2024-05-14T09:19:20.076 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-14T09:19:20.076 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681 --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/valgrind} --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681/orig.config.yaml 2024-05-14T09:19:20.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T09:19:20.221 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681 branch: wip-vshankar-testing-20240509.053109-debug description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/valgrind} email: vshankar@redhat.com first_in_suite: false job_id: '7705681' kernel: flavor: default kdb: true sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240509.053109-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow request - SLOW_OPS - MON_DOWN sha1: e2b755a64f0d72176b57299d02e880cf0620d780 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: e2b755a64f0d72176b57299d02e880cf0620d780 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240509.053109-debug sha1: e2b755a64f0d72176b57299d02e880cf0620d780 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 6285 sha1: e2b755a64f0d72176b57299d02e880cf0620d780 sleep_before_teardown: 0 subset: 548/1024 suite: fs suite_branch: wip-vshankar-testing-20240509.053109-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e2b755a64f0d72176b57299d02e880cf0620d780 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIPdqmRcfkAd8InfGtLXOKFfEPYARVHKrYuYM0eW2pW7fKonJ75X8tAReGE68/ACIBchR2/DXapwr3ZLSmNmi0= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIZsn4PaLA5f0ZhIB56Idv0+jgfWuLQa+HklIyQYCqxiE/mjddYUvqk3d4GBzUTabTrwiGivMcyAAl1zC4jrAw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-14_07:04:04 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-14T09:19:20.222 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa; will attempt to use it 2024-05-14T09:19:20.222 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks 2024-05-14T09:19:20.222 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-14T09:19:20.224 INFO:teuthology.task.internal:Checking packages... 2024-05-14T09:19:20.248 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e2b755a64f0d72176b57299d02e880cf0620d780' 2024-05-14T09:19:20.248 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-14T09:19:20.249 INFO:teuthology.packaging:ref: None 2024-05-14T09:19:20.249 INFO:teuthology.packaging:tag: None 2024-05-14T09:19:20.249 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240509.053109-debug 2024-05-14T09:19:20.249 INFO:teuthology.packaging:sha1: e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:19:20.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240509.053109-debug 2024-05-14T09:19:20.392 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3588.ge2b755a6 2024-05-14T09:19:20.393 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-14T09:19:20.400 INFO:teuthology.task.internal:no buildpackages task found 2024-05-14T09:19:20.400 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-14T09:19:20.407 INFO:teuthology.task.internal:Saving configuration 2024-05-14T09:19:20.425 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-14T09:19:20.431 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T09:19:20.455 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 09:14:12.406492', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIPdqmRcfkAd8InfGtLXOKFfEPYARVHKrYuYM0eW2pW7fKonJ75X8tAReGE68/ACIBchR2/DXapwr3ZLSmNmi0='} 2024-05-14T09:19:20.477 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 09:14:12.404503', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIZsn4PaLA5f0ZhIB56Idv0+jgfWuLQa+HklIyQYCqxiE/mjddYUvqk3d4GBzUTabTrwiGivMcyAAl1zC4jrAw='} 2024-05-14T09:19:20.477 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-14T09:19:20.483 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-14T09:19:20.484 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-14T09:19:20.484 INFO:teuthology.run_tasks:Running task console_log... 2024-05-14T09:19:20.558 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f07ff6c4f70>, signals=[15]) 2024-05-14T09:19:20.559 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-14T09:19:20.567 INFO:teuthology.task.internal:Opening connections... 2024-05-14T09:19:20.567 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T09:19:20.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:19:20.649 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-05-14T09:19:20.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:19:20.724 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-14T09:19:20.731 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-05-14T09:19:20.749 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-05-14T09:19:20.749 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-05-14T09:19:20.807 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-05-14T09:19:20.807 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-05-14T09:19:20.807 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-05-14T09:19:20.807 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-05-14T09:19:20.807 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-05-14T09:19:20.807 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-05-14T09:19:20.807 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T09:19:20.807 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-05-14T09:19:20.808 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-05-14T09:19:20.808 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T09:19:20.808 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-05-14T09:19:20.808 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T09:19:20.808 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T09:19:20.808 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T09:19:20.808 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-05-14T09:19:20.834 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-05-14T09:19:20.852 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-05-14T09:19:20.853 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-05-14T09:19:20.910 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-05-14T09:19:20.910 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-05-14T09:19:20.910 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-05-14T09:19:20.910 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-05-14T09:19:20.910 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-05-14T09:19:20.910 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-05-14T09:19:20.910 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T09:19:20.910 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-05-14T09:19:20.910 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-05-14T09:19:20.910 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T09:19:20.910 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-05-14T09:19:20.911 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T09:19:20.911 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T09:19:20.911 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T09:19:20.911 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-05-14T09:19:20.934 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-14T09:19:20.943 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-14T09:19:20.979 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-14T09:19:20.979 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-05-14T09:19:20.982 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-05-14T09:19:20.999 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-14T09:19:21.005 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-14T09:19:21.006 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-05-14T09:19:21.040 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-05-14T09:19:21.158 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-14T09:19:21.208 INFO:teuthology.run_tasks:Running task kernel... 2024-05-14T09:19:21.222 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'} 2024-05-14T09:19:21.223 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}}, timeout 300 2024-05-14T09:19:21.223 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T09:19:21.223 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T09:19:21.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T09:19:21.240 DEBUG:teuthology.task.kernel:sha1 for mon.b is fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T09:19:21.240 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e"... 2024-05-14T09:19:21.240 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-05-14T09:19:21.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T09:19:21.241 DEBUG:teuthology.task.kernel:sha1 for mon.a is fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T09:19:21.241 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e"... 2024-05-14T09:19:21.242 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-05-14T09:19:21.298 INFO:teuthology.orchestra.run.smithi196.stdout:5.14.0-437.el9.x86_64 2024-05-14T09:19:21.298 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T09:19:21.299 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-14T09:19:21.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T09:19:21.303 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-437.el9.x86_64 2024-05-14T09:19:21.303 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T09:19:21.303 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-14T09:19:21.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T09:19:21.443 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum upgrade -y linux-firmware 2024-05-14T09:19:21.524 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum upgrade -y linux-firmware 2024-05-14T09:19:23.655 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-14T09:19:25.540 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-14T09:19:26.092 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.1 MB 00:02 2024-05-14T09:19:27.859 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-05-14T09:19:30.690 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.2 MB 00:01 2024-05-14T09:19:32.018 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-14T09:19:32.232 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 16 kB 00:00 2024-05-14T09:19:33.428 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 16 kB 00:00 2024-05-14T09:19:34.053 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-14T09:19:39.208 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-14T09:19:41.313 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-05-14T09:19:41.314 INFO:teuthology.orchestra.run.smithi196.stdout:Nothing to do. 2024-05-14T09:19:41.314 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-05-14T09:19:41.409 INFO:teuthology.task.kernel:Downloading kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.b... 2024-05-14T09:19:41.410 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T09:19:41.551 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ 2024-05-14T09:19:41.551 DEBUG:teuthology.orchestra.run.smithi196:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-14T09:19:41.553 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi196.front.sepia.ceph.com to complete... 2024-05-14T09:19:48.861 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 1.4 MB/s | 21 MB 00:15 2024-05-14T09:19:54.003 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-14T09:19:56.098 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-14T09:19:56.099 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-14T09:19:56.099 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-14T09:19:56.220 INFO:teuthology.task.kernel:Downloading kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.a... 2024-05-14T09:19:56.221 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T09:19:56.455 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ 2024-05-14T09:19:56.455 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-14T09:19:56.458 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi135.front.sepia.ceph.com to complete... 2024-05-14T09:20:14.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14 09:20:14 URL:https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm [357387737/357387737] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-14T09:20:14.541 INFO:teuthology.orchestra.run.smithi135.stderr:FINISHED --2024-05-14 09:20:14-- 2024-05-14T09:20:14.541 INFO:teuthology.orchestra.run.smithi135.stderr:Total wall clock time: 18s 2024-05-14T09:20:14.541 INFO:teuthology.orchestra.run.smithi135.stderr:Downloaded: 1 files, 341M in 18s (19.2 MB/s) 2024-05-14T09:20:14.544 INFO:teuthology.task.kernel:Installing kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.a... 2024-05-14T09:20:14.544 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-14T09:20:16.692 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying... ######################################## 2024-05-14T09:20:16.873 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing... ######################################## 2024-05-14T09:20:17.006 INFO:teuthology.orchestra.run.smithi135.stdout:Updating / installing... 2024-05-14T09:20:24.970 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-6.9.0_rc3_gfb9a6a44107e-1 ######################################## 2024-05-14T09:20:26.897 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14 09:20:26 URL:https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm [357387737/357387737] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-14T09:20:26.897 INFO:teuthology.orchestra.run.smithi196.stderr:FINISHED --2024-05-14 09:20:26-- 2024-05-14T09:20:26.897 INFO:teuthology.orchestra.run.smithi196.stderr:Total wall clock time: 45s 2024-05-14T09:20:26.897 INFO:teuthology.orchestra.run.smithi196.stderr:Downloaded: 1 files, 341M in 45s (7.59 MB/s) 2024-05-14T09:20:26.900 INFO:teuthology.task.kernel:Installing kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.b... 2024-05-14T09:20:26.900 DEBUG:teuthology.orchestra.run.smithi196:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-14T09:20:29.030 INFO:teuthology.orchestra.run.smithi196.stdout:Verifying... ######################################## 2024-05-14T09:20:29.155 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing... ######################################## 2024-05-14T09:20:29.269 INFO:teuthology.orchestra.run.smithi196.stdout:Updating / installing... 2024-05-14T09:20:37.211 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-6.9.0_rc3_gfb9a6a44107e-1 ######################################## 2024-05-14T09:21:05.416 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-14T09:21:05.416 DEBUG:teuthology.orchestra.run.smithi135:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-14T09:21:05.499 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/System.map-6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:05.499 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/config-6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/System.map 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/config 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-14T09:21:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-14T09:21:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm.ko 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ansi_cprng.ko 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/anubis.ko 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/arc4.ko 2024-05-14T09:21:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_memcpy.ko 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_pq.ko 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_tx.ko 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_xor.ko 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/raid6test.ko 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authenc.ko 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authencesn.ko 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blake2b_generic.ko 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_common.ko 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_generic.ko 2024-05-14T09:21:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/camellia_generic.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast5_generic.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast6_generic.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast_common.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ccm.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cmac.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crc32_generic.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_engine.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_user.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cts.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/des_generic.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/dh_generic.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/echainiv.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/essiv.ko 2024-05-14T09:21:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/fcrypt.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/khazad.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4hc.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/md4.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/michael_mic.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcbc.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcrypt.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/rmd160.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/seed.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/serpent_generic.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tcrypt.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tea.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_common.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_generic.ko 2024-05-14T09:21:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/vmac.ko 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/wp512.ko 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xcbc.ko 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xor.ko 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xxhash_generic.ko 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_pad.ko 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ec_sys.ko 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/platform_profile.ko 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbs.ko 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbshc.ko 2024-05-14T09:21:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/video.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/acard-ahci.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci_platform.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ata_generic.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci_platform.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_acpi.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ali.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_amd.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_artop.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atiixp.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atp867x.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd640.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd64x.ko 2024-05-14T09:21:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cypress.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_efar.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt366.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt37x.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it8213.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it821x.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_jmicron.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_marvell.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_mpiix.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_netcell.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ninja32.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87410.ko 2024-05-14T09:21:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87415.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_oldpiix.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_opti.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_optidma.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pcmcia.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_piccolo.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rdc.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sch.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_serverworks.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sil680.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sis.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sl82c105.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_triflex.ko 2024-05-14T09:21:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_via.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pdc_adma.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_inic162x.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_mv.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_nv.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_promise.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_qstor.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil24.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sis.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_svw.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sx4.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_uli.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_via.ko 2024-05-14T09:21:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_vsc.ko 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ks0108.ko 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/bcma.ko 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/aoe.ko 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/brd.ko 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd 2024-05-14T09:21:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/drbd.ko 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/floppy.ko 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/loop.ko 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/nbd.ko 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/null_blk.ko 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/pktcdvd.ko 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/rbd.ko 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/virtio_blk.ko 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkfront.ko 2024-05-14T09:21:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/zram.ko 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hangcheck-timer.ko 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/via-rng.ko 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-14T09:21:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/lp.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/mwave.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ppdev.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tlclk.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-14T09:21:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/uv_mmtimer.ko 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/virtio_console.ko 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp.ko 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat 2024-05-14T09:21:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-aes.ko 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-sha.ko 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/dca.ko 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw 2024-05-14T09:21:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/amd64_edac.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/e752x_edac.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/edac_mce_amd.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3000_edac.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3200_edac.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5100_edac.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5400_edac.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7300_edac.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7core_edac.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i82975x_edac.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ie31200_edac.ko 2024-05-14T09:21:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/sb_edac.ko 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/x38_edac.ko 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/edd.ko 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ich.ko 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-appleir.ko 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-aureal.ko 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-axff.ko 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-dr.ko 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elecom.ko 2024-05-14T09:21:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elo.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-emsff.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gaff.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gt683r.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gyration.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtekff.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-hyperv.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-icade.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-keytouch.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kye.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lcpower.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-led.ko 2024-05-14T09:21:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lenovo.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-multitouch.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ortek.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-penmount.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-petalynx.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-picolcd.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-pl.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-plantronics.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-primax.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-rmi.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-common.ko 2024-05-14T09:21:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-saitek.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-samsung.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sjoy.ko 2024-05-14T09:21:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sony.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-speedlink.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-steelseries.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sunplus.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tivo.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tmff.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-topseed.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-twinhan.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-uclogic.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-waltop.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-wiimote.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-xinmo.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zpff.ko 2024-05-14T09:21:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zydacron.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/uhid.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/wacom.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_balloon.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_utils.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_vmbus.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru3.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7414.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7418.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adc128d818.ko 2024-05-14T09:21:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1025.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1026.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1029.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1031.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm9240.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ads7828.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7410.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7411.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7462.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7470.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7475.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7x10.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/amc6821.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/applesmc.ko 2024-05-14T09:21:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asb100.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asc7621.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/atxp1.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/coretemp.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dme1737.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds1621.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds620.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc1403.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc6w201.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71805f.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71882fg.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f75375s.ko 2024-05-14T09:21:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fam15h_power.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fschmd.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g760a.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g762.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl518sm.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl520sm.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5500_temp.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5k_amb.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmaem.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmpex.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina209.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina2xx.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/it87.ko 2024-05-14T09:21:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k10temp.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k8temp.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lineage-pem.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm63.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm73.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm75.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm77.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm78.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm80.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm83.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm85.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm87.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm90.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm92.ko 2024-05-14T09:21:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm93.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95234.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95241.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95245.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc2945.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4151.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4215.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4222.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4245.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4260.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4261.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max16065.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1619.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1668.ko 2024-05-14T09:21:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max197.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6639.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6650.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6697.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mcp3021.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6683.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775-core.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct7802.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87360.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87427.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pcf8591.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-14T09:21:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/powr1220.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5627.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5636.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-14T09:21:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht15.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht21.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/shtc1.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sis5595.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47b397.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m1.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m192.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/thmc50.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp102.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp103.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp401.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp421.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via-cputemp.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via686a.ko 2024-05-14T09:21:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt1211.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt8231.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627ehf.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627hf.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83781d.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83791d.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83792d.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83793.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83795.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l785ts.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l786ng.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-14T09:21:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-14T09:21:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-dev.ko 2024-05-14T09:21:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-mux.ko 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-smbus.ko 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-stub.ko 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_core.ko 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-14T09:21:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-14T09:21:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/gameport.ko 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/joydev.ko 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse 2024-05-14T09:21:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/appletouch.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/bcm5974.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/cyapatp.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/sermouse.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/altera_ps2.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/arc_ps2.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-14T09:21:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serio_raw.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/sparse-keymap.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-blinkm.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3530.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp3944.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-ss4200.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-14T09:21:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/bcache.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bio-prison.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache-smq.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-crypt.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-delay.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-flakey.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log-userspace.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-multipath.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-queue-length.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-raid.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-round-robin.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-service-time.ko 2024-05-14T09:21:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-switch.ko 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-thin-pool.ko 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-verity.ko 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid0.ko 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid1.ko 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid10.ko 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid456.ko 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptbase.ko 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptctl.ko 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptfc.ko 2024-05-14T09:21:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptlan.ko 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptsas.ko 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptscsih.ko 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptspi.ko 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_ich.ko 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_sch.ko 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mfd-core.ko 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/sm501.ko 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/viperboard.ko 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/vx855.ko 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wl1273-core.ko 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl 2024-05-14T09:21:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds9802als.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds990x.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/bh1770glc.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/cb710.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/at24.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/max6875.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/enclosure.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hpilo.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29003.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29020.ko 2024-05-14T09:21:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-me.ko 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-txe.ko 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei.ko 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_7xx1.ko 2024-05-14T09:21:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_core.ko 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tsl2550.ko 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_balloon.ko 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/bonding.ko 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-14T09:21:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dummy.ko 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/eql.ko 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec 2024-05-14T09:21:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-14T09:21:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet 2024-05-14T09:21:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-14T09:21:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-14T09:21:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dnet.ko 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ethoc.ko 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fealnx.ko 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k 2024-05-14T09:21:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/jme.ko 2024-05-14T09:21:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-14T09:21:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-14T09:21:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-14T09:21:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-14T09:21:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-14T09:21:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/geneve.ko 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ifb.ko 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvlan.ko 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvtap.ko 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio.ko 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-14T09:21:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mii.ko 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/net_failover.ko 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/netconsole.ko 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/nlmon.ko 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/amd.ko 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-14T09:21:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm87xx.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/broadcom.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/cicada.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/davicom.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/dp83640.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/et1011c.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/icplus.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/lxt.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/marvell.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/micrel.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/national.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/phylink.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/qsemi.ko 2024-05-14T09:21:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/realtek.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/smsc.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ste10Xp.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/vitesse.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_async.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppoe.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppox.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pptp.ko 2024-05-14T09:21:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slhc.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slip.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sungem_phy.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tap.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_random.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tun.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/veth.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/virtio_net.ko 2024-05-14T09:21:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/vxlan.ko 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netfront.ko 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ntb.ko 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme-core.ko 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme.ko 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport 2024-05-14T09:21:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport.ko 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_cs.ko 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_pc.ko 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_serial.ko 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/xen-pcifront.ko 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/i82092.ko 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pd6729.ko 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-14T09:21:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acerhdf.ko 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-14T09:21:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/hdaps.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel_ips.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-14T09:21:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi.ko 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps_parport.ko 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/pps_core.ko 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp.ko 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp_kvm.ko 2024-05-14T09:21:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/fmpm.ko 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-14T09:21:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-em3027.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max6900.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-14T09:21:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-x1205.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-9xxx.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-sas.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-xxxx.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/BusLogic.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/a100u2w.ko 2024-05-14T09:21:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/advansys.ko 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/am53c974.ko 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/atp870u.ko 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/bfa.ko 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc 2024-05-14T09:21:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ch.ko 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dc395x.ko 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler 2024-05-14T09:21:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dmx3191d.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esp_scsi.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/fnic.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hpsa.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hptiop.ko 2024-05-14T09:21:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hv_storvsc.ko 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/initio.ko 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ipr.ko 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ips.ko 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/isci.ko 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/libfc.ko 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi.ko 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/libsas.ko 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc 2024-05-14T09:21:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid.ko 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvumi.ko 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pmcraid.ko 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla1280.ko 2024-05-14T09:21:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/raid_class.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_debug.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ses.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/st.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/stex.ko 2024-05-14T09:21:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/virtio_scsi.ko 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/wd719x.ko 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ssb.ko 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_file.ko 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_iblock.ko 2024-05-14T09:21:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_mod.ko 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_pscsi.ko 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_user.ko 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-14T09:21:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-14T09:21:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_gsm.ko 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_hdlc.ko 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/nozomi.ko 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/arc_uart.ko 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-14T09:21:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio.ko 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_aec.ko 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_cif.ko 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pci_generic.ko 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_sercos3.ko 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-acm.ko 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usblp.ko 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usbtmc.ko 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image 2024-05-14T09:21:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/mdc800.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/microtek.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/adutux.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/appledisplay.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi26.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi62.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ezusb.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/idmouse.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/iowarrior.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ldusb.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/legousbtower.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-14T09:21:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usb3503.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usblcd.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/uss720.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/yurex.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-generic.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/aircable.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ark3116.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ch341.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cp210x.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cyberjack.ko 2024-05-14T09:21:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/empeg.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_ti.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipaq.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipw.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ir-usb.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-14T09:21:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mct_u232.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7720.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7840.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/navman.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/omninet.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/opticon.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/option.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/oti6858.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/pl2303.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcaux.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcserial.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/quatech2.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/safe_serial.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/sierra.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-14T09:21:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ssu100.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/symbolserial.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_debug.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/visor.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/whiteheat.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/uas.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-14T09:21:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-karma.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/usb-storage.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-14T09:21:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio.ko 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost.ko 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_net.ko 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_scsi.ko 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/apple_bl.ko 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lcd.ko 2024-05-14T09:21:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio.ko 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_balloon.ko 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_mmio.ko 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci.ko 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_ring.ko 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2482.ko 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2490.ko 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves 2024-05-14T09:21:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/wire.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-14T09:21:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/hpwdt.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/i6300esb.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ib700wdt.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ibmasr.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it87_wdt.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/machzwd.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/nv_tco.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-14T09:21:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/softdog.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/via_wdt.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wdt_pci.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/xen_wdt.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-evtchn.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntalloc.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntdev.ko 2024-05-14T09:21:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-privcmd.ko 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/9p.ko 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/affs.ko 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/befs.ko 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/binfmt_misc.ko 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/btrfs.ko 2024-05-14T09:21:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/cachefiles.ko 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ceph.ko 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/coda.ko 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/cramfs.ko 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/dlm.ko 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/f2fs.ko 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat 2024-05-14T09:21:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/fat.ko 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/msdos.ko 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/vfat.ko 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/cuse.ko 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/fuse.ko 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/gfs2.ko 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/hfs.ko 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/hfsplus.ko 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/isofs.ko 2024-05-14T09:21:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/jfs.ko 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/lockd.ko 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/minix.ko 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/netfs.ko 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-14T09:21:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfs.ko 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv3.ko 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv4.ko 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/grace.ko 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/nfs_acl.ko 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/nfsd.ko 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/nilfs2.ko 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-celtic.ko 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-centeuro.ko 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-croatian.ko 2024-05-14T09:21:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-cyrillic.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-gaelic.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-greek.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-iceland.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-inuit.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-roman.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-romanian.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-turkish.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1250.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1251.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1255.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp737.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp775.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp850.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp852.ko 2024-05-14T09:21:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp855.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp857.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp860.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp861.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp862.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp863.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp864.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp865.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp866.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp869.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp874.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp932.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp936.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp949.ko 2024-05-14T09:21:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp950.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_euc-jp.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-1.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-13.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-14.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-15.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-2.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-3.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-4.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-5.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-6.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-7.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-9.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-r.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-ru.ko 2024-05-14T09:21:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-u.ko 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_utf8.ko 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2.ko 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs 2024-05-14T09:21:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/overlay.ko 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ramoops.ko 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/reiserfs.ko 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/romfs.ko 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/cifs.ko 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_arc4.ko 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_md4.ko 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs 2024-05-14T09:21:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/squashfs.ko 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/sysv.ko 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/udf.ko 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ufs.ko 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/xfs.ko 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu/rcutorture.ko 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/torture.ko 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace 2024-05-14T09:21:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/asn1_encoder.ko 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc-itu-t.ko 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc8.ko 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libarc4.ko 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libdes.ko 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/libcrc32c.ko 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lru_cache.ko 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4_compress.ko 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4hc_compress.ko 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/cordic.ko 2024-05-14T09:21:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/raid6_pq.ko 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_bm.ko 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_fsm.ko 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_kmp.ko 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd/zstd_compress.ko 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/hwpoison-inject.ko 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/6lowpan.ko 2024-05-14T09:21:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_dest.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_fragment.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_hop.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_mobility.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_routing.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_udp.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/garp.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/mrp.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/p8022.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/psnap.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/stp.ko 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q 2024-05-14T09:21:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/8021q.ko 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet.ko 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_fd.ko 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_rdma.ko 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_virtio.ko 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/batman-adv.ko 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/br_netfilter.ko 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/bridge.ko 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-14T09:21:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-14T09:21:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtables.ko 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/libceph.ko 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/failover.ko 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/pktgen.ko 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp.ko 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_diag.ko 2024-05-14T09:21:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv4.ko 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv6.ko 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver/dns_resolver.ko 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/dsa_core.ko 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_brcm.ko 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_dsa.ko 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_none.ko 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_trailer.ko 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154.ko 2024-05-14T09:21:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ah4.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/esp4.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/fou.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/gre.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/inet_diag.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_gre.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_tunnel.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_vti.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipcomp.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipip.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-14T09:21:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-14T09:21:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_bic.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_dctcp.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_diag.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_highspeed.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_htcp.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_hybla.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_illinois.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_lp.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_scalable.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_vegas.ko 2024-05-14T09:21:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_veno.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_westwood.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_yeah.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tunnel4.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_diag.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_tunnel.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ah6.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/esp6.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/fou6.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_tunnel.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_vti.ko 2024-05-14T09:21:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ipcomp6.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-14T09:21:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/sit.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/tunnel6.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key 2024-05-14T09:21:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/af_key.ko 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_core.ko 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_eth.ko 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip.ko 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip6.ko 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_netlink.ko 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ppp.ko 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc.ko 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/mac802154.ko 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls 2024-05-14T09:21:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/mpls_gso.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-14T09:21:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-14T09:21:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conncount.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-14T09:21:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_log_syslog.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_irc.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_sip.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-14T09:21:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_tables.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_log.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_chain_nat.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_compat.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_ct.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fib.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_hash.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_limit.ko 2024-05-14T09:21:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_log.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_masq.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_nat.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_numgen.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_queue.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_quota.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_redir.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject_inet.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_socket.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_tunnel.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_AUDIT.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-14T09:21:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CT.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_DSCP.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HL.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HMARK.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LED.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LOG.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NETMAP.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFLOG.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_RATEEST.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_SECMARK.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-14T09:21:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TEE.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TPROXY.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TRACE.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_addrtype.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_bpf.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cgroup.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cluster.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_comment.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connbytes.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlabel.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlimit.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connmark.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_conntrack.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cpu.ko 2024-05-14T09:21:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dccp.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_devgroup.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dscp.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ecn.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_esp.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hashlimit.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_helper.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hl.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipcomp.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_iprange.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipvs.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_l2tp.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_length.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_limit.ko 2024-05-14T09:21:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mac.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mark.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_multiport.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nat.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nfacct.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_osf.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_owner.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_physdev.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_pkttype.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_policy.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_quota.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_rateest.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_realm.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_recent.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_sctp.ko 2024-05-14T09:21:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_set.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_socket.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_state.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_statistic.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_string.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpmss.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_time.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_u32.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/netlink_diag.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/nsh.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/openvswitch.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-geneve.ko 2024-05-14T09:21:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-gre.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-vxlan.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/af_packet_diag.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_rdma.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_tcp.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_csum.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_gact.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_mirred.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_nat.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_pedit.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_police.ko 2024-05-14T09:21:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_simple.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_skbedit.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_vlan.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_basic.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_bpf.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_flow.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_fw.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_route.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_u32.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_cmp.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_ipset.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_meta.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_nbyte.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_text.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_u32.ko 2024-05-14T09:21:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_choke.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_codel.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_drr.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_gred.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hfsc.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hhf.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_htb.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_ingress.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio_lib.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_multiq.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_netem.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_pie.ko 2024-05-14T09:21:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_plug.ko 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_prio.ko 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_qfq.ko 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_red.ko 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfb.ko 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfq.ko 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_tbf.ko 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_teql.ko 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp.ko 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp_diag.ko 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-14T09:21:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/sunrpc.ko 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc.ko 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc_diag.ko 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/unix_diag.ko 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock.ko 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-14T09:21:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys/trusted.ko 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias.bin 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.alias.bin 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.bin 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.modinfo 2024-05-14T09:21:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep 2024-05-14T09:21:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep.bin 2024-05-14T09:21:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.devname 2024-05-14T09:21:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.order 2024-05-14T09:21:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.softdep 2024-05-14T09:21:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols 2024-05-14T09:21:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols.bin 2024-05-14T09:21:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T09:21:05.639 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:05.639 DEBUG:teuthology.orchestra.run.smithi135:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-14T09:21:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:postinstall scriptlet (using /bin/sh): 2024-05-14T09:21:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T09:21:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: /usr/bin/kernel-install add 6.9.0-rc3-gfb9a6a44107e /lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T09:21:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2024-05-14T09:21:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:for file in vmlinuz System.map config; do 2024-05-14T09:21:05.662 INFO:teuthology.orchestra.run.smithi135.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e"; then 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: cp "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: fi 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:done 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -d "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" ] && \ 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" >/dev/null 2>&1; then 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: rm -rf "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: cp -r "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep" ]; then 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout: /usr/sbin/depmod 6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-install remove 6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2024-05-14T09:21:05.664 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.06 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 68.el9 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Group : Unspecified 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 8264254 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T09:21:05.741 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : builder@centos.org 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:21:05.742 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T09:21:05.743 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T09:21:05.743 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:05.743 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T09:21:06.398 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2024-05-14T09:21:07.825 INFO:teuthology.orchestra.run.smithi135.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T09:21:07.857 INFO:teuthology.orchestra.run.smithi135.stderr:done 2024-05-14T09:21:07.859 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-05-14T09:21:07.943 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.saoLtOectV 2024-05-14T09:21:07.944 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.saoLtOectV 2024-05-14T09:21:07.969 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.saoLtOectV 2024-05-14T09:21:08.118 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.saoLtOectV is 6KB 2024-05-14T09:21:08.166 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.saoLtOectV 2024-05-14T09:21:08.180 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T09:21:08.253 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T09:21:08.253 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T09:21:08.253 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T09:21:08.253 INFO:teuthology.orchestra.run.smithi135.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e.conf 2024-05-14T09:21:08.254 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:08.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2024-05-14T09:21:14.504 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-14T09:21:14.504 DEBUG:teuthology.orchestra.run.smithi196:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-14T09:21:14.578 INFO:teuthology.orchestra.run.smithi196.stdout:/boot/System.map-6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:14.578 INFO:teuthology.orchestra.run.smithi196.stdout:/boot/config-6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:14.578 INFO:teuthology.orchestra.run.smithi196.stdout:/boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:14.578 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/System.map 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/config 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-14T09:21:14.579 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu 2024-05-14T09:21:14.580 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm.ko 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ansi_cprng.ko 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/anubis.ko 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/arc4.ko 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_memcpy.ko 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_pq.ko 2024-05-14T09:21:14.581 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_tx.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_xor.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/raid6test.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authenc.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authencesn.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blake2b_generic.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_common.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_generic.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/camellia_generic.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast5_generic.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast6_generic.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast_common.ko 2024-05-14T09:21:14.582 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ccm.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cmac.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crc32_generic.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_engine.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_user.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cts.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/des_generic.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/dh_generic.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/echainiv.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/essiv.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/fcrypt.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/khazad.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4hc.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/md4.ko 2024-05-14T09:21:14.583 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/michael_mic.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcbc.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcrypt.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/rmd160.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/seed.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/serpent_generic.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tcrypt.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tea.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_common.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_generic.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/vmac.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/wp512.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xcbc.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xor.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xxhash_generic.ko 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers 2024-05-14T09:21:14.584 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_pad.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ec_sys.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/platform_profile.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbs.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbshc.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/video.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/acard-ahci.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci_platform.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ata_generic.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci_platform.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_acpi.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ali.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_amd.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_artop.ko 2024-05-14T09:21:14.585 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atiixp.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atp867x.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd640.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd64x.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cypress.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_efar.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt366.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt37x.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it8213.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it821x.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_jmicron.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_marvell.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_mpiix.ko 2024-05-14T09:21:14.586 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_netcell.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ninja32.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87410.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87415.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_oldpiix.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_opti.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_optidma.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pcmcia.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_piccolo.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rdc.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sch.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_serverworks.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sil680.ko 2024-05-14T09:21:14.587 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sis.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sl82c105.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_triflex.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_via.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pdc_adma.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_inic162x.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_mv.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_nv.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_promise.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_qstor.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil24.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sis.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_svw.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sx4.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_uli.ko 2024-05-14T09:21:14.588 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_via.ko 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_vsc.ko 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ks0108.ko 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/bcma.ko 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/aoe.ko 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/brd.ko 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd 2024-05-14T09:21:14.589 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/drbd.ko 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/floppy.ko 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/loop.ko 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/nbd.ko 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/null_blk.ko 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/pktcdvd.ko 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/rbd.ko 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/virtio_blk.ko 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkfront.ko 2024-05-14T09:21:14.590 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/zram.ko 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hangcheck-timer.ko 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/via-rng.ko 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-14T09:21:14.591 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/lp.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/mwave.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ppdev.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tlclk.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-14T09:21:14.592 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/uv_mmtimer.ko 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/virtio_console.ko 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp.ko 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel 2024-05-14T09:21:14.593 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-aes.ko 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-sha.ko 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/dca.ko 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma 2024-05-14T09:21:14.594 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/amd64_edac.ko 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/e752x_edac.ko 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/edac_mce_amd.ko 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3000_edac.ko 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3200_edac.ko 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5100_edac.ko 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5400_edac.ko 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7300_edac.ko 2024-05-14T09:21:14.595 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7core_edac.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i82975x_edac.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ie31200_edac.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/sb_edac.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/x38_edac.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/edd.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ich.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-appleir.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-aureal.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-axff.ko 2024-05-14T09:21:14.596 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-dr.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elecom.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elo.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-emsff.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gaff.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gt683r.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gyration.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtekff.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-hyperv.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-icade.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-keytouch.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kye.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lcpower.ko 2024-05-14T09:21:14.597 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-led.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lenovo.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-multitouch.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ortek.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-penmount.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-petalynx.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-picolcd.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-pl.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-plantronics.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-primax.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-rmi.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-14T09:21:14.598 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-common.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-saitek.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-samsung.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-14T09:21:14.599 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sjoy.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sony.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-speedlink.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-steelseries.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sunplus.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tivo.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tmff.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-topseed.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-twinhan.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-uclogic.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-waltop.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-wiimote.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-xinmo.ko 2024-05-14T09:21:14.600 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zpff.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zydacron.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/uhid.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/wacom.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_balloon.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_utils.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_vmbus.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru3.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7414.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7418.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adc128d818.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1025.ko 2024-05-14T09:21:14.601 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1026.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1029.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1031.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm9240.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ads7828.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7410.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7411.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7462.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7470.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7475.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7x10.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/amc6821.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/applesmc.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asb100.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asc7621.ko 2024-05-14T09:21:14.602 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/atxp1.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/coretemp.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dme1737.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds1621.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds620.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc1403.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc6w201.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71805f.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71882fg.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f75375s.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fam15h_power.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fschmd.ko 2024-05-14T09:21:14.603 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g760a.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g762.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl518sm.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl520sm.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5500_temp.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5k_amb.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmaem.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmpex.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina209.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina2xx.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/it87.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k10temp.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k8temp.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lineage-pem.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm63.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm73.ko 2024-05-14T09:21:14.604 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm75.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm77.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm78.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm80.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm83.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm85.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm87.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm90.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm92.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm93.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95234.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95241.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95245.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc2945.ko 2024-05-14T09:21:14.605 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4151.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4215.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4222.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4245.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4260.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4261.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max16065.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1619.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1668.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max197.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6639.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6650.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6697.ko 2024-05-14T09:21:14.606 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mcp3021.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6683.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775-core.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct7802.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87360.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87427.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pcf8591.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-14T09:21:14.607 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/powr1220.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5627.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5636.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht15.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht21.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/shtc1.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sis5595.ko 2024-05-14T09:21:14.608 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47b397.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m1.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m192.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/thmc50.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp102.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp103.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp401.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp421.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via-cputemp.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via686a.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt1211.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt8231.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627ehf.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627hf.ko 2024-05-14T09:21:14.609 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83781d.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83791d.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83792d.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83793.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83795.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l785ts.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l786ng.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-14T09:21:14.610 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-14T09:21:14.611 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-dev.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-mux.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-smbus.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-stub.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_core.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-14T09:21:14.612 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert 2024-05-14T09:21:14.613 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/gameport.ko 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/joydev.ko 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/appletouch.ko 2024-05-14T09:21:14.614 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/bcm5974.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/cyapatp.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/sermouse.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/altera_ps2.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/arc_ps2.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serio_raw.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/sparse-keymap.ko 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds 2024-05-14T09:21:14.615 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-blinkm.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3530.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp3944.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-ss4200.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md 2024-05-14T09:21:14.616 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/bcache.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bio-prison.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache-smq.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-crypt.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-delay.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-flakey.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log-userspace.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-multipath.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-queue-length.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-raid.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-round-robin.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-service-time.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-switch.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-thin-pool.ko 2024-05-14T09:21:14.617 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-verity.ko 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid0.ko 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid1.ko 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid10.ko 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid456.ko 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptbase.ko 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptctl.ko 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptfc.ko 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptlan.ko 2024-05-14T09:21:14.618 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptsas.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptscsih.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptspi.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_ich.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_sch.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mfd-core.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/sm501.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/viperboard.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/vx855.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wl1273-core.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds9802als.ko 2024-05-14T09:21:14.619 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds990x.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/bh1770glc.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/cb710.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/at24.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/max6875.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/enclosure.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hpilo.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29003.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29020.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei 2024-05-14T09:21:14.620 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-me.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-txe.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_7xx1.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_core.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tsl2550.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_balloon.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-14T09:21:14.621 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/bonding.ko 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dummy.ko 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/eql.ko 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com 2024-05-14T09:21:14.622 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon 2024-05-14T09:21:14.623 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-14T09:21:14.624 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade 2024-05-14T09:21:14.625 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco 2024-05-14T09:21:14.626 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dnet.ko 2024-05-14T09:21:14.627 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ethoc.ko 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fealnx.ko 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-14T09:21:14.628 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/jme.ko 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox 2024-05-14T09:21:14.629 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion 2024-05-14T09:21:14.630 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek 2024-05-14T09:21:14.631 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-14T09:21:14.632 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via 2024-05-14T09:21:14.633 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/geneve.ko 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ifb.ko 2024-05-14T09:21:14.634 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvlan.ko 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvtap.ko 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio.ko 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mii.ko 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/net_failover.ko 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/netconsole.ko 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/nlmon.ko 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs 2024-05-14T09:21:14.635 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/amd.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm87xx.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/broadcom.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/cicada.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/davicom.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/dp83640.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/et1011c.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/icplus.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/lxt.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/marvell.ko 2024-05-14T09:21:14.636 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/micrel.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/national.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/phylink.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/qsemi.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/realtek.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/smsc.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ste10Xp.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/vitesse.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_async.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-14T09:21:14.637 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppoe.ko 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppox.ko 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pptp.ko 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slhc.ko 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slip.ko 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sungem_phy.ko 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tap.ko 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team.ko 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-14T09:21:14.638 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_random.ko 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tun.ko 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/veth.ko 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/virtio_net.ko 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/vxlan.ko 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netfront.ko 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ntb.ko 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host 2024-05-14T09:21:14.639 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme-core.ko 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme.ko 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport.ko 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_cs.ko 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_pc.ko 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_serial.ko 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/xen-pcifront.ko 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/i82092.ko 2024-05-14T09:21:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pd6729.ko 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acerhdf.ko 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-14T09:21:14.641 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/hdaps.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel_ips.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-14T09:21:14.642 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi.ko 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps_parport.ko 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/pps_core.ko 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp.ko 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp_kvm.ko 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras 2024-05-14T09:21:14.643 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/fmpm.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-em3027.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-14T09:21:14.644 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max6900.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-14T09:21:14.645 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-x1205.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-9xxx.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-sas.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-xxxx.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/BusLogic.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/a100u2w.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/advansys.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-14T09:21:14.646 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/am53c974.ko 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/atp870u.ko 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/bfa.ko 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ch.ko 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-14T09:21:14.647 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dc395x.ko 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dmx3191d.ko 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-14T09:21:14.648 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esp_scsi.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/fnic.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hpsa.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hptiop.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hv_storvsc.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/initio.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ipr.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ips.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/isci.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-14T09:21:14.649 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/libfc.ko 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi.ko 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/libsas.ko 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid.ko 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas 2024-05-14T09:21:14.650 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvumi.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pmcraid.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla1280.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/raid_class.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_debug.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-14T09:21:14.651 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ses.ko 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/st.ko 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/stex.ko 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/virtio_scsi.ko 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/wd719x.ko 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb 2024-05-14T09:21:14.652 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ssb.ko 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_file.ko 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_iblock.ko 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_mod.ko 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_pscsi.ko 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_user.ko 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel 2024-05-14T09:21:14.653 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-14T09:21:14.654 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-14T09:21:14.655 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-14T09:21:14.655 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-14T09:21:14.655 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-14T09:21:14.655 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-14T09:21:14.655 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty 2024-05-14T09:21:14.655 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless 2024-05-14T09:21:14.657 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-14T09:21:14.657 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_gsm.ko 2024-05-14T09:21:14.657 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_hdlc.ko 2024-05-14T09:21:14.657 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/nozomi.ko 2024-05-14T09:21:14.657 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial 2024-05-14T09:21:14.657 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250 2024-05-14T09:21:14.657 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-14T09:21:14.657 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/arc_uart.ko 2024-05-14T09:21:14.657 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm 2024-05-14T09:21:14.657 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-14T09:21:14.657 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio.ko 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_aec.ko 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_cif.ko 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pci_generic.ko 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_sercos3.ko 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-acm.ko 2024-05-14T09:21:14.658 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usblp.ko 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usbtmc.ko 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/mdc800.ko 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/microtek.ko 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/adutux.ko 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/appledisplay.ko 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi26.ko 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi62.ko 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ezusb.ko 2024-05-14T09:21:14.659 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/idmouse.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/iowarrior.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ldusb.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/legousbtower.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usb3503.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usblcd.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/uss720.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/yurex.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-generic.ko 2024-05-14T09:21:14.660 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/aircable.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ark3116.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ch341.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cp210x.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cyberjack.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/empeg.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_ti.ko 2024-05-14T09:21:14.661 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipaq.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipw.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ir-usb.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mct_u232.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7720.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7840.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/navman.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/omninet.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/opticon.ko 2024-05-14T09:21:14.662 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/option.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/oti6858.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/pl2303.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcaux.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcserial.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/quatech2.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/safe_serial.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/sierra.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ssu100.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/symbolserial.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_debug.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-14T09:21:14.663 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/visor.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/whiteheat.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/uas.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-karma.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-14T09:21:14.664 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/usb-storage.ko 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio.ko 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost 2024-05-14T09:21:14.665 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_net.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_scsi.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/apple_bl.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lcd.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_balloon.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_mmio.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-14T09:21:14.666 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_ring.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2482.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2490.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-14T09:21:14.667 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/wire.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/hpwdt.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/i6300esb.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ib700wdt.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ibmasr.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-14T09:21:14.668 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it87_wdt.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/machzwd.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/nv_tco.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/softdog.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/via_wdt.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wdt_pci.ko 2024-05-14T09:21:14.669 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/xen_wdt.ko 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-evtchn.ko 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntalloc.ko 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntdev.ko 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-privcmd.ko 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p 2024-05-14T09:21:14.670 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/9p.ko 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/affs.ko 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/befs.ko 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/binfmt_misc.ko 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/btrfs.ko 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/cachefiles.ko 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ceph.ko 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/coda.ko 2024-05-14T09:21:14.671 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/cramfs.ko 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/dlm.ko 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/f2fs.ko 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/fat.ko 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/msdos.ko 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/vfat.ko 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/cuse.ko 2024-05-14T09:21:14.672 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/fuse.ko 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/gfs2.ko 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/hfs.ko 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/hfsplus.ko 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/isofs.ko 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/jfs.ko 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/lockd.ko 2024-05-14T09:21:14.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/minix.ko 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/netfs.ko 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfs.ko 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv3.ko 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv4.ko 2024-05-14T09:21:14.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/grace.ko 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/nfs_acl.ko 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/nfsd.ko 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/nilfs2.ko 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-celtic.ko 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-centeuro.ko 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-croatian.ko 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-cyrillic.ko 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-gaelic.ko 2024-05-14T09:21:14.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-greek.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-iceland.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-inuit.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-roman.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-romanian.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-turkish.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1250.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1251.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1255.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp737.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp775.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp850.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp852.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp855.ko 2024-05-14T09:21:14.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp857.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp860.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp861.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp862.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp863.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp864.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp865.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp866.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp869.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp874.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp932.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp936.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp949.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp950.ko 2024-05-14T09:21:14.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_euc-jp.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-1.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-13.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-14.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-15.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-2.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-3.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-4.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-5.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-6.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-7.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-9.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-r.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-ru.ko 2024-05-14T09:21:14.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-u.ko 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_utf8.ko 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2.ko 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs 2024-05-14T09:21:14.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/overlay.ko 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ramoops.ko 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/reiserfs.ko 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/romfs.ko 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/cifs.ko 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_arc4.ko 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_md4.ko 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/squashfs.ko 2024-05-14T09:21:14.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/sysv.ko 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/udf.ko 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ufs.ko 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/xfs.ko 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu/rcutorture.ko 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/torture.ko 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/asn1_encoder.ko 2024-05-14T09:21:14.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc-itu-t.ko 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc8.ko 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libarc4.ko 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libdes.ko 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/libcrc32c.ko 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lru_cache.ko 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4_compress.ko 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4hc_compress.ko 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/cordic.ko 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/raid6_pq.ko 2024-05-14T09:21:14.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_bm.ko 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_fsm.ko 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_kmp.ko 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd/zstd_compress.ko 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/hwpoison-inject.ko 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/6lowpan.ko 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_dest.ko 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_fragment.ko 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_hop.ko 2024-05-14T09:21:14.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_mobility.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_routing.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_udp.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/garp.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/mrp.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/p8022.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/psnap.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/stp.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/8021q.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_fd.ko 2024-05-14T09:21:14.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_rdma.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_virtio.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/batman-adv.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/br_netfilter.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/bridge.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-14T09:21:14.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtables.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-14T09:21:14.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/libceph.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/failover.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/pktgen.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_diag.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv4.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv6.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver/dns_resolver.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/dsa_core.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_brcm.ko 2024-05-14T09:21:14.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_dsa.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_none.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_trailer.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ah4.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/esp4.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/fou.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/gre.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/inet_diag.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_gre.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_tunnel.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_vti.ko 2024-05-14T09:21:14.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipcomp.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipip.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-14T09:21:14.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_bic.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_dctcp.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_diag.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_highspeed.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_htcp.ko 2024-05-14T09:21:14.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_hybla.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_illinois.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_lp.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_scalable.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_vegas.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_veno.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_westwood.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_yeah.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tunnel4.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_diag.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_tunnel.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ah6.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/esp6.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/fou6.ko 2024-05-14T09:21:14.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_tunnel.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_vti.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ipcomp6.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-14T09:21:14.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/sit.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/tunnel6.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-14T09:21:14.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/af_key.ko 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_core.ko 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_eth.ko 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip.ko 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip6.ko 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_netlink.ko 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ppp.ko 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc.ko 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/mac802154.ko 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls 2024-05-14T09:21:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/mpls_gso.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-14T09:21:14.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-14T09:21:14.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conncount.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-14T09:21:14.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_log_syslog.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_irc.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_sip.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_tables.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-14T09:21:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_log.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_chain_nat.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_compat.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_ct.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fib.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_hash.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_limit.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_log.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_masq.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_nat.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_numgen.ko 2024-05-14T09:21:14.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_queue.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_quota.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_redir.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject_inet.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_socket.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_tunnel.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_AUDIT.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CT.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_DSCP.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HL.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HMARK.ko 2024-05-14T09:21:14.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LED.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LOG.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NETMAP.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFLOG.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_RATEEST.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_SECMARK.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TEE.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TPROXY.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TRACE.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_addrtype.ko 2024-05-14T09:21:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_bpf.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cgroup.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cluster.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_comment.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connbytes.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlabel.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlimit.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connmark.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_conntrack.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cpu.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dccp.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_devgroup.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dscp.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ecn.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_esp.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hashlimit.ko 2024-05-14T09:21:14.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_helper.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hl.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipcomp.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_iprange.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipvs.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_l2tp.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_length.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_limit.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mac.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mark.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_multiport.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nat.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nfacct.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_osf.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_owner.ko 2024-05-14T09:21:14.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_physdev.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_pkttype.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_policy.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_quota.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_rateest.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_realm.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_recent.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_sctp.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_set.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_socket.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_state.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_statistic.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_string.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpmss.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_time.ko 2024-05-14T09:21:14.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_u32.ko 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/netlink_diag.ko 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/nsh.ko 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/openvswitch.ko 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-geneve.ko 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-gre.ko 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-vxlan.ko 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/af_packet_diag.ko 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds.ko 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_rdma.ko 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_tcp.ko 2024-05-14T09:21:14.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_csum.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_gact.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_mirred.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_nat.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_pedit.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_police.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_simple.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_skbedit.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_vlan.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_basic.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_bpf.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_flow.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_fw.ko 2024-05-14T09:21:14.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_route.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_u32.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_cmp.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_ipset.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_meta.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_nbyte.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_text.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_u32.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_choke.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_codel.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_drr.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_gred.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hfsc.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hhf.ko 2024-05-14T09:21:14.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_htb.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_ingress.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio_lib.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_multiq.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_netem.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_pie.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_plug.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_prio.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_qfq.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_red.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfb.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfq.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_tbf.ko 2024-05-14T09:21:14.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_teql.ko 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp.ko 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp_diag.ko 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/sunrpc.ko 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc.ko 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc_diag.ko 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix 2024-05-14T09:21:14.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/unix_diag.ko 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock.ko 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys 2024-05-14T09:21:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys/trusted.ko 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias.bin 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.alias.bin 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.bin 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.modinfo 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep.bin 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.devname 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.order 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.softdep 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols 2024-05-14T09:21:14.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols.bin 2024-05-14T09:21:14.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T09:21:14.715 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:14.715 DEBUG:teuthology.orchestra.run.smithi196:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-14T09:21:14.738 INFO:teuthology.orchestra.run.smithi196.stdout:postinstall scriptlet (using /bin/sh): 2024-05-14T09:21:14.738 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout: /usr/bin/kernel-install add 6.9.0-rc3-gfb9a6a44107e /lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:for file in vmlinuz System.map config; do 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e"; then 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout: cp "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout: fi 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:done 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -d "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" ] && \ 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" >/dev/null 2>&1; then 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout: rm -rf "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout: cp -r "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep" ]; then 2024-05-14T09:21:14.739 INFO:teuthology.orchestra.run.smithi196.stdout: /usr/sbin/depmod 6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2024-05-14T09:21:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-14T09:21:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T09:21:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-install remove 6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:14.740 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2024-05-14T09:21:14.741 DEBUG:teuthology.orchestra.run.smithi196:> sudo rpm -qi grub2-tools 2024-05-14T09:21:14.815 INFO:teuthology.orchestra.run.smithi196.stdout:Name : grub2-tools 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Epoch : 1 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Version : 2.06 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Release : 68.el9 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: x86_64 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Group : Unspecified 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Size : 8264254 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:License : GPLv3+ 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Packager : builder@centos.org 2024-05-14T09:21:14.816 INFO:teuthology.orchestra.run.smithi196.stdout:Vendor : CentOS 2024-05-14T09:21:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T09:21:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:Summary : Support tools for GRUB. 2024-05-14T09:21:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:Description : 2024-05-14T09:21:14.817 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:21:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T09:21:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T09:21:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T09:21:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:hardware devices. 2024-05-14T09:21:14.817 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:21:14.817 INFO:teuthology.orchestra.run.smithi196.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T09:21:14.818 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T09:21:14.818 INFO:teuthology.task.kernel:Updating grub on smithi196 to boot 6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:14.818 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T09:21:15.387 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-05-14T09:21:16.749 INFO:teuthology.orchestra.run.smithi196.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T09:21:16.790 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-05-14T09:21:16.793 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-05-14T09:21:16.824 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.RNDbpVfZZE 2024-05-14T09:21:16.824 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.RNDbpVfZZE 2024-05-14T09:21:16.890 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.RNDbpVfZZE 2024-05-14T09:21:17.023 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.RNDbpVfZZE is 6KB 2024-05-14T09:21:17.072 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.RNDbpVfZZE 2024-05-14T09:21:17.086 DEBUG:teuthology.orchestra.run.smithi196:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T09:21:17.147 INFO:teuthology.orchestra.run.smithi196.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T09:21:17.147 INFO:teuthology.orchestra.run.smithi196.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T09:21:17.147 INFO:teuthology.orchestra.run.smithi196.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T09:21:17.147 INFO:teuthology.orchestra.run.smithi196.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e.conf 2024-05-14T09:21:17.148 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:21:17.312 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2024-05-14T09:21:38.430 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-14T09:21:38.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-14T09:21:38.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:21:47.322 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-14T09:21:47.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-14T09:21:47.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:21:56.767 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-05-14T09:22:05.730 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-05-14T09:22:05.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-14T09:22:05.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:22:08.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-05-14T09:22:14.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-14T09:22:14.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:22:20.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-14T09:22:20.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:22:39.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-05-14T09:22:54.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-14T09:22:54.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:22:55.963 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-05-14T09:22:56.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-14T09:22:56.532 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-gfb9a6a44107e"... 2024-05-14T09:22:56.532 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-05-14T09:22:56.573 INFO:teuthology.orchestra.run.smithi135.stdout:6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:22:56.573 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-gfb9a6a44107e vs 6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:22:56.574 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T09:22:56.574 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T09:22:57.574 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-14T09:22:57.574 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T09:22:57.748 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2024-05-14T09:22:57.795 DEBUG:teuthology.parallel:result is None 2024-05-14T09:23:14.739 DEBUG:teuthology.orchestra.remote:timed out 2024-05-14T09:23:26.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-14T09:23:26.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:23:27.116 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-05-14T09:23:27.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-14T09:23:27.801 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-gfb9a6a44107e"... 2024-05-14T09:23:27.801 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-05-14T09:23:27.853 INFO:teuthology.orchestra.run.smithi196.stdout:6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:23:27.853 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-gfb9a6a44107e vs 6.9.0-rc3-gfb9a6a44107e 2024-05-14T09:23:27.853 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T09:23:27.854 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T09:23:28.855 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-14T09:23:28.855 DEBUG:teuthology.orchestra.run.smithi196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T09:23:28.988 INFO:teuthology.orchestra.run.smithi196.stdout:ttyS1 2024-05-14T09:23:29.052 DEBUG:teuthology.parallel:result is None 2024-05-14T09:23:29.052 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-14T09:23:29.063 INFO:teuthology.task.internal:Creating test directory... 2024-05-14T09:23:29.063 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T09:23:29.072 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T09:23:29.129 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-14T09:23:29.140 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-14T09:23:29.148 INFO:teuthology.task.internal:Creating archive directory... 2024-05-14T09:23:29.148 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T09:23:29.155 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T09:23:29.234 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-14T09:23:29.241 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-14T09:23:29.242 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T09:23:29.249 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T09:23:29.332 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T09:23:29.341 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T09:23:29.366 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T09:23:29.373 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T09:23:29.377 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-14T09:23:29.385 INFO:teuthology.task.internal:Configuring sudo... 2024-05-14T09:23:29.386 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T09:23:29.393 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T09:23:29.476 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-14T09:23:29.486 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-14T09:23:29.486 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T09:23:29.493 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T09:23:29.549 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T09:23:29.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T09:23:29.718 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T09:23:29.803 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T09:23:29.888 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:23:29.888 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T09:23:29.974 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T09:23:30.067 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T09:23:30.175 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T09:23:30.262 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T09:23:30.347 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:23:30.347 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T09:23:30.430 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-05-14T09:23:30.437 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-05-14T09:23:30.557 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T09:23:30.602 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T09:23:31.024 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-14T09:23:31.032 INFO:teuthology.task.internal:Starting timer... 2024-05-14T09:23:31.033 INFO:teuthology.run_tasks:Running task pcp... 2024-05-14T09:23:31.061 INFO:teuthology.run_tasks:Running task selinux... 2024-05-14T09:23:31.070 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-14T09:23:31.070 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-05-14T09:23:31.193 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-05-14T09:23:31.197 DEBUG:teuthology.orchestra.run.smithi196:> sudo service auditd rotate 2024-05-14T09:23:31.319 INFO:teuthology.orchestra.run.smithi196.stdout:Rotating logs: 2024-05-14T09:23:31.324 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-14T09:23:31.324 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-05-14T09:23:31.385 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-05-14T09:23:31.385 DEBUG:teuthology.orchestra.run.smithi196:> /usr/sbin/getenforce 2024-05-14T09:23:31.451 INFO:teuthology.orchestra.run.smithi196.stdout:Permissive 2024-05-14T09:23:31.451 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi135.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi196.front.sepia.ceph.com': 'permissive'} 2024-05-14T09:23:31.451 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T09:23:31.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T09:23:31.532 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T09:23:31.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T09:23:31.605 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-14T09:23:31.605 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-05-14T09:23:31.686 DEBUG:teuthology.orchestra.run.smithi196:> sudo /usr/sbin/setenforce permissive 2024-05-14T09:23:31.757 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-14T09:23:31.766 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-14T09:23:31.782 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-14T09:23:31.784 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi135.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-14T09:29:37.782 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi135.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-05-14T09:29:37.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-14T09:29:37.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:29:37.900 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-05-14T09:29:38.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-14T09:29:38.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-14T09:29:38.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T09:29:38.165 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-05-14T09:29:38.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-14T09:29:38.329 INFO:teuthology.run_tasks:Running task clock... 2024-05-14T09:29:38.343 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-14T09:29:38.343 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T09:29:38.343 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T09:29:38.351 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T09:29:38.351 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T09:29:38.439 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T09:29:38.444 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T09:29:38.482 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T09:29:38.489 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T09:29:38.551 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-05-14T09:29:38.562 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: ntpd: command not found 2024-05-14T09:29:38.579 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-05-14T09:29:38.590 INFO:teuthology.orchestra.run.smithi196.stdout:506 Cannot talk to daemon 2024-05-14T09:29:38.617 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T09:29:38.630 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T09:29:38.658 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T09:29:38.673 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T09:29:38.787 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-05-14T09:29:38.794 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T09:29:38.794 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-14T09:29:38.794 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:29:38.794 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:29:38.794 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:29:38.795 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:29:38.801 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-05-14T09:29:38.809 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T09:29:38.809 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-05-14T09:29:38.809 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:29:38.809 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:29:38.809 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:29:38.809 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T09:29:38.811 INFO:teuthology.run_tasks:Running task install... 2024-05-14T09:29:38.820 DEBUG:teuthology.task.install:project ceph 2024-05-14T09:29:38.820 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}} 2024-05-14T09:29:38.820 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'} 2024-05-14T09:29:38.820 INFO:teuthology.task.install:Using flavor: default 2024-05-14T09:29:38.829 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-05-14T09:29:38.829 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-14T09:29:38.829 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T09:29:38.830 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:29:38.831 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T09:29:38.832 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:29:39.057 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T09:29:39.057 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T09:29:39.061 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T09:29:39.061 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T09:29:39.168 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T09:29:39.168 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:29:39.168 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T09:29:39.177 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T09:29:39.177 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:29:39.177 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T09:29:39.258 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T09:29:39.258 DEBUG:teuthology.orchestra.run.smithi196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T09:29:39.265 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T09:29:39.266 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T09:29:39.387 DEBUG:teuthology.orchestra.run.smithi196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T09:29:39.390 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T09:29:39.494 DEBUG:teuthology.orchestra.run.smithi196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T09:29:39.495 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T09:29:39.568 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-05-14T09:29:39.573 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-05-14T09:29:39.575 INFO:teuthology.orchestra.run.smithi196.stdout:check_obsoletes = 1 2024-05-14T09:29:39.579 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum clean all 2024-05-14T09:29:39.907 INFO:teuthology.orchestra.run.smithi135.stdout:57 files removed 2024-05-14T09:29:39.918 INFO:teuthology.orchestra.run.smithi196.stdout:57 files removed 2024-05-14T09:29:39.945 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T09:29:39.956 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T09:29:40.857 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 177 kB/s | 84 kB 00:00 2024-05-14T09:29:40.890 INFO:teuthology.orchestra.run.smithi196.stdout:ceph packages for x86_64 169 kB/s | 84 kB 00:00 2024-05-14T09:29:41.399 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 26 kB/s | 12 kB 00:00 2024-05-14T09:29:41.440 INFO:teuthology.orchestra.run.smithi196.stdout:ceph noarch packages 26 kB/s | 12 kB 00:00 2024-05-14T09:29:41.942 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-05-14T09:29:42.041 INFO:teuthology.orchestra.run.smithi196.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2024-05-14T09:29:42.622 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.1 MB 00:00 2024-05-14T09:29:44.240 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.1 MB 00:02 2024-05-14T09:29:46.209 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-05-14T09:29:50.769 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.2 MB 00:00 2024-05-14T09:29:52.503 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 16 kB 00:00 2024-05-14T09:29:53.971 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-05-14T09:29:56.447 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 1.5 MB/s | 19 MB 00:12 2024-05-14T09:30:00.122 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-05-14T09:30:00.856 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-05-14T09:30:02.622 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T09:30:02.623 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T09:30:02.664 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T09:30:02.665 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T09:30:02.666 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T09:30:02.667 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T09:30:02.669 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T09:30:02.672 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T09:30:02.672 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T09:30:02.741 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================================== 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================================== 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 70 M 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 420 M 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.2 M 2024-05-14T09:30:02.761 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 49 M 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 21 M 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 99 M 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 283 M 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T09:30:02.762 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 192 M 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 624 M 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T09:30:02.763 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 105 k 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 47 M 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 54 M 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 615 k 2024-05-14T09:30:02.764 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 770 k 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.1 M 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 337 k 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 524 k 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 53 M 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.3 M 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-05-14T09:30:02.765 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T09:30:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T09:30:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T09:30:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T09:30:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T09:30:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T09:30:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T09:30:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T09:30:02.766 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-14T09:30:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T09:30:02.766 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 22 M 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T09:30:02.767 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T09:30:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T09:30:02.769 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T09:30:02.770 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T09:30:02.771 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T09:30:02.772 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T09:30:02.773 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T09:30:02.774 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T09:30:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T09:30:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T09:30:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T09:30:02.775 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-05-14T09:30:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T09:30:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:30:02.775 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-14T09:30:02.775 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================================== 2024-05-14T09:30:02.775 INFO:teuthology.orchestra.run.smithi135.stdout:Install 170 Packages 2024-05-14T09:30:02.775 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 8 Packages 2024-05-14T09:30:02.775 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:30:02.778 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 2.1 G 2024-05-14T09:30:02.778 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-14T09:30:02.789 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 16 kB 00:00 2024-05-14T09:30:04.041 INFO:teuthology.orchestra.run.smithi135.stdout:(1/178): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-05-14T09:30:04.625 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-14T09:30:05.357 INFO:teuthology.orchestra.run.smithi135.stdout:(2/178): ceph-common-19.0.0-3588.ge2b755a6.el9. 15 MB/s | 20 MB 00:01 2024-05-14T09:30:06.333 INFO:teuthology.orchestra.run.smithi135.stdout:(3/178): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 2.1 MB/s | 5.4 MB 00:02 2024-05-14T09:30:10.749 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-05-14T09:30:13.291 INFO:teuthology.orchestra.run.smithi196.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T09:30:13.293 INFO:teuthology.orchestra.run.smithi196.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T09:30:13.334 INFO:teuthology.orchestra.run.smithi196.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T09:30:13.335 INFO:teuthology.orchestra.run.smithi196.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T09:30:13.336 INFO:teuthology.orchestra.run.smithi196.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T09:30:13.337 INFO:teuthology.orchestra.run.smithi196.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T09:30:13.339 INFO:teuthology.orchestra.run.smithi196.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T09:30:13.342 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T09:30:13.343 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T09:30:13.411 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================================== 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================================== 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 70 M 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 420 M 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.2 M 2024-05-14T09:30:13.445 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 49 M 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 21 M 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 99 M 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 283 M 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 192 M 2024-05-14T09:30:13.446 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 624 M 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T09:30:13.447 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 105 k 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 47 M 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 54 M 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 615 k 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 770 k 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.1 M 2024-05-14T09:30:13.448 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 337 k 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 524 k 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 53 M 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.3 M 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T09:30:13.449 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-debuginfo x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 22 M 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T09:30:13.450 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T09:30:13.451 INFO:teuthology.orchestra.run.smithi196.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T09:30:13.452 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T09:30:13.453 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T09:30:13.454 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T09:30:13.455 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T09:30:13.456 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T09:30:13.457 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T09:30:13.458 INFO:teuthology.orchestra.run.smithi196.stdout:Installing weak dependencies: 2024-05-14T09:30:13.458 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T09:30:13.458 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:30:13.458 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-05-14T09:30:13.458 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================================== 2024-05-14T09:30:13.458 INFO:teuthology.orchestra.run.smithi196.stdout:Install 170 Packages 2024-05-14T09:30:13.458 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 8 Packages 2024-05-14T09:30:13.458 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:30:13.458 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 2.1 G 2024-05-14T09:30:13.459 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-05-14T09:30:14.701 INFO:teuthology.orchestra.run.smithi196.stdout:(1/178): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-05-14T09:30:17.784 INFO:teuthology.orchestra.run.smithi196.stdout:(2/178): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-05-14T09:30:20.273 INFO:teuthology.orchestra.run.smithi135.stdout:(4/178): ceph-debuginfo-19.0.0-3588.ge2b755a6.e 1.6 MB/s | 22 MB 00:13 2024-05-14T09:30:20.957 INFO:teuthology.orchestra.run.smithi135.stdout:(5/178): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.2 MB/s | 863 kB 00:00 2024-05-14T09:30:21.975 INFO:teuthology.orchestra.run.smithi196.stdout:(3/178): ceph-common-19.0.0-3588.ge2b755a6.el9. 2.7 MB/s | 20 MB 00:07 2024-05-14T09:30:26.348 INFO:teuthology.orchestra.run.smithi135.stdout:(6/178): ceph-fuse-debuginfo-19.0.0-3588.ge2b75 1.1 MB/s | 6.2 MB 00:05 2024-05-14T09:30:26.524 INFO:teuthology.orchestra.run.smithi135.stdout:(7/178): ceph-immutable-object-cache-19.0.0-358 844 kB/s | 147 kB 00:00 2024-05-14T09:30:27.550 INFO:teuthology.orchestra.run.smithi196.stdout:(4/178): ceph-debuginfo-19.0.0-3588.ge2b755a6.e 4.0 MB/s | 22 MB 00:05 2024-05-14T09:30:27.917 INFO:teuthology.orchestra.run.smithi196.stdout:(5/178): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 2.3 MB/s | 863 kB 00:00 2024-05-14T09:30:28.032 INFO:teuthology.orchestra.run.smithi135.stdout:(8/178): ceph-immutable-object-cache-debuginfo- 995 kB/s | 1.5 MB 00:01 2024-05-14T09:30:29.450 INFO:teuthology.orchestra.run.smithi196.stdout:(6/178): ceph-fuse-debuginfo-19.0.0-3588.ge2b75 4.0 MB/s | 6.2 MB 00:01 2024-05-14T09:30:29.558 INFO:teuthology.orchestra.run.smithi196.stdout:(7/178): ceph-immutable-object-cache-19.0.0-358 1.3 MB/s | 147 kB 00:00 2024-05-14T09:30:30.466 INFO:teuthology.orchestra.run.smithi135.stdout:(9/178): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 952 kB/s | 2.3 MB 00:02 2024-05-14T09:30:30.600 INFO:teuthology.orchestra.run.smithi196.stdout:(8/178): ceph-immutable-object-cache-debuginfo- 1.4 MB/s | 1.5 MB 00:01 2024-05-14T09:30:31.484 INFO:teuthology.orchestra.run.smithi196.stdout:(9/178): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 2.6 MB/s | 2.3 MB 00:00 2024-05-14T09:30:33.892 INFO:teuthology.orchestra.run.smithi135.stdout:(10/178): ceph-base-debuginfo-19.0.0-3588.ge2b7 2.3 MB/s | 70 MB 00:30 2024-05-14T09:30:34.909 INFO:teuthology.orchestra.run.smithi135.stdout:(11/178): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x8 1.5 MB/s | 1.5 MB 00:01 2024-05-14T09:30:42.192 INFO:teuthology.orchestra.run.smithi196.stdout:(10/178): ceph-mds-debuginfo-19.0.0-3588.ge2b75 4.6 MB/s | 49 MB 00:10 2024-05-14T09:30:42.608 INFO:teuthology.orchestra.run.smithi196.stdout:(11/178): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x8 3.6 MB/s | 1.5 MB 00:00 2024-05-14T09:30:45.055 INFO:teuthology.orchestra.run.smithi135.stdout:(12/178): ceph-mgr-debuginfo-19.0.0-3588.ge2b75 2.1 MB/s | 21 MB 00:10 2024-05-14T09:30:47.566 INFO:teuthology.orchestra.run.smithi196.stdout:(12/178): ceph-mgr-debuginfo-19.0.0-3588.ge2b75 4.3 MB/s | 21 MB 00:04 2024-05-14T09:30:48.941 INFO:teuthology.orchestra.run.smithi135.stdout:(13/178): ceph-mon-19.0.0-3588.ge2b755a6.el9.x8 1.3 MB/s | 4.9 MB 00:03 2024-05-14T09:30:49.833 INFO:teuthology.orchestra.run.smithi196.stdout:(13/178): ceph-mon-19.0.0-3588.ge2b755a6.el9.x8 2.2 MB/s | 4.9 MB 00:02 2024-05-14T09:30:58.115 INFO:teuthology.orchestra.run.smithi135.stdout:(14/178): ceph-mds-debuginfo-19.0.0-3588.ge2b75 1.8 MB/s | 49 MB 00:27 2024-05-14T09:31:05.256 INFO:teuthology.orchestra.run.smithi196.stdout:(14/178): ceph-base-debuginfo-19.0.0-3588.ge2b7 1.4 MB/s | 70 MB 00:50 2024-05-14T09:31:11.564 INFO:teuthology.orchestra.run.smithi135.stdout:(15/178): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 1.3 MB/s | 18 MB 00:13 2024-05-14T09:31:16.788 INFO:teuthology.orchestra.run.smithi196.stdout:(15/178): ceph-mon-debuginfo-19.0.0-3588.ge2b75 3.7 MB/s | 99 MB 00:26 2024-05-14T09:31:17.996 INFO:teuthology.orchestra.run.smithi196.stdout:(16/178): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 1.4 MB/s | 18 MB 00:12 2024-05-14T09:31:24.179 INFO:teuthology.orchestra.run.smithi196.stdout:(17/178): ceph-radosgw-19.0.0-3588.ge2b755a6.el 1.6 MB/s | 10 MB 00:06 2024-05-14T09:31:34.670 INFO:teuthology.orchestra.run.smithi135.stdout:(16/178): ceph-common-debuginfo-19.0.0-3588.ge2 4.7 MB/s | 420 MB 01:29 2024-05-14T09:31:36.929 INFO:teuthology.orchestra.run.smithi135.stdout:(17/178): ceph-radosgw-19.0.0-3588.ge2b755a6.el 4.5 MB/s | 10 MB 00:02 2024-05-14T09:31:40.979 INFO:teuthology.orchestra.run.smithi135.stdout:(18/178): ceph-mon-debuginfo-19.0.0-3588.ge2b75 1.9 MB/s | 99 MB 00:52 2024-05-14T09:31:41.104 INFO:teuthology.orchestra.run.smithi135.stdout:(19/178): ceph-selinux-19.0.0-3588.ge2b755a6.el 203 kB/s | 25 kB 00:00 2024-05-14T09:31:55.878 INFO:teuthology.orchestra.run.smithi135.stdout:(20/178): ceph-test-19.0.0-3588.ge2b755a6.el9.x 2.9 MB/s | 43 MB 00:14 2024-05-14T09:32:05.223 INFO:teuthology.orchestra.run.smithi196.stdout:(18/178): ceph-common-debuginfo-19.0.0-3588.ge2 3.9 MB/s | 420 MB 01:47 2024-05-14T09:32:06.639 INFO:teuthology.orchestra.run.smithi196.stdout:(19/178): ceph-osd-debuginfo-19.0.0-3588.ge2b75 5.7 MB/s | 283 MB 00:49 2024-05-14T09:32:06.665 INFO:teuthology.orchestra.run.smithi196.stdout:(20/178): ceph-selinux-19.0.0-3588.ge2b755a6.el 17 kB/s | 25 kB 00:01 2024-05-14T09:32:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:(21/178): ceph-radosgw-debuginfo-19.0.0-3588.ge 6.1 MB/s | 192 MB 00:31 2024-05-14T09:32:08.636 INFO:teuthology.orchestra.run.smithi135.stdout:(22/178): cephfs-mirror-19.0.0-3588.ge2b755a6.e 842 kB/s | 224 kB 00:00 2024-05-14T09:32:08.727 INFO:teuthology.orchestra.run.smithi135.stdout:(23/178): cephfs-shell-19.0.0-3588.ge2b755a6.el 300 kB/s | 27 kB 00:00 2024-05-14T09:32:08.805 INFO:teuthology.orchestra.run.smithi135.stdout:(24/178): libcephfs-devel-19.0.0-3588.ge2b755a6 426 kB/s | 32 kB 00:00 2024-05-14T09:32:09.003 INFO:teuthology.orchestra.run.smithi135.stdout:(25/178): libcephfs2-19.0.0-3588.ge2b755a6.el9. 3.7 MB/s | 756 kB 00:00 2024-05-14T09:32:10.120 INFO:teuthology.orchestra.run.smithi135.stdout:(26/178): libcephfs2-debuginfo-19.0.0-3588.ge2b 4.8 MB/s | 5.4 MB 00:01 2024-05-14T09:32:10.212 INFO:teuthology.orchestra.run.smithi135.stdout:(27/178): libcephsqlite-19.0.0-3588.ge2b755a6.e 1.7 MB/s | 157 kB 00:00 2024-05-14T09:32:10.312 INFO:teuthology.orchestra.run.smithi135.stdout:(28/178): librados-devel-19.0.0-3588.ge2b755a6. 1.2 MB/s | 127 kB 00:00 2024-05-14T09:32:10.413 INFO:teuthology.orchestra.run.smithi135.stdout:(29/178): librados-devel-debuginfo-19.0.0-3588. 1.0 MB/s | 105 kB 00:00 2024-05-14T09:32:13.498 INFO:teuthology.orchestra.run.smithi196.stdout:(21/178): ceph-radosgw-debuginfo-19.0.0-3588.ge 3.9 MB/s | 192 MB 00:49 2024-05-14T09:32:13.998 INFO:teuthology.orchestra.run.smithi196.stdout:(22/178): ceph-test-19.0.0-3588.ge2b755a6.el9.x 5.9 MB/s | 43 MB 00:07 2024-05-14T09:32:14.031 INFO:teuthology.orchestra.run.smithi196.stdout:(23/178): cephfs-mirror-19.0.0-3588.ge2b755a6.e 422 kB/s | 224 kB 00:00 2024-05-14T09:32:14.114 INFO:teuthology.orchestra.run.smithi196.stdout:(24/178): cephfs-shell-19.0.0-3588.ge2b755a6.el 234 kB/s | 27 kB 00:00 2024-05-14T09:32:14.140 INFO:teuthology.orchestra.run.smithi196.stdout:(25/178): libcephfs-devel-19.0.0-3588.ge2b755a6 293 kB/s | 32 kB 00:00 2024-05-14T09:32:14.698 INFO:teuthology.orchestra.run.smithi196.stdout:(26/178): libcephfs2-19.0.0-3588.ge2b755a6.el9. 1.3 MB/s | 756 kB 00:00 2024-05-14T09:32:14.807 INFO:teuthology.orchestra.run.smithi196.stdout:(27/178): libcephsqlite-19.0.0-3588.ge2b755a6.e 1.4 MB/s | 157 kB 00:00 2024-05-14T09:32:14.890 INFO:teuthology.orchestra.run.smithi196.stdout:(28/178): librados-devel-19.0.0-3588.ge2b755a6. 1.5 MB/s | 127 kB 00:00 2024-05-14T09:32:14.958 INFO:teuthology.orchestra.run.smithi196.stdout:(29/178): librados-devel-debuginfo-19.0.0-3588. 1.6 MB/s | 105 kB 00:00 2024-05-14T09:32:15.441 INFO:teuthology.orchestra.run.smithi196.stdout:(30/178): libcephfs2-debuginfo-19.0.0-3588.ge2b 4.1 MB/s | 5.4 MB 00:01 2024-05-14T09:32:15.633 INFO:teuthology.orchestra.run.smithi196.stdout:(31/178): libradosstriper1-19.0.0-3588.ge2b755a 2.5 MB/s | 497 kB 00:00 2024-05-14T09:32:16.163 INFO:teuthology.orchestra.run.smithi135.stdout:(30/178): librados2-debuginfo-19.0.0-3588.ge2b7 8.1 MB/s | 47 MB 00:05 2024-05-14T09:32:16.380 INFO:teuthology.orchestra.run.smithi135.stdout:(31/178): libradosstriper1-19.0.0-3588.ge2b755a 2.3 MB/s | 497 kB 00:00 2024-05-14T09:32:24.346 INFO:teuthology.orchestra.run.smithi135.stdout:(32/178): librbd1-debuginfo-19.0.0-3588.ge2b755 6.8 MB/s | 54 MB 00:07 2024-05-14T09:32:25.230 INFO:teuthology.orchestra.run.smithi135.stdout:(33/178): librgw2-19.0.0-3588.ge2b755a6.el9.x86 5.8 MB/s | 5.2 MB 00:00 2024-05-14T09:32:25.280 INFO:teuthology.orchestra.run.smithi135.stdout:(34/178): python3-ceph-argparse-19.0.0-3588.ge2 923 kB/s | 45 kB 00:00 2024-05-14T09:32:25.338 INFO:teuthology.orchestra.run.smithi135.stdout:(35/178): python3-ceph-common-19.0.0-3588.ge2b7 2.3 MB/s | 135 kB 00:00 2024-05-14T09:32:25.414 INFO:teuthology.orchestra.run.smithi135.stdout:(36/178): python3-cephfs-19.0.0-3588.ge2b755a6. 2.1 MB/s | 162 kB 00:00 2024-05-14T09:32:25.514 INFO:teuthology.orchestra.run.smithi135.stdout:(37/178): python3-cephfs-debuginfo-19.0.0-3588. 6.1 MB/s | 615 kB 00:00 2024-05-14T09:32:25.581 INFO:teuthology.orchestra.run.smithi135.stdout:(38/178): python3-rados-19.0.0-3588.ge2b755a6.e 4.8 MB/s | 321 kB 00:00 2024-05-14T09:32:25.582 INFO:teuthology.orchestra.run.smithi196.stdout:(32/178): librados2-debuginfo-19.0.0-3588.ge2b7 4.4 MB/s | 47 MB 00:10 2024-05-14T09:32:25.940 INFO:teuthology.orchestra.run.smithi135.stdout:(39/178): python3-rados-debuginfo-19.0.0-3588.g 2.1 MB/s | 770 kB 00:00 2024-05-14T09:32:26.015 INFO:teuthology.orchestra.run.smithi135.stdout:(40/178): python3-rbd-19.0.0-3588.ge2b755a6.el9 3.9 MB/s | 301 kB 00:00 2024-05-14T09:32:26.274 INFO:teuthology.orchestra.run.smithi135.stdout:(41/178): python3-rbd-debuginfo-19.0.0-3588.ge2 4.4 MB/s | 1.1 MB 00:00 2024-05-14T09:32:26.375 INFO:teuthology.orchestra.run.smithi135.stdout:(42/178): python3-rgw-19.0.0-3588.ge2b755a6.el9 1.0 MB/s | 100 kB 00:00 2024-05-14T09:32:26.767 INFO:teuthology.orchestra.run.smithi135.stdout:(43/178): python3-rgw-debuginfo-19.0.0-3588.ge2 863 kB/s | 337 kB 00:00 2024-05-14T09:32:26.859 INFO:teuthology.orchestra.run.smithi135.stdout:(44/178): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 944 kB/s | 86 kB 00:00 2024-05-14T09:32:27.009 INFO:teuthology.orchestra.run.smithi135.stdout:(45/178): rbd-fuse-debuginfo-19.0.0-3588.ge2b75 3.4 MB/s | 524 kB 00:00 2024-05-14T09:32:27.040 INFO:teuthology.orchestra.run.smithi196.stdout:(33/178): librgw2-19.0.0-3588.ge2b755a6.el9.x86 3.5 MB/s | 5.2 MB 00:01 2024-05-14T09:32:27.132 INFO:teuthology.orchestra.run.smithi196.stdout:(34/178): python3-ceph-argparse-19.0.0-3588.ge2 494 kB/s | 45 kB 00:00 2024-05-14T09:32:27.232 INFO:teuthology.orchestra.run.smithi196.stdout:(35/178): python3-ceph-common-19.0.0-3588.ge2b7 1.3 MB/s | 135 kB 00:00 2024-05-14T09:32:27.354 INFO:teuthology.orchestra.run.smithi196.stdout:(36/178): python3-cephfs-19.0.0-3588.ge2b755a6. 1.3 MB/s | 162 kB 00:00 2024-05-14T09:32:27.401 INFO:teuthology.orchestra.run.smithi135.stdout:(46/178): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 7.8 MB/s | 3.0 MB 00:00 2024-05-14T09:32:27.483 INFO:teuthology.orchestra.run.smithi196.stdout:(37/178): python3-cephfs-debuginfo-19.0.0-3588. 4.7 MB/s | 615 kB 00:00 2024-05-14T09:32:28.150 INFO:teuthology.orchestra.run.smithi196.stdout:(38/178): librbd1-debuginfo-19.0.0-3588.ge2b755 4.3 MB/s | 54 MB 00:12 2024-05-14T09:32:28.183 INFO:teuthology.orchestra.run.smithi196.stdout:(39/178): python3-rados-19.0.0-3588.ge2b755a6.e 459 kB/s | 321 kB 00:00 2024-05-14T09:32:28.342 INFO:teuthology.orchestra.run.smithi196.stdout:(40/178): python3-rbd-19.0.0-3588.ge2b755a6.el9 1.9 MB/s | 301 kB 00:00 2024-05-14T09:32:28.543 INFO:teuthology.orchestra.run.smithi196.stdout:(41/178): python3-rados-debuginfo-19.0.0-3588.g 1.9 MB/s | 770 kB 00:00 2024-05-14T09:32:28.659 INFO:teuthology.orchestra.run.smithi196.stdout:(42/178): python3-rgw-19.0.0-3588.ge2b755a6.el9 861 kB/s | 100 kB 00:00 2024-05-14T09:32:28.709 INFO:teuthology.orchestra.run.smithi196.stdout:(43/178): python3-rbd-debuginfo-19.0.0-3588.ge2 3.1 MB/s | 1.1 MB 00:00 2024-05-14T09:32:28.776 INFO:teuthology.orchestra.run.smithi196.stdout:(44/178): python3-rgw-debuginfo-19.0.0-3588.ge2 2.8 MB/s | 337 kB 00:00 2024-05-14T09:32:28.810 INFO:teuthology.orchestra.run.smithi196.stdout:(45/178): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 864 kB/s | 86 kB 00:00 2024-05-14T09:32:29.135 INFO:teuthology.orchestra.run.smithi196.stdout:(46/178): rbd-fuse-debuginfo-19.0.0-3588.ge2b75 1.4 MB/s | 524 kB 00:00 2024-05-14T09:32:29.811 INFO:teuthology.orchestra.run.smithi196.stdout:(47/178): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 3.0 MB/s | 3.0 MB 00:00 2024-05-14T09:32:29.911 INFO:teuthology.orchestra.run.smithi196.stdout:(48/178): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 1.7 MB/s | 170 kB 00:00 2024-05-14T09:32:30.313 INFO:teuthology.orchestra.run.smithi196.stdout:(49/178): rbd-nbd-debuginfo-19.0.0-3588.ge2b755 3.2 MB/s | 1.3 MB 00:00 2024-05-14T09:32:30.403 INFO:teuthology.orchestra.run.smithi196.stdout:(50/178): ceph-grafana-dashboards-19.0.0-3588.g 387 kB/s | 34 kB 00:00 2024-05-14T09:32:30.495 INFO:teuthology.orchestra.run.smithi196.stdout:(51/178): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 1.5 MB/s | 142 kB 00:00 2024-05-14T09:32:31.462 INFO:teuthology.orchestra.run.smithi196.stdout:(52/178): ceph-mgr-dashboard-19.0.0-3588.ge2b75 3.7 MB/s | 3.5 MB 00:00 2024-05-14T09:32:33.295 INFO:teuthology.orchestra.run.smithi196.stdout:(53/178): ceph-mgr-diskprediction-local-19.0.0- 4.0 MB/s | 7.4 MB 00:01 2024-05-14T09:32:33.395 INFO:teuthology.orchestra.run.smithi196.stdout:(54/178): ceph-mgr-modules-core-19.0.0-3588.ge2 2.7 MB/s | 274 kB 00:00 2024-05-14T09:32:33.479 INFO:teuthology.orchestra.run.smithi196.stdout:(55/178): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 599 kB/s | 49 kB 00:00 2024-05-14T09:32:33.579 INFO:teuthology.orchestra.run.smithi196.stdout:(56/178): ceph-prometheus-alerts-19.0.0-3588.ge 166 kB/s | 16 kB 00:00 2024-05-14T09:32:33.679 INFO:teuthology.orchestra.run.smithi196.stdout:(57/178): ceph-volume-19.0.0-3588.ge2b755a6.el9 2.7 MB/s | 273 kB 00:00 2024-05-14T09:32:33.905 INFO:teuthology.orchestra.run.smithi196.stdout:(58/178): cephadm-19.0.0-3588.ge2b755a6.el9.noa 3.3 MB/s | 763 kB 00:00 2024-05-14T09:32:34.020 INFO:teuthology.orchestra.run.smithi196.stdout:(59/178): cephfs-top-19.0.0-3588.ge2b755a6.el9. 159 kB/s | 18 kB 00:00 2024-05-14T09:32:34.147 INFO:teuthology.orchestra.run.smithi196.stdout:(60/178): fuse-2.9.9-15.el9.x86_64.rpm 644 kB/s | 80 kB 00:00 2024-05-14T09:32:34.272 INFO:teuthology.orchestra.run.smithi196.stdout:(61/178): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-05-14T09:32:34.322 INFO:teuthology.orchestra.run.smithi196.stdout:(62/178): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2024-05-14T09:32:34.406 INFO:teuthology.orchestra.run.smithi196.stdout:(63/178): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-05-14T09:32:34.498 INFO:teuthology.orchestra.run.smithi196.stdout:(64/178): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-05-14T09:32:34.540 INFO:teuthology.orchestra.run.smithi196.stdout:(65/178): python3-ply-3.11-14.el9.noarch.rpm 2.6 MB/s | 106 kB 00:00 2024-05-14T09:32:34.582 INFO:teuthology.orchestra.run.smithi196.stdout:(66/178): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-05-14T09:32:34.624 INFO:teuthology.orchestra.run.smithi196.stdout:(67/178): python3-requests-2.25.1-8.el9.noarch. 3.0 MB/s | 125 kB 00:00 2024-05-14T09:32:34.683 INFO:teuthology.orchestra.run.smithi196.stdout:(68/178): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-05-14T09:32:34.692 INFO:teuthology.orchestra.run.smithi135.stdout:(47/178): rbd-mirror-debuginfo-19.0.0-3588.ge2b 7.3 MB/s | 53 MB 00:07 2024-05-14T09:32:34.775 INFO:teuthology.orchestra.run.smithi196.stdout:(69/178): automake-1.16.2-8.el9.noarch.rpm 7.4 MB/s | 689 kB 00:00 2024-05-14T09:32:34.801 INFO:teuthology.orchestra.run.smithi135.stdout:(48/178): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 1.5 MB/s | 170 kB 00:00 2024-05-14T09:32:34.859 INFO:teuthology.orchestra.run.smithi196.stdout:(70/178): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-05-14T09:32:34.901 INFO:teuthology.orchestra.run.smithi196.stdout:(71/178): boost-program-options-1.75.0-8.el9.x8 2.6 MB/s | 107 kB 00:00 2024-05-14T09:32:34.942 INFO:teuthology.orchestra.run.smithi196.stdout:(72/178): elfutils-libelf-devel-0.190-2.el9.x86 526 kB/s | 21 kB 00:00 2024-05-14T09:32:34.993 INFO:teuthology.orchestra.run.smithi196.stdout:(73/178): flex-2.6.4-9.el9.x86_64.rpm 6.3 MB/s | 313 kB 00:00 2024-05-14T09:32:35.018 INFO:teuthology.orchestra.run.smithi135.stdout:(49/178): rbd-nbd-debuginfo-19.0.0-3588.ge2b755 5.9 MB/s | 1.3 MB 00:00 2024-05-14T09:32:35.035 INFO:teuthology.orchestra.run.smithi196.stdout:(74/178): flexiblas-3.0.4-8.el9.x86_64.rpm 802 kB/s | 33 kB 00:00 2024-05-14T09:32:35.085 INFO:teuthology.orchestra.run.smithi135.stdout:(50/178): ceph-grafana-dashboards-19.0.0-3588.g 521 kB/s | 34 kB 00:00 2024-05-14T09:32:35.152 INFO:teuthology.orchestra.run.smithi135.stdout:(51/178): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 2.1 MB/s | 142 kB 00:00 2024-05-14T09:32:35.168 INFO:teuthology.orchestra.run.smithi196.stdout:(75/178): flexiblas-netlib-3.0.4-8.el9.x86_64.r 23 MB/s | 3.0 MB 00:00 2024-05-14T09:32:35.210 INFO:teuthology.orchestra.run.smithi196.stdout:(76/178): flexiblas-openblas-openmp-3.0.4-8.el9 448 kB/s | 18 kB 00:00 2024-05-14T09:32:35.252 INFO:teuthology.orchestra.run.smithi196.stdout:(77/178): libaio-devel-0.3.111-13.el9.x86_64.rp 273 kB/s | 11 kB 00:00 2024-05-14T09:32:35.302 INFO:teuthology.orchestra.run.smithi196.stdout:(78/178): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 160 kB 00:00 2024-05-14T09:32:35.344 INFO:teuthology.orchestra.run.smithi196.stdout:(79/178): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-05-14T09:32:35.412 INFO:teuthology.orchestra.run.smithi196.stdout:(80/178): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 662 kB 00:00 2024-05-14T09:32:35.489 INFO:teuthology.orchestra.run.smithi196.stdout:(81/178): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 582 kB 00:00 2024-05-14T09:32:35.537 INFO:teuthology.orchestra.run.smithi196.stdout:(82/178): libuuid-devel-2.37.4-18.el9.x86_64.rp 541 kB/s | 25 kB 00:00 2024-05-14T09:32:35.579 INFO:teuthology.orchestra.run.smithi196.stdout:(83/178): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-05-14T09:32:35.629 INFO:teuthology.orchestra.run.smithi196.stdout:(84/178): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.8 MB/s | 292 kB 00:00 2024-05-14T09:32:35.636 INFO:teuthology.orchestra.run.smithi135.stdout:(52/178): ceph-mgr-dashboard-19.0.0-3588.ge2b75 7.3 MB/s | 3.5 MB 00:00 2024-05-14T09:32:35.679 INFO:teuthology.orchestra.run.smithi196.stdout:(85/178): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-05-14T09:32:35.722 INFO:teuthology.orchestra.run.smithi196.stdout:(86/178): openblas-0.3.21-2.el9.x86_64.rpm 860 kB/s | 35 kB 00:00 2024-05-14T09:32:35.906 INFO:teuthology.orchestra.run.smithi196.stdout:(87/178): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-05-14T09:32:36.047 INFO:teuthology.orchestra.run.smithi196.stdout:(88/178): openssl-devel-3.2.1-1.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-05-14T09:32:36.139 INFO:teuthology.orchestra.run.smithi196.stdout:(89/178): postgresql-13.14-1.el9.x86_64.rpm 18 MB/s | 1.6 MB 00:00 2024-05-14T09:32:36.215 INFO:teuthology.orchestra.run.smithi196.stdout:(90/178): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-05-14T09:32:36.281 INFO:teuthology.orchestra.run.smithi196.stdout:(91/178): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-05-14T09:32:36.448 INFO:teuthology.orchestra.run.smithi196.stdout:(92/178): postgresql-server-13.14-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-05-14T09:32:36.524 INFO:teuthology.orchestra.run.smithi196.stdout:(93/178): protobuf-3.14.0-13.el9.x86_64.rpm 14 MB/s | 1.0 MB 00:00 2024-05-14T09:32:36.566 INFO:teuthology.orchestra.run.smithi196.stdout:(94/178): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-05-14T09:32:36.687 INFO:teuthology.orchestra.run.smithi135.stdout:(53/178): ceph-mgr-diskprediction-local-19.0.0- 7.0 MB/s | 7.4 MB 00:01 2024-05-14T09:32:36.749 INFO:teuthology.orchestra.run.smithi196.stdout:(95/178): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 6.0 MB 00:00 2024-05-14T09:32:36.753 INFO:teuthology.orchestra.run.smithi135.stdout:(54/178): ceph-mgr-modules-core-19.0.0-3588.ge2 4.1 MB/s | 274 kB 00:00 2024-05-14T09:32:36.800 INFO:teuthology.orchestra.run.smithi196.stdout:(96/178): python3-devel-3.9.18-3.el9.x86_64.rpm 4.9 MB/s | 244 kB 00:00 2024-05-14T09:32:36.820 INFO:teuthology.orchestra.run.smithi135.stdout:(55/178): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 751 kB/s | 49 kB 00:00 2024-05-14T09:32:36.850 INFO:teuthology.orchestra.run.smithi196.stdout:(97/178): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-05-14T09:32:36.879 INFO:teuthology.orchestra.run.smithi135.stdout:(56/178): ceph-prometheus-alerts-19.0.0-3588.ge 286 kB/s | 16 kB 00:00 2024-05-14T09:32:36.892 INFO:teuthology.orchestra.run.smithi196.stdout:(98/178): python3-jsonpatch-1.21-16.el9.noarch. 631 kB/s | 26 kB 00:00 2024-05-14T09:32:36.934 INFO:teuthology.orchestra.run.smithi196.stdout:(99/178): python3-jsonpointer-2.0-4.el9.noarch. 471 kB/s | 19 kB 00:00 2024-05-14T09:32:36.979 INFO:teuthology.orchestra.run.smithi135.stdout:(57/178): ceph-volume-19.0.0-3588.ge2b755a6.el9 2.7 MB/s | 273 kB 00:00 2024-05-14T09:32:37.001 INFO:teuthology.orchestra.run.smithi196.stdout:(100/178): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-05-14T09:32:37.043 INFO:teuthology.orchestra.run.smithi196.stdout:(101/178): python3-markupsafe-1.1.1-12.el9.x86_ 852 kB/s | 35 kB 00:00 2024-05-14T09:32:37.142 INFO:teuthology.orchestra.run.smithi135.stdout:(58/178): cephadm-19.0.0-3588.ge2b755a6.el9.noa 4.6 MB/s | 763 kB 00:00 2024-05-14T09:32:37.193 INFO:teuthology.orchestra.run.smithi196.stdout:(102/178): python3-numpy-1.20.1-5.el9.x86_64.rp 34 MB/s | 5.1 MB 00:00 2024-05-14T09:32:37.197 INFO:teuthology.orchestra.run.smithi135.stdout:(59/178): cephfs-top-19.0.0-3588.ge2b755a6.el9. 338 kB/s | 18 kB 00:00 2024-05-14T09:32:37.243 INFO:teuthology.orchestra.run.smithi196.stdout:(103/178): python3-numpy-f2py-1.20.1-5.el9.x86_ 5.0 MB/s | 250 kB 00:00 2024-05-14T09:32:37.294 INFO:teuthology.orchestra.run.smithi196.stdout:(104/178): python3-oauthlib-3.1.1-5.el9.noarch. 4.4 MB/s | 222 kB 00:00 2024-05-14T09:32:37.361 INFO:teuthology.orchestra.run.smithi196.stdout:(105/178): python3-packaging-20.9-5.el9.noarch. 1.1 MB/s | 77 kB 00:00 2024-05-14T09:32:37.403 INFO:teuthology.orchestra.run.smithi196.stdout:(106/178): python3-prettytable-0.7.2-27.el9.noa 1.0 MB/s | 42 kB 00:00 2024-05-14T09:32:37.453 INFO:teuthology.orchestra.run.smithi196.stdout:(107/178): python3-protobuf-3.14.0-13.el9.noarc 5.3 MB/s | 269 kB 00:00 2024-05-14T09:32:37.503 INFO:teuthology.orchestra.run.smithi196.stdout:(108/178): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.2 MB/s | 159 kB 00:00 2024-05-14T09:32:37.553 INFO:teuthology.orchestra.run.smithi196.stdout:(109/178): python3-pyasn1-modules-0.4.8-6.el9.n 5.5 MB/s | 279 kB 00:00 2024-05-14T09:32:37.596 INFO:teuthology.orchestra.run.smithi196.stdout:(110/178): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-05-14T09:32:37.631 INFO:teuthology.orchestra.run.smithi135.stdout:(60/178): fuse-2.9.9-15.el9.x86_64.rpm 186 kB/s | 80 kB 00:00 2024-05-14T09:32:37.638 INFO:teuthology.orchestra.run.smithi196.stdout:(111/178): python3-requests-oauthlib-1.3.0-12.e 1.3 MB/s | 54 kB 00:00 2024-05-14T09:32:37.963 INFO:teuthology.orchestra.run.smithi196.stdout:(112/178): python3-scipy-1.6.2-8.el9.x86_64.rpm 50 MB/s | 16 MB 00:00 2024-05-14T09:32:38.522 INFO:teuthology.orchestra.run.smithi196.stdout:(113/178): rbd-mirror-debuginfo-19.0.0-3588.ge2 5.7 MB/s | 53 MB 00:09 2024-05-14T09:32:38.538 INFO:teuthology.orchestra.run.smithi196.stdout:(114/178): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2024-05-14T09:32:38.588 INFO:teuthology.orchestra.run.smithi196.stdout:(115/178): qatlib-24.02.0-1.el9.x86_64.rpm 4.4 MB/s | 221 kB 00:00 2024-05-14T09:32:38.614 INFO:teuthology.orchestra.run.smithi196.stdout:(116/178): python3-wcwidth-0.2.5-8.el9.noarch.r 486 kB/s | 44 kB 00:00 2024-05-14T09:32:38.631 INFO:teuthology.orchestra.run.smithi196.stdout:(117/178): qatlib-service-24.02.0-1.el9.x86_64. 870 kB/s | 36 kB 00:00 2024-05-14T09:32:38.664 INFO:teuthology.orchestra.run.smithi196.stdout:(118/178): qatzip-libs-1.2.0-1.el9.x86_64.rpm 961 kB/s | 47 kB 00:00 2024-05-14T09:32:38.698 INFO:teuthology.orchestra.run.smithi196.stdout:(119/178): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-14T09:32:38.723 INFO:teuthology.orchestra.run.smithi196.stdout:(120/178): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-05-14T09:32:38.748 INFO:teuthology.orchestra.run.smithi196.stdout:(121/178): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.9 MB/s | 94 kB 00:00 2024-05-14T09:32:38.774 INFO:teuthology.orchestra.run.smithi196.stdout:(122/178): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-05-14T09:32:38.799 INFO:teuthology.orchestra.run.smithi196.stdout:(123/178): zlib-devel-1.2.11-41.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-05-14T09:32:38.825 INFO:teuthology.orchestra.run.smithi196.stdout:(124/178): lua-devel-5.4.4-4.el9.x86_64.rpm 452 kB/s | 22 kB 00:00 2024-05-14T09:32:38.900 INFO:teuthology.orchestra.run.smithi196.stdout:(125/178): protobuf-compiler-3.14.0-13.el9.x86_ 8.5 MB/s | 863 kB 00:00 2024-05-14T09:32:39.248 INFO:teuthology.orchestra.run.smithi135.stdout:(61/178): ceph-osd-debuginfo-19.0.0-3588.ge2b75 3.2 MB/s | 283 MB 01:27 2024-05-14T09:32:39.442 INFO:teuthology.orchestra.run.smithi196.stdout:(126/178): abseil-cpp-20211102.0-3.el9.x86_64.r 890 kB/s | 548 kB 00:00 2024-05-14T09:32:39.475 INFO:teuthology.orchestra.run.smithi196.stdout:(127/178): gperftools-libs-2.9.1-2.el9.x86_64.r 612 kB/s | 309 kB 00:00 2024-05-14T09:32:39.517 INFO:teuthology.orchestra.run.smithi196.stdout:(128/178): grpc-data-1.46.7-10.el9.noarch.rpm 262 kB/s | 19 kB 00:00 2024-05-14T09:32:39.618 INFO:teuthology.orchestra.run.smithi196.stdout:(129/178): libarrow-doc-9.0.0-11.el9.noarch.rpm 262 kB/s | 26 kB 00:00 2024-05-14T09:32:39.718 INFO:teuthology.orchestra.run.smithi196.stdout:(130/178): liboath-2.6.7-2.el9.x86_64.rpm 490 kB/s | 49 kB 00:00 2024-05-14T09:32:39.806 INFO:teuthology.orchestra.run.smithi135.stdout:(62/178): libquadmath-11.4.1-3.el9.x86_64.rpm 351 kB/s | 195 kB 00:00 2024-05-14T09:32:39.843 INFO:teuthology.orchestra.run.smithi196.stdout:(131/178): libunwind-1.6.2-1.el9.x86_64.rpm 543 kB/s | 67 kB 00:00 2024-05-14T09:32:39.890 INFO:teuthology.orchestra.run.smithi135.stdout:(63/178): libgfortran-11.4.1-3.el9.x86_64.rpm 356 kB/s | 803 kB 00:02 2024-05-14T09:32:40.010 INFO:teuthology.orchestra.run.smithi196.stdout:(132/178): libarrow-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-05-14T09:32:40.015 INFO:teuthology.orchestra.run.smithi135.stdout:(64/178): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-05-14T09:32:40.035 INFO:teuthology.orchestra.run.smithi196.stdout:(133/178): luarocks-3.9.2-1.el9.noarch.rpm 791 kB/s | 151 kB 00:00 2024-05-14T09:32:40.119 INFO:teuthology.orchestra.run.smithi196.stdout:(134/178): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 839 kB 00:00 2024-05-14T09:32:40.124 INFO:teuthology.orchestra.run.smithi135.stdout:(65/178): python3-ply-3.11-14.el9.noarch.rpm 993 kB/s | 106 kB 00:00 2024-05-14T09:32:40.161 INFO:teuthology.orchestra.run.smithi196.stdout:(135/178): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-05-14T09:32:40.191 INFO:teuthology.orchestra.run.smithi135.stdout:(66/178): python3-cryptography-36.0.1-4.el9.x86 4.1 MB/s | 1.2 MB 00:00 2024-05-14T09:32:40.233 INFO:teuthology.orchestra.run.smithi135.stdout:(67/178): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-05-14T09:32:40.309 INFO:teuthology.orchestra.run.smithi135.stdout:(68/178): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-05-14T09:32:40.359 INFO:teuthology.orchestra.run.smithi135.stdout:(69/178): python3-urllib3-1.26.5-5.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-05-14T09:32:40.443 INFO:teuthology.orchestra.run.smithi135.stdout:(70/178): automake-1.16.2-8.el9.noarch.rpm 5.1 MB/s | 689 kB 00:00 2024-05-14T09:32:40.560 INFO:teuthology.orchestra.run.smithi135.stdout:(71/178): boost-program-options-1.75.0-8.el9.x8 923 kB/s | 107 kB 00:00 2024-05-14T09:32:40.660 INFO:teuthology.orchestra.run.smithi135.stdout:(72/178): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-05-14T09:32:40.685 INFO:teuthology.orchestra.run.smithi135.stdout:(73/178): elfutils-libelf-devel-0.190-2.el9.x86 172 kB/s | 21 kB 00:00 2024-05-14T09:32:40.794 INFO:teuthology.orchestra.run.smithi135.stdout:(74/178): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-05-14T09:32:40.819 INFO:teuthology.orchestra.run.smithi135.stdout:(75/178): flexiblas-3.0.4-8.el9.x86_64.rpm 246 kB/s | 33 kB 00:00 2024-05-14T09:32:40.920 INFO:teuthology.orchestra.run.smithi135.stdout:(76/178): flexiblas-openblas-openmp-3.0.4-8.el9 183 kB/s | 18 kB 00:00 2024-05-14T09:32:41.029 INFO:teuthology.orchestra.run.smithi135.stdout:(77/178): libaio-devel-0.3.111-13.el9.x86_64.rp 104 kB/s | 11 kB 00:00 2024-05-14T09:32:41.146 INFO:teuthology.orchestra.run.smithi135.stdout:(78/178): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-05-14T09:32:41.254 INFO:teuthology.orchestra.run.smithi135.stdout:(79/178): librabbitmq-0.11.0-7.el9.x86_64.rpm 421 kB/s | 45 kB 00:00 2024-05-14T09:32:41.388 INFO:teuthology.orchestra.run.smithi135.stdout:(80/178): librdkafka-1.6.1-102.el9.x86_64.rpm 4.9 MB/s | 662 kB 00:00 2024-05-14T09:32:41.513 INFO:teuthology.orchestra.run.smithi135.stdout:(81/178): libtool-2.4.6-45.el9.x86_64.rpm 4.6 MB/s | 582 kB 00:00 2024-05-14T09:32:41.622 INFO:teuthology.orchestra.run.smithi135.stdout:(82/178): libuuid-devel-2.37.4-18.el9.x86_64.rp 236 kB/s | 25 kB 00:00 2024-05-14T09:32:41.748 INFO:teuthology.orchestra.run.smithi135.stdout:(83/178): libzstd-devel-1.5.1-2.el9.x86_64.rpm 380 kB/s | 47 kB 00:00 2024-05-14T09:32:41.882 INFO:teuthology.orchestra.run.smithi135.stdout:(84/178): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 292 kB 00:00 2024-05-14T09:32:41.999 INFO:teuthology.orchestra.run.smithi135.stdout:(85/178): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-05-14T09:32:42.099 INFO:teuthology.orchestra.run.smithi135.stdout:(86/178): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.3 MB/s | 3.0 MB 00:01 2024-05-14T09:32:42.125 INFO:teuthology.orchestra.run.smithi135.stdout:(87/178): openblas-0.3.21-2.el9.x86_64.rpm 282 kB/s | 35 kB 00:00 2024-05-14T09:32:42.486 INFO:teuthology.orchestra.run.smithi196.stdout:(136/178): python3-bcrypt-3.2.2-1.el9.x86_64.rp 18 kB/s | 43 kB 00:02 2024-05-14T09:32:42.511 INFO:teuthology.orchestra.run.smithi196.stdout:(137/178): python3-cachetools-4.2.4-1.el9.noarc 14 kB/s | 32 kB 00:02 2024-05-14T09:32:42.603 INFO:teuthology.orchestra.run.smithi196.stdout:(138/178): python3-certifi-2021.10.8-2.el9.noar 169 kB/s | 15 kB 00:00 2024-05-14T09:32:42.770 INFO:teuthology.orchestra.run.smithi196.stdout:(139/178): python3-cherrypy-18.6.1-2.el9.noarch 3.3 MB/s | 358 kB 00:00 2024-05-14T09:32:42.870 INFO:teuthology.orchestra.run.smithi196.stdout:(140/178): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-05-14T09:32:42.945 INFO:teuthology.orchestra.run.smithi196.stdout:(141/178): python3-colorama-0.4.4-12.el9.noarch 477 kB/s | 35 kB 00:00 2024-05-14T09:32:43.004 INFO:teuthology.orchestra.run.smithi196.stdout:(142/178): python3-cheroot-8.6.0-4.el9.noarch.r 351 kB/s | 172 kB 00:00 2024-05-14T09:32:43.038 INFO:teuthology.orchestra.run.smithi196.stdout:(143/178): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-05-14T09:32:43.121 INFO:teuthology.orchestra.run.smithi196.stdout:(144/178): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-05-14T09:32:43.330 INFO:teuthology.orchestra.run.smithi196.stdout:(145/178): python3-jaraco-8.2.1-3.el9.noarch.rp 51 kB/s | 11 kB 00:00 2024-05-14T09:32:43.422 INFO:teuthology.orchestra.run.smithi196.stdout:(146/178): python3-grpcio-1.46.7-10.el9.x86_64. 4.9 MB/s | 2.0 MB 00:00 2024-05-14T09:32:43.439 INFO:teuthology.orchestra.run.smithi196.stdout:(147/178): python3-jaraco-classes-3.2.1-5.el9.n 164 kB/s | 18 kB 00:00 2024-05-14T09:32:43.497 INFO:teuthology.orchestra.run.smithi196.stdout:(148/178): python3-jaraco-collections-3.0.0-8.e 312 kB/s | 23 kB 00:00 2024-05-14T09:32:43.514 INFO:teuthology.orchestra.run.smithi196.stdout:(149/178): python3-jaraco-functools-3.5.0-2.el9 261 kB/s | 19 kB 00:00 2024-05-14T09:32:43.573 INFO:teuthology.orchestra.run.smithi196.stdout:(150/178): python3-jaraco-text-3.2.0-6.el9.noar 264 kB/s | 20 kB 00:00 2024-05-14T09:32:43.682 INFO:teuthology.orchestra.run.smithi196.stdout:(151/178): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-05-14T09:32:43.874 INFO:teuthology.orchestra.run.smithi196.stdout:(152/178): python3-logutils-0.3.5-21.el9.noarch 155 kB/s | 46 kB 00:00 2024-05-14T09:32:43.936 INFO:teuthology.orchestra.run.smithi196.stdout:(153/178): python3-more-itertools-8.12.0-2.el9. 312 kB/s | 79 kB 00:00 2024-05-14T09:32:43.966 INFO:teuthology.orchestra.run.smithi196.stdout:(154/178): python3-natsort-7.1.1-5.el9.noarch.r 633 kB/s | 58 kB 00:00 2024-05-14T09:32:44.325 INFO:teuthology.orchestra.run.smithi196.stdout:(155/178): python3-portend-3.1.0-2.el9.noarch.r 46 kB/s | 16 kB 00:00 2024-05-14T09:32:44.358 INFO:teuthology.orchestra.run.smithi196.stdout:(156/178): python3-pecan-1.4.2-3.el9.noarch.rpm 646 kB/s | 272 kB 00:00 2024-05-14T09:32:44.434 INFO:teuthology.orchestra.run.smithi196.stdout:(157/178): python3-pyperclip-1.8.2-2.el9.noarch 381 kB/s | 28 kB 00:00 2024-05-14T09:32:44.517 INFO:teuthology.orchestra.run.smithi196.stdout:(158/178): python3-repoze-lru-0.7-16.el9.noarch 373 kB/s | 31 kB 00:00 2024-05-14T09:32:44.601 INFO:teuthology.orchestra.run.smithi196.stdout:(159/178): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-05-14T09:32:44.701 INFO:teuthology.orchestra.run.smithi196.stdout:(160/178): python3-rsa-4.9-2.el9.noarch.rpm 595 kB/s | 59 kB 00:00 2024-05-14T09:32:44.851 INFO:teuthology.orchestra.run.smithi196.stdout:(161/178): python3-tempora-5.0.0-2.el9.noarch.r 239 kB/s | 36 kB 00:00 2024-05-14T09:32:44.927 INFO:teuthology.orchestra.run.smithi196.stdout:(162/178): python3-typing-extensions-4.4.0-2.el 688 kB/s | 51 kB 00:00 2024-05-14T09:32:45.094 INFO:teuthology.orchestra.run.smithi196.stdout:(163/178): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-05-14T09:32:45.127 INFO:teuthology.orchestra.run.smithi196.stdout:(164/178): python3-pyOpenSSL-21.0.0-1.el9.noarc 112 kB/s | 90 kB 00:00 2024-05-14T09:32:45.169 INFO:teuthology.orchestra.run.smithi196.stdout:(165/178): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-05-14T09:32:45.453 INFO:teuthology.orchestra.run.smithi196.stdout:(166/178): python3-zc-lockfile-2.0-10.el9.noarc 71 kB/s | 20 kB 00:00 2024-05-14T09:32:45.503 INFO:teuthology.orchestra.run.smithi196.stdout:(167/178): python3-werkzeug-2.0.3-3.el9.1.noarc 1.1 MB/s | 427 kB 00:00 2024-05-14T09:32:45.537 INFO:teuthology.orchestra.run.smithi196.stdout:(168/178): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2024-05-14T09:32:45.637 INFO:teuthology.orchestra.run.smithi196.stdout:(169/178): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-14T09:32:46.216 INFO:teuthology.orchestra.run.smithi135.stdout:(88/178): openssl-devel-3.2.1-1.el9.x86_64.rpm 1.1 MB/s | 4.4 MB 00:04 2024-05-14T09:32:46.529 INFO:teuthology.orchestra.run.smithi196.stdout:(170/178): librados2-19.0.0-3588.ge2b755a6.el9. 3.4 MB/s | 3.3 MB 00:00 2024-05-14T09:32:46.696 INFO:teuthology.orchestra.run.smithi196.stdout:(171/178): librbd1-19.0.0-3588.ge2b755a6.el9.x8 2.9 MB/s | 3.1 MB 00:01 2024-05-14T09:32:46.796 INFO:teuthology.orchestra.run.smithi196.stdout:(172/178): NetworkManager-1.47.90-1.el9.x86_64. 8.7 MB/s | 2.3 MB 00:00 2024-05-14T09:32:46.838 INFO:teuthology.orchestra.run.smithi196.stdout:(173/178): NetworkManager-team-1.47.90-1.el9.x8 1.0 MB/s | 41 kB 00:00 2024-05-14T09:32:46.896 INFO:teuthology.orchestra.run.smithi196.stdout:(174/178): NetworkManager-tui-1.47.90-1.el9.x86 4.2 MB/s | 248 kB 00:00 2024-05-14T09:32:46.972 INFO:teuthology.orchestra.run.smithi196.stdout:(175/178): NetworkManager-libnm-1.47.90-1.el9.x 6.6 MB/s | 1.8 MB 00:00 2024-05-14T09:32:47.039 INFO:teuthology.orchestra.run.smithi196.stdout:(176/178): openssl-3.2.1-1.el9.x86_64.rpm 9.6 MB/s | 1.3 MB 00:00 2024-05-14T09:32:47.131 INFO:teuthology.orchestra.run.smithi196.stdout:(177/178): openssl-libs-3.2.1-1.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-05-14T09:32:48.475 INFO:teuthology.orchestra.run.smithi135.stdout:(89/178): postgresql-13.14-1.el9.x86_64.rpm 720 kB/s | 1.6 MB 00:02 2024-05-14T09:32:48.692 INFO:teuthology.orchestra.run.smithi135.stdout:(90/178): openblas-openmp-0.3.21-2.el9.x86_64.r 736 kB/s | 4.7 MB 00:06 2024-05-14T09:32:48.975 INFO:teuthology.orchestra.run.smithi135.stdout:(91/178): postgresql-private-libs-13.14-1.el9.x 472 kB/s | 133 kB 00:00 2024-05-14T09:32:49.775 INFO:teuthology.orchestra.run.smithi135.stdout:(92/178): postgresql-contrib-13.14-1.el9.x86_64 701 kB/s | 911 kB 00:01 2024-05-14T09:32:51.426 INFO:teuthology.orchestra.run.smithi135.stdout:(93/178): protobuf-3.14.0-13.el9.x86_64.rpm 626 kB/s | 1.0 MB 00:01 2024-05-14T09:32:51.618 INFO:teuthology.orchestra.run.smithi135.stdout:(94/178): python3-attrs-20.3.0-7.el9.noarch.rpm 459 kB/s | 87 kB 00:00 2024-05-14T09:32:56.192 INFO:teuthology.orchestra.run.smithi135.stdout:(95/178): postgresql-server-13.14-1.el9.x86_64. 820 kB/s | 5.8 MB 00:07 2024-05-14T09:32:56.543 INFO:teuthology.orchestra.run.smithi135.stdout:(96/178): python3-devel-3.9.18-3.el9.x86_64.rpm 699 kB/s | 244 kB 00:00 2024-05-14T09:32:56.910 INFO:teuthology.orchestra.run.smithi135.stdout:(97/178): python3-jinja2-2.11.3-5.el9.noarch.rp 678 kB/s | 248 kB 00:00 2024-05-14T09:32:57.018 INFO:teuthology.orchestra.run.smithi135.stdout:(98/178): python3-jsonpatch-1.21-16.el9.noarch. 239 kB/s | 26 kB 00:00 2024-05-14T09:32:57.127 INFO:teuthology.orchestra.run.smithi135.stdout:(99/178): python3-jsonpointer-2.0-4.el9.noarch. 178 kB/s | 19 kB 00:00 2024-05-14T09:32:57.394 INFO:teuthology.orchestra.run.smithi135.stdout:(100/178): python3-mako-1.1.4-6.el9.noarch.rpm 647 kB/s | 172 kB 00:00 2024-05-14T09:32:57.503 INFO:teuthology.orchestra.run.smithi135.stdout:(101/178): python3-markupsafe-1.1.1-12.el9.x86_ 323 kB/s | 35 kB 00:00 2024-05-14T09:33:00.153 INFO:teuthology.orchestra.run.smithi135.stdout:(102/178): python3-babel-2.9.1-2.el9.noarch.rpm 715 kB/s | 6.0 MB 00:08 2024-05-14T09:33:00.545 INFO:teuthology.orchestra.run.smithi135.stdout:(103/178): python3-numpy-f2py-1.20.1-5.el9.x86_ 641 kB/s | 250 kB 00:00 2024-05-14T09:33:00.954 INFO:teuthology.orchestra.run.smithi135.stdout:(104/178): python3-oauthlib-3.1.1-5.el9.noarch. 545 kB/s | 222 kB 00:00 2024-05-14T09:33:01.179 INFO:teuthology.orchestra.run.smithi135.stdout:(105/178): python3-packaging-20.9-5.el9.noarch. 344 kB/s | 77 kB 00:00 2024-05-14T09:33:01.330 INFO:teuthology.orchestra.run.smithi135.stdout:(106/178): python3-prettytable-0.7.2-27.el9.noa 283 kB/s | 42 kB 00:00 2024-05-14T09:33:02.314 INFO:teuthology.orchestra.run.smithi135.stdout:(107/178): python3-numpy-1.20.1-5.el9.x86_64.rp 1.1 MB/s | 5.1 MB 00:04 2024-05-14T09:33:03.356 INFO:teuthology.orchestra.run.smithi135.stdout:(108/178): python3-protobuf-3.14.0-13.el9.noarc 133 kB/s | 269 kB 00:02 2024-05-14T09:33:03.472 INFO:teuthology.orchestra.run.smithi135.stdout:(109/178): python3-pyasn1-0.4.8-6.el9.noarch.rp 137 kB/s | 159 kB 00:01 2024-05-14T09:33:03.715 INFO:teuthology.orchestra.run.smithi135.stdout:(110/178): python3-pytz-2021.1-5.el9.noarch.rpm 212 kB/s | 51 kB 00:00 2024-05-14T09:33:03.815 INFO:teuthology.orchestra.run.smithi135.stdout:(111/178): python3-pyasn1-modules-0.4.8-6.el9.n 609 kB/s | 279 kB 00:00 2024-05-14T09:33:03.857 INFO:teuthology.orchestra.run.smithi135.stdout:(112/178): python3-requests-oauthlib-1.3.0-12.e 380 kB/s | 54 kB 00:00 2024-05-14T09:33:03.999 INFO:teuthology.orchestra.run.smithi135.stdout:(113/178): python3-toml-0.10.2-6.el9.noarch.rpm 295 kB/s | 42 kB 00:00 2024-05-14T09:33:04.132 INFO:teuthology.orchestra.run.smithi135.stdout:(114/178): python3-wcwidth-0.2.5-8.el9.noarch.r 332 kB/s | 44 kB 00:00 2024-05-14T09:33:04.458 INFO:teuthology.orchestra.run.smithi135.stdout:(115/178): qatlib-24.02.0-1.el9.x86_64.rpm 680 kB/s | 221 kB 00:00 2024-05-14T09:33:04.575 INFO:teuthology.orchestra.run.smithi135.stdout:(116/178): qatlib-service-24.02.0-1.el9.x86_64. 309 kB/s | 36 kB 00:00 2024-05-14T09:33:04.723 INFO:teuthology.orchestra.run.smithi135.stdout:(117/178): qatzip-libs-1.2.0-1.el9.x86_64.rpm 323 kB/s | 47 kB 00:00 2024-05-14T09:33:04.859 INFO:teuthology.orchestra.run.smithi135.stdout:(118/178): socat-1.7.4.1-5.el9.x86_64.rpm 2.2 MB/s | 305 kB 00:00 2024-05-14T09:33:04.984 INFO:teuthology.orchestra.run.smithi135.stdout:(119/178): uuid-1.6.2-55.el9.x86_64.rpm 466 kB/s | 58 kB 00:00 2024-05-14T09:33:05.110 INFO:teuthology.orchestra.run.smithi135.stdout:(120/178): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 753 kB/s | 94 kB 00:00 2024-05-14T09:33:05.235 INFO:teuthology.orchestra.run.smithi135.stdout:(121/178): xmlstarlet-1.6.1-20.el9.x86_64.rpm 512 kB/s | 64 kB 00:00 2024-05-14T09:33:05.361 INFO:teuthology.orchestra.run.smithi135.stdout:(122/178): zlib-devel-1.2.11-41.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-05-14T09:33:05.486 INFO:teuthology.orchestra.run.smithi135.stdout:(123/178): lua-devel-5.4.4-4.el9.x86_64.rpm 179 kB/s | 22 kB 00:00 2024-05-14T09:33:05.795 INFO:teuthology.orchestra.run.smithi135.stdout:(124/178): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-05-14T09:33:06.196 INFO:teuthology.orchestra.run.smithi135.stdout:(125/178): abseil-cpp-20211102.0-3.el9.x86_64.r 1.3 MB/s | 548 kB 00:00 2024-05-14T09:33:06.371 INFO:teuthology.orchestra.run.smithi135.stdout:(126/178): gperftools-libs-2.9.1-2.el9.x86_64.r 1.7 MB/s | 309 kB 00:00 2024-05-14T09:33:06.438 INFO:teuthology.orchestra.run.smithi135.stdout:(127/178): grpc-data-1.46.7-10.el9.noarch.rpm 294 kB/s | 19 kB 00:00 2024-05-14T09:33:08.330 INFO:teuthology.orchestra.run.smithi135.stdout:(128/178): libarrow-9.0.0-11.el9.x86_64.rpm 2.3 MB/s | 4.4 MB 00:01 2024-05-14T09:33:08.397 INFO:teuthology.orchestra.run.smithi135.stdout:(129/178): libarrow-doc-9.0.0-11.el9.noarch.rpm 395 kB/s | 26 kB 00:00 2024-05-14T09:33:08.472 INFO:teuthology.orchestra.run.smithi135.stdout:(130/178): liboath-2.6.7-2.el9.x86_64.rpm 655 kB/s | 49 kB 00:00 2024-05-14T09:33:08.548 INFO:teuthology.orchestra.run.smithi135.stdout:(131/178): libunwind-1.6.2-1.el9.x86_64.rpm 905 kB/s | 67 kB 00:00 2024-05-14T09:33:08.706 INFO:teuthology.orchestra.run.smithi135.stdout:(132/178): luarocks-3.9.2-1.el9.noarch.rpm 958 kB/s | 151 kB 00:00 2024-05-14T09:33:09.431 INFO:teuthology.orchestra.run.smithi135.stdout:(133/178): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.1 MB/s | 839 kB 00:00 2024-05-14T09:33:10.199 INFO:teuthology.orchestra.run.smithi135.stdout:(134/178): python3-asyncssh-2.13.2-5.el9.noarch 715 kB/s | 548 kB 00:00 2024-05-14T09:33:10.332 INFO:teuthology.orchestra.run.smithi135.stdout:(135/178): python3-bcrypt-3.2.2-1.el9.x86_64.rp 330 kB/s | 43 kB 00:00 2024-05-14T09:33:10.408 INFO:teuthology.orchestra.run.smithi135.stdout:(136/178): python3-cachetools-4.2.4-1.el9.noarc 432 kB/s | 32 kB 00:00 2024-05-14T09:33:10.483 INFO:teuthology.orchestra.run.smithi135.stdout:(137/178): python3-certifi-2021.10.8-2.el9.noar 202 kB/s | 15 kB 00:00 2024-05-14T09:33:10.800 INFO:teuthology.orchestra.run.smithi135.stdout:(138/178): python3-cheroot-8.6.0-4.el9.noarch.r 544 kB/s | 172 kB 00:00 2024-05-14T09:33:11.251 INFO:teuthology.orchestra.run.smithi135.stdout:(139/178): python3-cherrypy-18.6.1-2.el9.noarch 797 kB/s | 358 kB 00:00 2024-05-14T09:33:11.493 INFO:teuthology.orchestra.run.smithi135.stdout:(140/178): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.2 MB/s | 303 kB 00:00 2024-05-14T09:33:11.559 INFO:teuthology.orchestra.run.smithi135.stdout:(141/178): python3-colorama-0.4.4-12.el9.noarch 539 kB/s | 35 kB 00:00 2024-05-14T09:33:11.735 INFO:teuthology.orchestra.run.smithi135.stdout:(142/178): python3-google-auth-2.29.0-1.el9.noa 1.2 MB/s | 206 kB 00:00 2024-05-14T09:33:12.811 INFO:teuthology.orchestra.run.smithi196.stdout:(178/178): ceph-test-debuginfo-19.0.0-3588.ge2b 9.4 MB/s | 624 MB 01:06 2024-05-14T09:33:12.822 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-05-14T09:33:12.822 INFO:teuthology.orchestra.run.smithi196.stdout:Total 12 MB/s | 2.1 GB 02:59 2024-05-14T09:33:13.319 INFO:teuthology.orchestra.run.smithi135.stdout:(143/178): python3-grpcio-1.46.7-10.el9.x86_64. 1.3 MB/s | 2.0 MB 00:01 2024-05-14T09:33:13.478 INFO:teuthology.orchestra.run.smithi135.stdout:(144/178): python3-grpcio-tools-1.46.7-10.el9.x 919 kB/s | 144 kB 00:00 2024-05-14T09:33:13.536 INFO:teuthology.orchestra.run.smithi135.stdout:(145/178): python3-jaraco-8.2.1-3.el9.noarch.rp 186 kB/s | 11 kB 00:00 2024-05-14T09:33:13.595 INFO:teuthology.orchestra.run.smithi135.stdout:(146/178): python3-jaraco-classes-3.2.1-5.el9.n 306 kB/s | 18 kB 00:00 2024-05-14T09:33:13.662 INFO:teuthology.orchestra.run.smithi135.stdout:(147/178): python3-jaraco-collections-3.0.0-8.e 351 kB/s | 23 kB 00:00 2024-05-14T09:33:13.721 INFO:teuthology.orchestra.run.smithi135.stdout:(148/178): python3-jaraco-functools-3.5.0-2.el9 338 kB/s | 19 kB 00:00 2024-05-14T09:33:13.779 INFO:teuthology.orchestra.run.smithi135.stdout:(149/178): python3-jaraco-text-3.2.0-6.el9.noar 341 kB/s | 20 kB 00:00 2024-05-14T09:33:14.805 INFO:teuthology.orchestra.run.smithi135.stdout:(150/178): python3-kubernetes-26.1.0-2.el9.noar 1.0 MB/s | 1.0 MB 00:01 2024-05-14T09:33:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:(151/178): python3-logutils-0.3.5-21.el9.noarch 232 kB/s | 46 kB 00:00 2024-05-14T09:33:15.256 INFO:teuthology.orchestra.run.smithi135.stdout:(152/178): python3-more-itertools-8.12.0-2.el9. 316 kB/s | 79 kB 00:00 2024-05-14T09:33:15.398 INFO:teuthology.orchestra.run.smithi135.stdout:(153/178): python3-natsort-7.1.1-5.el9.noarch.r 410 kB/s | 58 kB 00:00 2024-05-14T09:33:15.840 INFO:teuthology.orchestra.run.smithi135.stdout:(154/178): python3-pecan-1.4.2-3.el9.noarch.rpm 617 kB/s | 272 kB 00:00 2024-05-14T09:33:15.853 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-05-14T09:33:15.898 INFO:teuthology.orchestra.run.smithi135.stdout:(155/178): python3-portend-3.1.0-2.el9.noarch.r 285 kB/s | 16 kB 00:00 2024-05-14T09:33:16.015 INFO:teuthology.orchestra.run.smithi135.stdout:(156/178): python3-pyOpenSSL-21.0.0-1.el9.noarc 775 kB/s | 90 kB 00:00 2024-05-14T09:33:16.074 INFO:teuthology.orchestra.run.smithi135.stdout:(157/178): python3-pyperclip-1.8.2-2.el9.noarch 489 kB/s | 28 kB 00:00 2024-05-14T09:33:16.104 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-05-14T09:33:16.105 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-05-14T09:33:16.133 INFO:teuthology.orchestra.run.smithi135.stdout:(158/178): python3-repoze-lru-0.7-16.el9.noarch 533 kB/s | 31 kB 00:00 2024-05-14T09:33:16.358 INFO:teuthology.orchestra.run.smithi135.stdout:(159/178): python3-routes-2.5.1-5.el9.noarch.rp 841 kB/s | 188 kB 00:00 2024-05-14T09:33:16.475 INFO:teuthology.orchestra.run.smithi135.stdout:(160/178): python3-rsa-4.9-2.el9.noarch.rpm 510 kB/s | 59 kB 00:00 2024-05-14T09:33:16.542 INFO:teuthology.orchestra.run.smithi135.stdout:(161/178): python3-tempora-5.0.0-2.el9.noarch.r 541 kB/s | 36 kB 00:00 2024-05-14T09:33:16.643 INFO:teuthology.orchestra.run.smithi135.stdout:(162/178): python3-typing-extensions-4.4.0-2.el 513 kB/s | 51 kB 00:00 2024-05-14T09:33:16.860 INFO:teuthology.orchestra.run.smithi135.stdout:(163/178): python3-webob-1.8.7-6.el9.noarch.rpm 1.0 MB/s | 230 kB 00:00 2024-05-14T09:33:16.960 INFO:teuthology.orchestra.run.smithi135.stdout:(164/178): python3-websocket-client-1.2.3-2.el9 902 kB/s | 90 kB 00:00 2024-05-14T09:33:17.294 INFO:teuthology.orchestra.run.smithi135.stdout:(165/178): python3-werkzeug-2.0.3-3.el9.1.noarc 1.3 MB/s | 427 kB 00:00 2024-05-14T09:33:17.353 INFO:teuthology.orchestra.run.smithi135.stdout:(166/178): python3-zc-lockfile-2.0-10.el9.noarc 346 kB/s | 20 kB 00:00 2024-05-14T09:33:20.203 INFO:teuthology.orchestra.run.smithi135.stdout:(167/178): ceph-test-debuginfo-19.0.0-3588.ge2b 7.4 MB/s | 624 MB 01:24 2024-05-14T09:33:20.228 INFO:teuthology.orchestra.run.smithi135.stdout:(168/178): re2-20211101-3.el9.x86_64.rpm 67 kB/s | 192 kB 00:02 2024-05-14T09:33:20.537 INFO:teuthology.orchestra.run.smithi135.stdout:(169/178): librados2-19.0.0-3588.ge2b755a6.el9. 11 MB/s | 3.3 MB 00:00 2024-05-14T09:33:20.746 INFO:teuthology.orchestra.run.smithi135.stdout:(170/178): librbd1-19.0.0-3588.ge2b755a6.el9.x8 15 MB/s | 3.1 MB 00:00 2024-05-14T09:33:21.588 INFO:teuthology.orchestra.run.smithi135.stdout:(171/178): thrift-0.15.0-2.el9.x86_64.rpm 1.1 MB/s | 1.6 MB 00:01 2024-05-14T09:33:21.805 INFO:teuthology.orchestra.run.smithi135.stdout:(172/178): NetworkManager-1.47.90-1.el9.x86_64. 2.2 MB/s | 2.3 MB 00:01 2024-05-14T09:33:21.905 INFO:teuthology.orchestra.run.smithi135.stdout:(173/178): NetworkManager-team-1.47.90-1.el9.x8 418 kB/s | 41 kB 00:00 2024-05-14T09:33:22.014 INFO:teuthology.orchestra.run.smithi135.stdout:(174/178): NetworkManager-tui-1.47.90-1.el9.x86 2.2 MB/s | 248 kB 00:00 2024-05-14T09:33:22.231 INFO:teuthology.orchestra.run.smithi135.stdout:(175/178): openssl-3.2.1-1.el9.x86_64.rpm 6.2 MB/s | 1.3 MB 00:00 2024-05-14T09:33:22.556 INFO:teuthology.orchestra.run.smithi135.stdout:(176/178): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.4 MB/s | 2.4 MB 00:00 2024-05-14T09:33:22.615 INFO:teuthology.orchestra.run.smithi135.stdout:(177/178): NetworkManager-libnm-1.47.90-1.el9.x 1.8 MB/s | 1.8 MB 00:01 2024-05-14T09:33:23.499 INFO:teuthology.orchestra.run.smithi135.stdout:(178/178): python3-scipy-1.6.2-8.el9.x86_64.rpm 845 kB/s | 16 MB 00:19 2024-05-14T09:33:23.505 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-14T09:33:23.506 INFO:teuthology.orchestra.run.smithi135.stdout:Total 11 MB/s | 2.1 GB 03:20 2024-05-14T09:33:26.646 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-14T09:33:26.896 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-14T09:33:26.897 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-14T09:33:30.427 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-05-14T09:33:30.428 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-05-14T09:33:41.317 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-14T09:33:41.318 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-14T09:33:49.265 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-05-14T09:33:52.557 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/186 2024-05-14T09:33:52.593 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_6 2/186 2024-05-14T09:33:52.658 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/186 2024-05-14T09:33:52.749 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/186 2024-05-14T09:33:52.794 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/186 2024-05-14T09:33:52.838 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/186 2024-05-14T09:33:52.949 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/186 2024-05-14T09:33:53.374 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/186 2024-05-14T09:33:53.508 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/186 2024-05-14T09:33:53.695 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/186 2024-05-14T09:33:53.721 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/186 2024-05-14T09:33:53.849 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/186 2024-05-14T09:33:53.938 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/186 2024-05-14T09:33:54.219 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 12/186 2024-05-14T09:33:54.292 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/186 2024-05-14T09:33:54.317 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/186 2024-05-14T09:33:54.469 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/186 2024-05-14T09:33:54.558 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 15/186 2024-05-14T09:33:54.813 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 15/186 2024-05-14T09:33:54.844 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/186 2024-05-14T09:33:54.921 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/186 2024-05-14T09:33:55.274 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/186 2024-05-14T09:33:55.649 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/186 2024-05-14T09:33:55.827 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/186 2024-05-14T09:33:55.905 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/186 2024-05-14T09:33:56.093 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/186 2024-05-14T09:33:56.237 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/186 2024-05-14T09:33:56.596 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/186 2024-05-14T09:33:56.806 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/186 2024-05-14T09:33:56.842 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/186 2024-05-14T09:33:56.901 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/186 2024-05-14T09:33:57.014 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/186 2024-05-14T09:33:57.071 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/186 2024-05-14T09:33:57.138 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/186 2024-05-14T09:33:57.184 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/186 2024-05-14T09:33:57.224 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/186 2024-05-14T09:33:57.341 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/186 2024-05-14T09:33:57.418 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/186 2024-05-14T09:33:57.458 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/186 2024-05-14T09:33:57.512 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/186 2024-05-14T09:33:57.626 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/186 2024-05-14T09:33:57.664 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 33/186 2024-05-14T09:33:57.739 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 34/186 2024-05-14T09:33:57.770 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 35/186 2024-05-14T09:33:57.890 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/186 2024-05-14T09:33:57.949 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/186 2024-05-14T09:33:58.048 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/186 2024-05-14T09:33:58.231 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/186 2024-05-14T09:33:58.302 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/186 2024-05-14T09:33:58.973 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/186 2024-05-14T09:33:59.073 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/186 2024-05-14T09:33:59.119 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/186 2024-05-14T09:33:59.190 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/186 2024-05-14T09:33:59.230 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 45/186 2024-05-14T09:33:59.295 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/186 2024-05-14T09:33:59.499 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/186 2024-05-14T09:33:59.588 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/186 2024-05-14T09:33:59.719 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/186 2024-05-14T09:33:59.793 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 50/186 2024-05-14T09:33:59.795 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-14T09:33:59.880 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/186 2024-05-14T09:33:59.930 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 52/186 2024-05-14T09:33:59.968 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 53/186 2024-05-14T09:34:00.035 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/186 2024-05-14T09:34:00.077 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/186 2024-05-14T09:34:00.146 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/186 2024-05-14T09:34:00.207 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/186 2024-05-14T09:34:00.440 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/186 2024-05-14T09:34:00.492 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/186 2024-05-14T09:34:00.530 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 60/186 2024-05-14T09:34:00.587 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/186 2024-05-14T09:34:00.734 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/186 2024-05-14T09:34:00.779 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/186 2024-05-14T09:34:00.840 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/186 2024-05-14T09:34:00.878 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/186 2024-05-14T09:34:00.911 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/186 2024-05-14T09:34:01.169 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/186 2024-05-14T09:34:01.356 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/186 2024-05-14T09:34:01.409 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/186 2024-05-14T09:34:01.451 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/186 2024-05-14T09:34:01.494 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/186 2024-05-14T09:34:01.552 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/186 2024-05-14T09:34:01.603 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/186 2024-05-14T09:34:01.645 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/186 2024-05-14T09:34:01.716 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/186 2024-05-14T09:34:01.766 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/186 2024-05-14T09:34:01.833 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/186 2024-05-14T09:34:01.882 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/186 2024-05-14T09:34:02.024 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/186 2024-05-14T09:34:02.116 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/186 2024-05-14T09:34:02.156 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/186 2024-05-14T09:34:02.227 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/186 2024-05-14T09:34:02.373 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/186 2024-05-14T09:34:02.457 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/186 2024-05-14T09:34:03.046 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/186 2024-05-14T09:34:03.085 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_6 2/186 2024-05-14T09:34:03.138 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/186 2024-05-14T09:34:03.228 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/186 2024-05-14T09:34:03.276 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/186 2024-05-14T09:34:03.313 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/186 2024-05-14T09:34:03.409 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/186 2024-05-14T09:34:03.416 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/186 2024-05-14T09:34:03.476 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/186 2024-05-14T09:34:03.509 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/186 2024-05-14T09:34:03.658 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/186 2024-05-14T09:34:03.737 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/186 2024-05-14T09:34:03.831 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/186 2024-05-14T09:34:03.838 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/186 2024-05-14T09:34:03.886 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/186 2024-05-14T09:34:03.974 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/186 2024-05-14T09:34:04.139 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-0.3.21-2.el9.x86_64 92/186 2024-05-14T09:34:04.149 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/186 2024-05-14T09:34:04.179 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 93/186 2024-05-14T09:34:04.181 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/186 2024-05-14T09:34:04.274 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/186 2024-05-14T09:34:04.307 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/186 2024-05-14T09:34:04.347 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/186 2024-05-14T09:34:04.656 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 12/186 2024-05-14T09:34:04.720 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/186 2024-05-14T09:34:04.745 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/186 2024-05-14T09:34:04.902 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/186 2024-05-14T09:34:04.938 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 15/186 2024-05-14T09:34:05.023 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 15/186 2024-05-14T09:34:05.056 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/186 2024-05-14T09:34:05.118 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/186 2024-05-14T09:34:05.134 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/186 2024-05-14T09:34:05.280 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/186 2024-05-14T09:34:05.435 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/186 2024-05-14T09:34:05.924 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/186 2024-05-14T09:34:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/186 2024-05-14T09:34:06.184 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/186 2024-05-14T09:34:06.308 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/186 2024-05-14T09:34:06.419 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/186 2024-05-14T09:34:06.727 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/186 2024-05-14T09:34:06.909 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/186 2024-05-14T09:34:06.949 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/186 2024-05-14T09:34:07.001 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/186 2024-05-14T09:34:07.104 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/186 2024-05-14T09:34:07.154 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/186 2024-05-14T09:34:07.217 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/186 2024-05-14T09:34:07.266 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/186 2024-05-14T09:34:07.281 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/186 2024-05-14T09:34:07.299 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/186 2024-05-14T09:34:07.381 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/186 2024-05-14T09:34:07.416 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/186 2024-05-14T09:34:07.420 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/186 2024-05-14T09:34:07.452 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 100/186 2024-05-14T09:34:07.494 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/186 2024-05-14T09:34:07.526 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/186 2024-05-14T09:34:07.580 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/186 2024-05-14T09:34:07.694 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/186 2024-05-14T09:34:07.732 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 33/186 2024-05-14T09:34:07.781 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 34/186 2024-05-14T09:34:07.813 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 35/186 2024-05-14T09:34:07.838 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/186 2024-05-14T09:34:07.885 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/186 2024-05-14T09:34:07.926 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/186 2024-05-14T09:34:07.985 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/186 2024-05-14T09:34:08.005 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/186 2024-05-14T09:34:08.041 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 103/186 2024-05-14T09:34:08.084 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/186 2024-05-14T09:34:08.099 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/186 2024-05-14T09:34:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/186 2024-05-14T09:34:08.328 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/186 2024-05-14T09:34:08.653 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/186 2024-05-14T09:34:08.688 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/186 2024-05-14T09:34:08.796 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/186 2024-05-14T09:34:08.823 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/186 2024-05-14T09:34:09.024 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/186 2024-05-14T09:34:09.135 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/186 2024-05-14T09:34:09.179 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/186 2024-05-14T09:34:09.225 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/186 2024-05-14T09:34:09.265 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 45/186 2024-05-14T09:34:09.324 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/186 2024-05-14T09:34:09.516 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/186 2024-05-14T09:34:09.589 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/186 2024-05-14T09:34:09.711 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/186 2024-05-14T09:34:09.791 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 50/186 2024-05-14T09:34:09.875 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/186 2024-05-14T09:34:09.915 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 52/186 2024-05-14T09:34:09.953 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 53/186 2024-05-14T09:34:10.041 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/186 2024-05-14T09:34:10.088 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/186 2024-05-14T09:34:10.150 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/186 2024-05-14T09:34:10.206 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/186 2024-05-14T09:34:10.412 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/186 2024-05-14T09:34:10.468 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/186 2024-05-14T09:34:10.515 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 60/186 2024-05-14T09:34:10.571 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/186 2024-05-14T09:34:10.702 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/186 2024-05-14T09:34:10.739 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/186 2024-05-14T09:34:10.786 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/186 2024-05-14T09:34:10.821 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/186 2024-05-14T09:34:10.854 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/186 2024-05-14T09:34:11.050 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/186 2024-05-14T09:34:11.231 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/186 2024-05-14T09:34:11.286 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/186 2024-05-14T09:34:11.325 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/186 2024-05-14T09:34:11.370 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/186 2024-05-14T09:34:11.428 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/186 2024-05-14T09:34:11.432 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/186 2024-05-14T09:34:11.481 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/186 2024-05-14T09:34:11.485 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/186 2024-05-14T09:34:11.555 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/186 2024-05-14T09:34:11.602 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/186 2024-05-14T09:34:11.652 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/186 2024-05-14T09:34:11.740 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/186 2024-05-14T09:34:11.794 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/186 2024-05-14T09:34:11.935 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/186 2024-05-14T09:34:12.015 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/186 2024-05-14T09:34:12.075 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/186 2024-05-14T09:34:12.149 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/186 2024-05-14T09:34:12.151 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/186 2024-05-14T09:34:12.222 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/186 2024-05-14T09:34:12.305 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/186 2024-05-14T09:34:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/186 2024-05-14T09:34:12.377 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T09:34:12.378 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T09:34:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:34:12.378 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/186 2024-05-14T09:34:12.448 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 110/186 2024-05-14T09:34:13.336 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/186 2024-05-14T09:34:13.386 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/186 2024-05-14T09:34:13.420 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/186 2024-05-14T09:34:13.540 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/186 2024-05-14T09:34:13.597 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/186 2024-05-14T09:34:13.701 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/186 2024-05-14T09:34:13.746 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/186 2024-05-14T09:34:13.979 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.21-2.el9.x86_64 92/186 2024-05-14T09:34:14.019 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 93/186 2024-05-14T09:34:14.136 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/186 2024-05-14T09:34:14.955 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/186 2024-05-14T09:34:15.098 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/186 2024-05-14T09:34:16.668 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/186 2024-05-14T09:34:16.775 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/186 2024-05-14T09:34:16.810 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/186 2024-05-14T09:34:16.845 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 100/186 2024-05-14T09:34:17.224 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/186 2024-05-14T09:34:17.270 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/186 2024-05-14T09:34:17.393 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/186 2024-05-14T09:34:17.426 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 103/186 2024-05-14T09:34:17.483 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/186 2024-05-14T09:34:18.072 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/186 2024-05-14T09:34:18.106 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/186 2024-05-14T09:34:18.215 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/186 2024-05-14T09:34:18.242 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/186 2024-05-14T09:34:20.774 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/186 2024-05-14T09:34:20.813 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/186 2024-05-14T09:34:21.471 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/186 2024-05-14T09:34:21.516 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/186 2024-05-14T09:34:21.682 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/186 2024-05-14T09:34:21.682 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T09:34:21.682 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T09:34:21.682 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:34:21.717 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 110/186 2024-05-14T09:34:26.401 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 110/186 2024-05-14T09:34:26.401 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /sys 2024-05-14T09:34:26.401 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /proc 2024-05-14T09:34:26.401 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /mnt 2024-05-14T09:34:26.401 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /var/tmp 2024-05-14T09:34:26.402 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /home 2024-05-14T09:34:26.402 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /root 2024-05-14T09:34:26.402 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /tmp 2024-05-14T09:34:26.402 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:34:26.629 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 111/186 2024-05-14T09:34:26.673 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 111/186 2024-05-14T09:34:26.673 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:26.673 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T09:34:26.673 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:34:28.423 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/186 2024-05-14T09:34:28.500 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/186 2024-05-14T09:34:28.500 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:28.500 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T09:34:28.500 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T09:34:28.500 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T09:34:28.500 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:34:28.790 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/186 2024-05-14T09:34:28.862 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/186 2024-05-14T09:34:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T09:34:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T09:34:28.863 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T09:34:28.863 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:34:29.374 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 114/186 2024-05-14T09:34:29.441 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 114/186 2024-05-14T09:34:29.441 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:29.441 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T09:34:29.441 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T09:34:29.442 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T09:34:29.442 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:34:29.582 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : automake-1.16.2-8.el9.noarch 115/186 2024-05-14T09:34:29.644 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/186 2024-05-14T09:34:29.720 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/186 2024-05-14T09:34:29.951 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/186 2024-05-14T09:34:30.019 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/186 2024-05-14T09:34:30.105 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/186 2024-05-14T09:34:30.213 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/186 2024-05-14T09:34:30.394 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/186 2024-05-14T09:34:30.444 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/186 2024-05-14T09:34:30.493 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/186 2024-05-14T09:34:30.526 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-2.9.9-15.el9.x86_64 125/186 2024-05-14T09:34:31.198 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 126/186 2024-05-14T09:34:31.237 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 126/186 2024-05-14T09:34:31.294 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 127/186 2024-05-14T09:34:31.429 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 128/186 2024-05-14T09:34:31.465 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 129/186 2024-05-14T09:34:32.717 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 129/186 2024-05-14T09:34:32.750 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 130/186 2024-05-14T09:34:33.850 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 130/186 2024-05-14T09:34:33.875 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 131/186 2024-05-14T09:34:34.032 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 131/186 2024-05-14T09:34:34.222 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 132/186 2024-05-14T09:34:34.277 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 133/186 2024-05-14T09:34:34.347 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 133/186 2024-05-14T09:34:34.347 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:34.347 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T09:34:34.347 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T09:34:34.347 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T09:34:34.347 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:34:34.421 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 134/186 2024-05-14T09:34:34.460 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 134/186 2024-05-14T09:34:34.608 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/186 2024-05-14T09:34:34.726 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 136/186 2024-05-14T09:34:35.803 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libtool-2.4.6-45.el9.x86_64 137/186 2024-05-14T09:34:35.840 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 138/186 2024-05-14T09:34:35.907 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 138/186 2024-05-14T09:34:35.907 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:35.907 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T09:34:35.907 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T09:34:35.907 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T09:34:35.907 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:34:35.961 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 139/186 2024-05-14T09:34:36.031 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 139/186 2024-05-14T09:34:36.031 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:36.031 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T09:34:36.032 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:34:36.128 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/186 2024-05-14T09:34:36.230 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/186 2024-05-14T09:34:36.230 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:36.230 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T09:34:36.231 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T09:34:36.231 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T09:34:36.231 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:34:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 110/186 2024-05-14T09:34:36.396 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-05-14T09:34:36.396 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-05-14T09:34:36.396 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-05-14T09:34:36.396 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-05-14T09:34:36.396 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-05-14T09:34:36.396 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-05-14T09:34:36.396 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-05-14T09:34:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:34:36.630 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 111/186 2024-05-14T09:34:36.679 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 111/186 2024-05-14T09:34:36.679 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:36.679 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T09:34:36.679 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:34:36.792 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/186 2024-05-14T09:34:36.890 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/186 2024-05-14T09:34:36.890 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:36.890 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T09:34:36.890 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T09:34:36.890 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T09:34:36.890 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:34:38.426 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/186 2024-05-14T09:34:38.506 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/186 2024-05-14T09:34:38.506 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:38.507 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T09:34:38.507 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T09:34:38.507 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T09:34:38.507 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:34:38.751 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/186 2024-05-14T09:34:38.820 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/186 2024-05-14T09:34:38.820 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:38.820 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T09:34:38.820 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T09:34:38.820 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T09:34:38.820 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:34:39.327 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 114/186 2024-05-14T09:34:39.397 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 114/186 2024-05-14T09:34:39.397 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:39.397 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T09:34:39.397 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T09:34:39.397 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T09:34:39.397 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:34:39.518 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.2-8.el9.noarch 115/186 2024-05-14T09:34:39.581 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/186 2024-05-14T09:34:39.669 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/186 2024-05-14T09:34:40.113 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/186 2024-05-14T09:34:40.174 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/186 2024-05-14T09:34:40.266 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/186 2024-05-14T09:34:40.374 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/186 2024-05-14T09:34:40.565 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/186 2024-05-14T09:34:40.621 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/186 2024-05-14T09:34:40.672 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/186 2024-05-14T09:34:40.727 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-15.el9.x86_64 125/186 2024-05-14T09:34:41.371 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 126/186 2024-05-14T09:34:41.412 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 126/186 2024-05-14T09:34:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 127/186 2024-05-14T09:34:41.577 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 128/186 2024-05-14T09:34:41.613 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 129/186 2024-05-14T09:34:41.615 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/186 2024-05-14T09:34:41.699 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/186 2024-05-14T09:34:41.766 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 144/186 2024-05-14T09:34:41.806 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 145/186 2024-05-14T09:34:41.845 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 146/186 2024-05-14T09:34:42.137 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 147/186 2024-05-14T09:34:42.185 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 148/186 2024-05-14T09:34:42.214 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 149/186 2024-05-14T09:34:42.249 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 150/186 2024-05-14T09:34:42.299 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 151/186 2024-05-14T09:34:42.910 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 129/186 2024-05-14T09:34:42.948 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 130/186 2024-05-14T09:34:43.267 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 152/186 2024-05-14T09:34:43.304 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 152/186 2024-05-14T09:34:43.358 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 152/186 2024-05-14T09:34:44.048 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 130/186 2024-05-14T09:34:44.081 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 131/186 2024-05-14T09:34:44.240 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 131/186 2024-05-14T09:34:44.426 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 132/186 2024-05-14T09:34:44.459 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 133/186 2024-05-14T09:34:44.527 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 133/186 2024-05-14T09:34:44.527 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:44.527 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T09:34:44.527 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T09:34:44.527 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T09:34:44.527 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:34:44.585 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 134/186 2024-05-14T09:34:44.621 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 134/186 2024-05-14T09:34:44.727 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/186 2024-05-14T09:34:44.793 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 136/186 2024-05-14T09:34:45.804 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-45.el9.x86_64 137/186 2024-05-14T09:34:45.853 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 138/186 2024-05-14T09:34:45.923 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 138/186 2024-05-14T09:34:45.923 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:45.923 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T09:34:45.923 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T09:34:45.923 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T09:34:45.923 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:34:45.987 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 139/186 2024-05-14T09:34:46.057 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 139/186 2024-05-14T09:34:46.057 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:46.057 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T09:34:46.057 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:34:46.130 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/186 2024-05-14T09:34:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/186 2024-05-14T09:34:46.205 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:46.205 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T09:34:46.205 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T09:34:46.205 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T09:34:46.205 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:34:46.605 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/186 2024-05-14T09:34:46.678 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/186 2024-05-14T09:34:46.678 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T09:34:46.678 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T09:34:46.679 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T09:34:46.679 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T09:34:46.679 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:34:51.287 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 153/186 2024-05-14T09:34:51.519 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/186 2024-05-14T09:34:51.596 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/186 2024-05-14T09:34:51.666 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 144/186 2024-05-14T09:34:51.704 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 145/186 2024-05-14T09:34:51.743 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 146/186 2024-05-14T09:34:52.042 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 147/186 2024-05-14T09:34:52.099 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 148/186 2024-05-14T09:34:52.129 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 149/186 2024-05-14T09:34:52.177 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 150/186 2024-05-14T09:34:52.230 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 151/186 2024-05-14T09:34:53.117 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 152/186 2024-05-14T09:34:53.193 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 152/186 2024-05-14T09:34:53.248 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 152/186 2024-05-14T09:35:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 153/186 2024-05-14T09:35:36.235 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 154/186 2024-05-14T09:35:36.944 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-debuginfo-2:19.0.0-3588.ge2b755a6.el 155/186 2024-05-14T09:35:37.134 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 156/186 2024-05-14T09:35:41.997 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 157/186 2024-05-14T09:35:46.073 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 158/186 2024-05-14T09:35:46.172 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 154/186 2024-05-14T09:35:46.875 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-debuginfo-2:19.0.0-3588.ge2b755a6.el 155/186 2024-05-14T09:35:47.057 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 156/186 2024-05-14T09:35:51.913 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 157/186 2024-05-14T09:35:54.469 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 158/186 2024-05-14T09:35:56.745 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 159/186 2024-05-14T09:36:05.091 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 159/186 2024-05-14T09:36:26.967 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 160/186 2024-05-14T09:36:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 160/186 2024-05-14T09:36:49.879 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 161/186 2024-05-14T09:36:58.994 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 161/186 2024-05-14T09:38:03.044 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-3588.ge2b755a6.e 162/186 2024-05-14T09:38:03.682 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 163/186 2024-05-14T09:38:03.730 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-3588.ge2b755a6.el9 164/186 2024-05-14T09:38:09.284 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-debuginfo-2:19.0.0-3588.ge2b755a6 165/186 2024-05-14T09:38:12.096 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-3588.ge2b755a6.e 162/186 2024-05-14T09:38:12.731 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 163/186 2024-05-14T09:38:12.776 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-3588.ge2b755a6.el9 164/186 2024-05-14T09:38:16.162 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados2-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 166/186 2024-05-14T09:38:16.255 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librbd1-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x8 167/186 2024-05-14T09:38:16.354 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-3588.ge2b755a6 168/186 2024-05-14T09:38:16.494 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-debuginfo-2:19.0.0-3588.ge2b755a6. 169/186 2024-05-14T09:38:16.579 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-3588.ge2b755a6.el 170/186 2024-05-14T09:38:16.664 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-3588.ge2b755a6.el 171/186 2024-05-14T09:38:18.266 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-debuginfo-2:19.0.0-3588.ge2b755a6 165/186 2024-05-14T09:38:23.253 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 172/186 2024-05-14T09:38:24.598 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-3588.ge2b755a6.el9 173/186 2024-05-14T09:38:24.867 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados2-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 166/186 2024-05-14T09:38:24.968 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librbd1-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x8 167/186 2024-05-14T09:38:25.066 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-3588.ge2b755a6 168/186 2024-05-14T09:38:25.213 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-debuginfo-2:19.0.0-3588.ge2b755a6. 169/186 2024-05-14T09:38:25.274 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-3588.ge2b755a6.el 170/186 2024-05-14T09:38:25.358 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-3588.ge2b755a6.el 171/186 2024-05-14T09:38:25.865 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x8 174/186 2024-05-14T09:38:25.984 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 175/186 2024-05-14T09:38:26.069 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 176/186 2024-05-14T09:38:26.228 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flex-2.6.4-9.el9.x86_64 177/186 2024-05-14T09:38:26.295 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : bison-3.7.4-5.el9.x86_64 178/186 2024-05-14T09:38:26.333 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 179/186 2024-05-14T09:38:26.333 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/186 2024-05-14T09:38:26.448 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/186 2024-05-14T09:38:26.490 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 181/186 2024-05-14T09:38:26.491 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 182/186 2024-05-14T09:38:26.661 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 182/186 2024-05-14T09:38:26.692 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 183/186 2024-05-14T09:38:26.733 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 184/186 2024-05-14T09:38:26.733 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 184/186 2024-05-14T09:38:27.056 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 184/186 2024-05-14T09:38:27.056 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 185/186 2024-05-14T09:38:27.201 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 185/186 2024-05-14T09:38:27.331 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 186/186 2024-05-14T09:38:27.589 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 186/186 2024-05-14T09:38:27.589 INFO:teuthology.orchestra.run.smithi196.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-14T09:38:27.590 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:31.957 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 172/186 2024-05-14T09:38:34.325 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-3588.ge2b755a6.el9 173/186 2024-05-14T09:38:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x8 174/186 2024-05-14T09:38:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 175/186 2024-05-14T09:38:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 176/186 2024-05-14T09:38:35.853 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/186 2024-05-14T09:38:35.853 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/186 2024-05-14T09:38:35.854 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 3/186 2024-05-14T09:38:35.854 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/186 2024-05-14T09:38:35.854 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-3588.ge2b755a6.el 5/186 2024-05-14T09:38:35.854 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_6 6/186 2024-05-14T09:38:35.854 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/186 2024-05-14T09:38:35.854 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 8/186 2024-05-14T09:38:35.854 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 9/186 2024-05-14T09:38:35.854 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 10/186 2024-05-14T09:38:35.854 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/186 2024-05-14T09:38:35.854 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 12/186 2024-05-14T09:38:35.854 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 14/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 15/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 16/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 18/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 19/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-3588.ge2b755a6.e 20/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 21/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 22/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 23/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/186 2024-05-14T09:38:35.855 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/186 2024-05-14T09:38:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 26/186 2024-05-14T09:38:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/186 2024-05-14T09:38:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-3588.ge2b755a6.el9 28/186 2024-05-14T09:38:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/186 2024-05-14T09:38:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 30/186 2024-05-14T09:38:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-3588.ge2b755a6 31/186 2024-05-14T09:38:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 32/186 2024-05-14T09:38:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 33/186 2024-05-14T09:38:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x8 34/186 2024-05-14T09:38:35.871 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 35/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 36/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 37/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 38/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-3588.ge2b755a6 39/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 40/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-3588.ge2b755a6. 41/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 42/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-3588.ge2b755a6.el 43/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 44/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-3588.ge2b755a6.el 45/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 46/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 47/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 48/186 2024-05-14T09:38:35.872 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-3588.ge2b755a6.el9 49/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 50/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x8 51/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 52/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 53/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 54/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 55/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 56/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 57/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 58/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 59/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 60/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 61/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 62/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 63/186 2024-05-14T09:38:35.873 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 64/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 65/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 66/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ply-3.11-14.el9.noarch 67/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 68/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 69/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 70/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : automake-1.16.2-8.el9.noarch 71/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : bison-3.7.4-5.el9.x86_64 72/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 73/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 74/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flex-2.6.4-9.el9.x86_64 75/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 76/186 2024-05-14T09:38:35.874 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 77/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 78/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 79/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 80/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 81/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 82/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 83/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 84/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 85/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 86/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-5.4.4-4.el9.x86_64 87/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 88/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 89/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 90/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-13.14-1.el9.x86_64 91/186 2024-05-14T09:38:35.875 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 92/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 93/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 94/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 95/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 96/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 97/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 98/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 99/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 100/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 101/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 102/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 104/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 105/186 2024-05-14T09:38:35.876 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 106/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 107/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 108/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 109/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 110/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 111/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 112/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 113/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 114/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 115/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 116/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 117/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 118/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 119/186 2024-05-14T09:38:35.877 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 120/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 121/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 122/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 123/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 124/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 125/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 126/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 127/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 128/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 129/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 130/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 131/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 132/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 133/186 2024-05-14T09:38:35.878 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 134/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 135/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 136/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 137/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 138/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 139/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 140/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 141/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 142/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 143/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 144/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 147/186 2024-05-14T09:38:35.879 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 148/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 149/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 150/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 151/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 152/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 153/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 154/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 155/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 156/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 157/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 158/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 159/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 160/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 161/186 2024-05-14T09:38:35.880 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 162/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 163/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 164/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 165/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 166/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 167/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 168/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : re2-1:20211101-3.el9.x86_64 169/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 170/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 171/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 172/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 173/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 174/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 175/186 2024-05-14T09:38:35.881 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 176/186 2024-05-14T09:38:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 177/186 2024-05-14T09:38:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 178/186 2024-05-14T09:38:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 179/186 2024-05-14T09:38:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 180/186 2024-05-14T09:38:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 181/186 2024-05-14T09:38:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 182/186 2024-05-14T09:38:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 183/186 2024-05-14T09:38:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 184/186 2024-05-14T09:38:35.882 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 185/186 2024-05-14T09:38:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.4-9.el9.x86_64 177/186 2024-05-14T09:38:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.7.4-5.el9.x86_64 178/186 2024-05-14T09:38:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 179/186 2024-05-14T09:38:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/186 2024-05-14T09:38:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/186 2024-05-14T09:38:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 181/186 2024-05-14T09:38:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 182/186 2024-05-14T09:38:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 182/186 2024-05-14T09:38:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 183/186 2024-05-14T09:38:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 184/186 2024-05-14T09:38:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 184/186 2024-05-14T09:38:36.749 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 184/186 2024-05-14T09:38:36.749 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 185/186 2024-05-14T09:38:36.895 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 185/186 2024-05-14T09:38:37.027 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 186/186 2024-05-14T09:38:37.318 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 186/186 2024-05-14T09:38:37.319 INFO:teuthology.orchestra.run.smithi135.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-14T09:38:37.319 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:38.491 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 186/186 2024-05-14T09:38:38.491 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:38.491 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T09:38:38.492 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:38.493 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.494 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T09:38:38.495 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.496 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T09:38:38.497 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T09:38:38.498 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T09:38:38.499 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T09:38:38.500 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T09:38:38.501 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T09:38:38.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T09:38:38.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T09:38:38.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T09:38:38.502 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T09:38:38.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T09:38:38.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T09:38:38.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T09:38:38.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T09:38:38.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T09:38:38.503 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T09:38:38.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T09:38:38.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T09:38:38.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T09:38:38.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T09:38:38.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T09:38:38.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T09:38:38.504 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T09:38:38.504 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T09:38:38.504 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T09:38:38.505 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T09:38:38.506 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T09:38:38.506 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:38.506 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-05-14T09:38:39.753 DEBUG:teuthology.parallel:result is None 2024-05-14T09:38:45.952 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/186 2024-05-14T09:38:45.952 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/186 2024-05-14T09:38:45.952 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 3/186 2024-05-14T09:38:45.952 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/186 2024-05-14T09:38:45.952 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-3588.ge2b755a6.el 5/186 2024-05-14T09:38:45.952 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_6 6/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 8/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 9/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 10/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 12/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 14/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 15/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 16/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 18/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 19/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-3588.ge2b755a6.e 20/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 21/186 2024-05-14T09:38:45.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 22/186 2024-05-14T09:38:45.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 23/186 2024-05-14T09:38:45.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/186 2024-05-14T09:38:45.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/186 2024-05-14T09:38:45.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 26/186 2024-05-14T09:38:45.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/186 2024-05-14T09:38:45.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-3588.ge2b755a6.el9 28/186 2024-05-14T09:38:45.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/186 2024-05-14T09:38:45.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 30/186 2024-05-14T09:38:45.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-3588.ge2b755a6 31/186 2024-05-14T09:38:45.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-debuginfo-2:19.0.0-3588.ge2b755a6.el9. 32/186 2024-05-14T09:38:45.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 33/186 2024-05-14T09:38:45.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x8 34/186 2024-05-14T09:38:45.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 35/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 36/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 37/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 38/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-3588.ge2b755a6 39/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 40/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-3588.ge2b755a6. 41/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 42/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-3588.ge2b755a6.el 43/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 44/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-3588.ge2b755a6.el 45/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 46/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x 47/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 48/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-3588.ge2b755a6.el9 49/186 2024-05-14T09:38:45.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 50/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x8 51/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 52/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 53/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 54/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 55/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 56/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 57/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 58/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 59/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 60/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 61/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 62/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 63/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 64/186 2024-05-14T09:38:45.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 65/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 66/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 67/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 68/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 69/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 70/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.2-8.el9.noarch 71/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.7.4-5.el9.x86_64 72/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 73/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 74/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.4-9.el9.x86_64 75/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 76/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 77/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 78/186 2024-05-14T09:38:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 79/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 80/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 81/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 82/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 83/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 84/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 85/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 86/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 87/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 88/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 89/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 90/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-13.14-1.el9.x86_64 91/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 92/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 93/186 2024-05-14T09:38:45.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 94/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 95/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 96/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 97/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 98/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 99/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 100/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 101/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 102/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 104/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 105/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 106/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 107/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 108/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 109/186 2024-05-14T09:38:45.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 110/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 111/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 112/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 113/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 114/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 115/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 116/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 117/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 118/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 119/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 120/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 121/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 122/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 123/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 124/186 2024-05-14T09:38:45.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 125/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 126/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 127/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 128/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 129/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 130/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 131/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 132/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 133/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 134/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 135/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 136/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 137/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 138/186 2024-05-14T09:38:45.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 139/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 140/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 141/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 142/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 143/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 144/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 147/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 148/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 149/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 150/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 151/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 152/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 153/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 154/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 155/186 2024-05-14T09:38:45.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 156/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 157/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 158/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 159/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 160/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 161/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 162/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 163/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 164/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 165/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 166/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 167/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 168/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-3.el9.x86_64 169/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 170/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 171/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 172/186 2024-05-14T09:38:45.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 173/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 174/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 175/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 176/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 177/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 178/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 179/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 180/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 181/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 182/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 183/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 184/186 2024-05-14T09:38:45.977 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 185/186 2024-05-14T09:38:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 186/186 2024-05-14T09:38:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:48.482 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-05-14T09:38:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T09:38:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T09:38:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T09:38:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T09:38:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.482 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.483 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.484 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.485 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.486 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.487 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T09:38:48.488 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T09:38:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T09:38:48.490 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T09:38:48.491 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.492 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T09:38:48.493 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-debuginfo-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T09:38:48.494 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T09:38:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T09:38:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T09:38:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T09:38:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T09:38:48.495 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:48.495 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-14T09:38:49.811 DEBUG:teuthology.parallel:result is None 2024-05-14T09:38:49.812 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:38:49.958 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T09:38:50.018 INFO:teuthology.orchestra.run.smithi135.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T09:38:50.019 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T09:38:50.019 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T09:38:50.021 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:38:50.169 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T09:38:50.241 INFO:teuthology.orchestra.run.smithi196.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T09:38:50.241 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T09:38:50.241 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T09:38:50.243 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-14T09:38:50.243 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:38:50.243 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T09:38:50.317 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:38:50.317 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T09:38:50.409 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-14T09:38:50.409 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:38:50.409 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T09:38:50.475 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T09:38:50.580 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:38:50.580 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T09:38:50.668 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T09:38:50.753 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-14T09:38:50.753 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:38:50.753 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T09:38:50.817 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T09:38:50.922 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:38:50.922 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T09:38:51.012 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T09:38:51.143 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-14T09:38:51.143 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:38:51.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T09:38:51.209 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T09:38:51.315 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:38:51.315 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T09:38:51.405 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T09:38:51.490 INFO:teuthology.run_tasks:Running task ceph... 2024-05-14T09:38:51.569 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-14T09:38:51.569 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2024-05-14T09:38:51.575 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2024-05-14T09:38:51.664 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-14T09:38:51.664 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-14T09:38:51.668 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-14T09:38:51.752 INFO:tasks.ceph:Creating extra log directories... 2024-05-14T09:38:51.752 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-14T09:38:51.756 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-14T09:38:51.848 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-14T09:38:51.848 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-14T09:38:51.848 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-14T09:38:51.848 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:38:51.848 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-14T09:38:51.887 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-14T09:38:52.070 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-14T09:38:52.142 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:38:52.143 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-14T09:38:52.199 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-14T09:38:52.417 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-14T09:38:52.503 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-14T09:38:52.503 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-14T09:38:52.503 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681', 'branch': 'wip-vshankar-testing-20240509.053109-debug', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/valgrind}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7705681', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240509.053109-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240509.053109-debug', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 120, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6285, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'sleep_before_teardown': 0, 'subset': '548/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240509.053109-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIPdqmRcfkAd8InfGtLXOKFfEPYARVHKrYuYM0eW2pW7fKonJ75X8tAReGE68/ACIBchR2/DXapwr3ZLSmNmi0=', 'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIZsn4PaLA5f0ZhIB56Idv0+jgfWuLQa+HklIyQYCqxiE/mjddYUvqk3d4GBzUTabTrwiGivMcyAAl1zC4jrAw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-14_07:04:04', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-14T09:38:52.504 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-14T09:38:52.508 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-14T09:38:52.564 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2024-05-14T09:38:52.596 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2024-05-14T09:38:52.684 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:38:52.684 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T09:38:52.724 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T09:38:52.725 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-05-14T09:38:52.805 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T09:38:52.805 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:38:52.805 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-05-14T09:38:52.805 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:38:52.805 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:38:52.805 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-14 09:38:37.738639088 +0000 2024-05-14T09:38:52.805 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-14 09:28:48.689916080 +0000 2024-05-14T09:38:52.805 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-14 09:28:48.689916080 +0000 2024-05-14T09:38:52.805 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-14 09:28:48.689916080 +0000 2024-05-14T09:38:52.805 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T09:38:52.906 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-14T09:38:52.906 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-14T09:38:52.906 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000411746 s, 1.2 MB/s 2024-05-14T09:38:52.909 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T09:38:52.953 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-05-14T09:38:53.034 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T09:38:53.034 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:38:53.034 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-05-14T09:38:53.034 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:38:53.034 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:38:53.034 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-14 09:38:37.739639067 +0000 2024-05-14T09:38:53.034 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-14 09:28:49.304903375 +0000 2024-05-14T09:38:53.035 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-14 09:28:49.304903375 +0000 2024-05-14T09:38:53.035 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-14 09:28:49.304903375 +0000 2024-05-14T09:38:53.035 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T09:38:53.146 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-14T09:38:53.147 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-14T09:38:53.147 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00034427 s, 1.5 MB/s 2024-05-14T09:38:53.150 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T09:38:53.193 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-05-14T09:38:53.273 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T09:38:53.274 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:38:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-05-14T09:38:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:38:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:38:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-14 09:38:37.739639067 +0000 2024-05-14T09:38:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-14 09:28:49.897891123 +0000 2024-05-14T09:38:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-14 09:28:49.897891123 +0000 2024-05-14T09:38:53.274 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-14 09:28:49.897891123 +0000 2024-05-14T09:38:53.274 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T09:38:53.377 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-14T09:38:53.377 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-14T09:38:53.378 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000309149 s, 1.7 MB/s 2024-05-14T09:38:53.380 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T09:38:53.431 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-05-14T09:38:53.480 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T09:38:53.480 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:38:53.480 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-05-14T09:38:53.480 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:38:53.480 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:38:53.480 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-14 09:38:37.741639025 +0000 2024-05-14T09:38:53.480 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-14 09:28:50.504878583 +0000 2024-05-14T09:38:53.480 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-14 09:28:50.504878583 +0000 2024-05-14T09:38:53.481 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-05-14 09:28:50.504878583 +0000 2024-05-14T09:38:53.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T09:38:53.554 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-14T09:38:53.554 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-14T09:38:53.554 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000565451 s, 905 kB/s 2024-05-14T09:38:53.558 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T09:38:53.611 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T09:38:53.611 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:38:53.611 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T09:38:53.670 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T09:38:53.670 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-05-14T09:38:53.721 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T09:38:53.721 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:38:53.722 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-05-14T09:38:53.722 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:38:53.722 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:38:53.722 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-05-14 09:38:28.048714921 +0000 2024-05-14T09:38:53.722 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-05-14 09:28:45.320276900 +0000 2024-05-14T09:38:53.722 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-05-14 09:28:45.320276900 +0000 2024-05-14T09:38:53.722 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-05-14 09:28:45.320276900 +0000 2024-05-14T09:38:53.722 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T09:38:53.799 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-05-14T09:38:53.800 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-05-14T09:38:53.800 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000389033 s, 1.3 MB/s 2024-05-14T09:38:53.803 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T09:38:53.859 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-05-14T09:38:53.910 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T09:38:53.910 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:38:53.910 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-05-14T09:38:53.910 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:38:53.910 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:38:53.910 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-05-14 09:38:28.049714900 +0000 2024-05-14T09:38:53.910 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-05-14 09:28:45.910264507 +0000 2024-05-14T09:38:53.911 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-05-14 09:28:45.910264507 +0000 2024-05-14T09:38:53.911 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-05-14 09:28:45.910264507 +0000 2024-05-14T09:38:53.911 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T09:38:53.990 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-05-14T09:38:53.990 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-05-14T09:38:53.991 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000540949 s, 946 kB/s 2024-05-14T09:38:53.994 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T09:38:54.050 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-05-14T09:38:54.101 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T09:38:54.101 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:38:54.101 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-05-14T09:38:54.101 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:38:54.101 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:38:54.102 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-05-14 09:38:28.049714900 +0000 2024-05-14T09:38:54.102 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-05-14 09:28:46.502252073 +0000 2024-05-14T09:38:54.102 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-05-14 09:28:46.502252073 +0000 2024-05-14T09:38:54.102 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-05-14 09:28:46.502252073 +0000 2024-05-14T09:38:54.102 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T09:38:54.177 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-05-14T09:38:54.178 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-05-14T09:38:54.178 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000419152 s, 1.2 MB/s 2024-05-14T09:38:54.181 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T09:38:54.236 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-05-14T09:38:54.285 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T09:38:54.285 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T09:38:54.285 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-05-14T09:38:54.285 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:38:54.285 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T09:38:54.285 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-05-14 09:38:28.050714878 +0000 2024-05-14T09:38:54.285 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-05-14 09:28:47.138238715 +0000 2024-05-14T09:38:54.285 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-05-14 09:28:47.138238715 +0000 2024-05-14T09:38:54.286 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-05-14 09:28:47.138238715 +0000 2024-05-14T09:38:54.286 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T09:38:54.363 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-05-14T09:38:54.363 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-05-14T09:38:54.363 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000493082 s, 1.0 MB/s 2024-05-14T09:38:54.367 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T09:38:54.424 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T09:38:54.424 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-14T09:38:54.424 INFO:tasks.ceph:Generating config... 2024-05-14T09:38:54.426 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-14T09:38:54.426 INFO:tasks.ceph:[client] debug client = 20 2024-05-14T09:38:54.426 INFO:tasks.ceph:[client] debug ms = 1 2024-05-14T09:38:54.426 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-14T09:38:54.426 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-14T09:38:54.426 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-05-14T09:38:54.426 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-05-14T09:38:54.426 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-05-14T09:38:54.426 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-14T09:38:54.426 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-14T09:38:54.426 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-14T09:38:54.427 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-14T09:38:54.428 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-14T09:38:54.428 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-14T09:38:54.428 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-14T09:38:54.428 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-14T09:38:54.428 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-05-14T09:38:54.428 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-14T09:38:54.428 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-14T09:38:54.428 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-14T09:38:54.428 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-14T09:38:54.428 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-14T09:38:54.428 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-14T09:38:54.428 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-14T09:38:54.428 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-14T09:38:54.428 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-14T09:38:54.429 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-14T09:38:54.429 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-14T09:38:54.429 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-05-14T09:38:54.429 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-14T09:38:54.429 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-14T09:38:54.429 INFO:tasks.ceph:Setting up mon.a... 2024-05-14T09:38:54.429 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-14T09:38:54.655 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.keyring 2024-05-14T09:38:54.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-14T09:38:54.871 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T09:38:54.946 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.135'), ('mon.b', '172.21.15.196'), ('mon.c', '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]')] 2024-05-14T09:38:54.947 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.135,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-14T09:38:54.947 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:38:54.947 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-14T09:38:54.997 DEBUG:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.135 --add b 172.21.15.196 --addv c '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:38:55.222 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: generated fsid 3d7e4a56-2293-41af-9139-c92eede1b811 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:setting min_mon_release = quincy 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:epoch 0 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:fsid 3d7e4a56-2293-41af-9139-c92eede1b811 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:last_changed 2024-05-14T09:38:55.223722+0000 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:created 2024-05-14T09:38:55.223722+0000 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:min_mon_release 17 (quincy) 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:election_strategy: 1 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:2: [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] mon.c 2024-05-14T09:38:55.223 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-14T09:38:55.232 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-14T09:38:55.281 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3d7e4a56-2293-41af-9139-c92eede1b811... 2024-05-14T09:38:55.282 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-14T09:38:55.328 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-14T09:38:55.459 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2024-05-14T09:38:55.459 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2024-05-14T09:38:55.459 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-14T09:38:55.459 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2024-05-14T09:38:55.459 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.459 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2024-05-14T09:38:55.459 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.459 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2024-05-14T09:38:55.459 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.460 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2024-05-14T09:38:55.461 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.135,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: mds beacon grace = 60 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: mds heartbeat grace = 60 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: osd heartbeat grace = 60 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = 3d7e4a56-2293-41af-9139-c92eede1b811 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2024-05-14T09:38:55.462 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug trim objects = true 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2024-05-14T09:38:55.463 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 20 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 20 2024-05-14T09:38:55.464 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 10 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: osd fast shutdown = False 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-05-14T09:38:55.465 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2024-05-14T09:38:55.466 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2024-05-14T09:38:55.467 INFO:teuthology.orchestra.run.smithi135.stdout: mon down mkfs grace = 300 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: mon op complaint time = 120 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd crush smoke test = False 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: client mount timeout = 600 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2024-05-14T09:38:55.468 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.e] 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.f] 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout:[mds] 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds = 20 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds balancer = 20 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug frag = True 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug scatterstat = True 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout: mds op complaint time = 180 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout: mds valgrind exit = True 2024-05-14T09:38:55.469 INFO:teuthology.orchestra.run.smithi135.stdout: mds verify scatter = True 2024-05-14T09:38:55.470 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2024-05-14T09:38:55.470 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2024-05-14T09:38:55.470 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2024-05-14T09:38:55.470 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2024-05-14T09:38:55.470 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2024-05-14T09:38:55.470 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-14T09:38:55.470 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2024-05-14T09:38:55.470 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.470 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.472 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.135,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: mds beacon grace = 60 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: mds heartbeat grace = 60 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd heartbeat grace = 60 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = 3d7e4a56-2293-41af-9139-c92eede1b811 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.473 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug trim objects = true 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.474 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 20 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 20 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-05-14T09:38:55.475 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 10 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: osd fast shutdown = False 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-05-14T09:38:55.476 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2024-05-14T09:38:55.477 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.478 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: mon down mkfs grace = 300 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: mon op complaint time = 120 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd crush smoke test = False 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: client mount timeout = 600 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2024-05-14T09:38:55.479 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.e] 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.f] 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout:[mds] 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds = 20 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds balancer = 20 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug frag = True 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug scatterstat = True 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout: mds op complaint time = 180 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout: mds valgrind exit = True 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout: mds verify scatter = True 2024-05-14T09:38:55.480 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-05-14T09:38:55.481 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-05-14T09:38:55.481 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-05-14T09:38:55.503 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-14T09:38:55.503 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-14T09:38:55.714 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-14T09:38:55.714 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:38:55.715 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-14T09:38:55.762 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:38:55.762 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-14T09:38:55.858 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T09:38:55.859 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:38:55.859 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-14T09:38:55.859 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T09:38:55.985 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:38:55.985 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:38:56.082 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2024-05-14T09:38:56.082 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:38:56.082 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-14T09:38:56.082 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T09:38:56.217 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:38:56.217 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:38:56.309 INFO:tasks.ceph:Setting up mon nodes... 2024-05-14T09:38:56.309 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-14T09:38:56.309 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-14T09:38:56.542 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-14T09:38:56.558 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-14T09:38:56.802 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-14T09:38:56.820 INFO:tasks.ceph:Setting up mds nodes... 2024-05-14T09:38:56.821 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-14T09:38:57.044 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-14T09:38:57.058 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-14T09:38:57.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-14T09:38:57.361 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-14T09:38:57.376 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-14T09:38:57.460 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-14T09:38:57.689 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-14T09:38:57.704 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-14T09:38:57.786 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-14T09:38:57.999 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-14T09:38:58.014 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-14T09:38:58.093 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-14T09:38:58.297 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-14T09:38:58.311 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-14T09:38:58.388 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-14T09:38:58.610 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-14T09:38:58.625 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-14T09:38:58.708 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-14T09:38:58.708 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-14T09:38:58.902 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-14T09:38:58.947 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-14T09:38:58.947 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-14T09:38:58.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-14T09:38:59.032 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T09:38:59.032 INFO:tasks.ceph:role: osd.0 2024-05-14T09:38:59.032 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T09:38:59.032 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-14T09:38:59.122 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T09:38:59.122 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T09:38:59.122 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T09:38:59.122 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T09:38:59.123 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T09:38:59.123 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-05-14T09:38:59.123 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T09:38:59.123 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T09:38:59.123 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T09:38:59.123 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T09:38:59.526 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-05-14T09:38:59.531 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-05-14T09:38:59.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-14T09:38:59.680 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-14T09:38:59.765 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-14T09:38:59.846 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T09:38:59.846 INFO:tasks.ceph:role: osd.1 2024-05-14T09:38:59.846 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T09:38:59.846 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-14T09:38:59.928 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T09:38:59.928 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T09:38:59.928 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T09:38:59.928 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T09:38:59.928 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T09:38:59.928 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-05-14T09:38:59.928 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T09:38:59.929 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T09:38:59.929 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T09:38:59.929 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T09:39:00.289 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-05-14T09:39:00.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-05-14T09:39:00.295 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-14T09:39:00.416 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-14T09:39:00.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-14T09:39:00.573 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T09:39:00.573 INFO:tasks.ceph:role: osd.2 2024-05-14T09:39:00.573 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T09:39:00.573 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-14T09:39:00.660 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T09:39:00.660 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T09:39:00.660 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T09:39:00.660 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T09:39:00.660 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T09:39:00.661 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-05-14T09:39:00.661 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T09:39:00.661 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T09:39:00.661 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T09:39:00.661 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T09:39:01.044 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-05-14T09:39:01.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-05-14T09:39:01.052 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-14T09:39:01.168 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-14T09:39:01.245 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-14T09:39:01.315 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T09:39:01.356 INFO:tasks.ceph:role: osd.3 2024-05-14T09:39:01.356 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T09:39:01.357 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-14T09:39:01.448 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T09:39:01.448 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T09:39:01.448 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T09:39:01.448 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T09:39:01.449 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T09:39:01.449 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-05-14T09:39:01.449 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T09:39:01.449 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T09:39:01.449 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T09:39:01.449 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T09:39:01.864 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-05-14T09:39:01.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-05-14T09:39:01.873 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-14T09:39:02.028 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-14T09:39:02.119 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:39:02.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:02.326+0000 7f15b240c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-14T09:39:02.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:02.327+0000 7f15b240c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-14T09:39:02.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:02.327+0000 7f15b240c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T09:39:02.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:02.327+0000 7f15b240c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T09:39:02.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:02.327+0000 7f15b240c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T09:39:02.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:02.330+0000 7f15b240c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-14T09:39:05.343 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-14T09:39:05.427 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:39:05.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:05.620+0000 7f5cd7030640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-14T09:39:05.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:05.621+0000 7f5cd7030640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-14T09:39:05.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:05.621+0000 7f5cd7030640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T09:39:05.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:05.621+0000 7f5cd7030640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T09:39:05.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:05.621+0000 7f5cd7030640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T09:39:05.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:05.623+0000 7f5cd7030640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-14T09:39:08.830 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-14T09:39:08.911 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:39:09.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:09.111+0000 7f88f3e11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-14T09:39:09.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:09.112+0000 7f88f3e11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-14T09:39:09.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:09.112+0000 7f88f3e11640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T09:39:09.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:09.112+0000 7f88f3e11640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T09:39:09.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:09.112+0000 7f88f3e11640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T09:39:09.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:09.114+0000 7f88f3e11640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-14T09:39:12.106 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-14T09:39:12.181 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:39:12.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:12.378+0000 7eff5840f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-14T09:39:12.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:12.379+0000 7eff5840f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-14T09:39:12.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:12.379+0000 7eff5840f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T09:39:12.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:12.379+0000 7eff5840f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T09:39:12.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:12.379+0000 7eff5840f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T09:39:12.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:12.381+0000 7eff5840f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-14T09:39:15.376 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-14T09:39:15.464 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-14T09:39:15.555 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T09:39:15.555 INFO:tasks.ceph:role: osd.4 2024-05-14T09:39:15.555 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2024-05-14T09:39:15.555 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-14T09:39:15.640 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T09:39:15.640 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T09:39:15.640 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T09:39:15.641 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T09:39:15.641 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T09:39:15.641 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-05-14T09:39:15.641 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T09:39:15.641 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T09:39:15.641 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T09:39:15.641 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T09:39:16.050 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-05-14T09:39:16.057 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-05-14T09:39:16.057 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-14T09:39:16.210 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-14T09:39:16.291 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-14T09:39:16.363 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T09:39:16.363 INFO:tasks.ceph:role: osd.5 2024-05-14T09:39:16.363 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2024-05-14T09:39:16.363 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-14T09:39:16.438 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T09:39:16.438 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T09:39:16.438 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T09:39:16.438 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T09:39:16.438 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T09:39:16.438 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-05-14T09:39:16.439 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T09:39:16.439 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T09:39:16.439 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T09:39:16.439 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T09:39:16.795 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-05-14T09:39:16.800 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-05-14T09:39:16.801 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-14T09:39:16.900 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-14T09:39:16.973 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-14T09:39:17.039 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T09:39:17.039 INFO:tasks.ceph:role: osd.6 2024-05-14T09:39:17.040 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2024-05-14T09:39:17.040 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-14T09:39:17.110 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T09:39:17.110 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T09:39:17.110 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T09:39:17.110 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T09:39:17.110 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T09:39:17.110 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-05-14T09:39:17.110 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T09:39:17.110 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T09:39:17.110 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T09:39:17.110 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T09:39:17.494 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-05-14T09:39:17.499 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-05-14T09:39:17.499 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-14T09:39:17.610 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-14T09:39:17.680 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-14T09:39:17.749 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T09:39:17.749 INFO:tasks.ceph:role: osd.7 2024-05-14T09:39:17.749 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2024-05-14T09:39:17.749 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-14T09:39:17.823 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T09:39:17.824 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T09:39:17.824 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T09:39:17.824 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T09:39:17.824 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T09:39:17.824 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-05-14T09:39:17.824 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T09:39:17.824 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T09:39:17.824 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T09:39:17.824 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T09:39:18.238 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-05-14T09:39:18.244 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-05-14T09:39:18.244 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-14T09:39:18.418 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-14T09:39:18.509 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:39:18.721 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:18.722+0000 7f972b188640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-14T09:39:18.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:18.722+0000 7f972b188640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-14T09:39:18.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:18.722+0000 7f972b188640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T09:39:18.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:18.722+0000 7f972b188640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T09:39:18.722 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:18.722+0000 7f972b188640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T09:39:18.725 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:18.726+0000 7f972b188640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-14T09:39:21.717 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-14T09:39:21.801 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:39:22.009 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:22.010+0000 7ff22ac14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-14T09:39:22.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:22.010+0000 7ff22ac14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-14T09:39:22.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:22.010+0000 7ff22ac14640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T09:39:22.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:22.010+0000 7ff22ac14640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T09:39:22.010 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:22.010+0000 7ff22ac14640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T09:39:22.012 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:22.013+0000 7ff22ac14640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-14T09:39:22.505 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:39:22.513 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:39:25.001 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-14T09:39:25.084 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:39:25.286 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:25.286+0000 7f6b003fc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-14T09:39:25.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:25.287+0000 7f6b003fc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-14T09:39:25.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:25.287+0000 7f6b003fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T09:39:25.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:25.287+0000 7f6b003fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T09:39:25.287 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:25.287+0000 7f6b003fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T09:39:25.288 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:25.289+0000 7f6b003fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-14T09:39:28.270 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-14T09:39:28.355 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:39:28.542 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:28.543+0000 7fd9de21d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-14T09:39:28.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:28.543+0000 7fd9de21d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-14T09:39:28.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:28.543+0000 7fd9de21d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T09:39:28.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:28.543+0000 7fd9de21d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T09:39:28.543 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:28.543+0000 7fd9de21d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T09:39:28.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:28.546+0000 7fd9de21d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-14T09:39:31.780 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-14T09:39:31.854 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-14T09:39:31.854 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:31.854 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-14T09:39:31.942 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:31.942 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-14T09:39:32.023 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:32.023 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-14T09:39:32.149 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:32.149 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-14T09:39:32.231 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:32.231 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-14T09:39:32.357 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:32.357 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-14T09:39:32.441 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:32.441 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-14T09:39:32.526 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:32.526 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-14T09:39:32.612 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:32.612 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-14T09:39:32.701 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:32.701 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-14T09:39:32.783 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:32.783 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-14T09:39:32.865 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:32.865 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-14T09:39:32.948 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:32.948 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-14T09:39:33.029 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:33.029 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-14T09:39:33.110 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:33.110 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-14T09:39:33.190 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:33.191 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-14T09:39:33.271 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:33.271 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-14T09:39:33.328 INFO:tasks.ceph:Adding keys to all mons... 2024-05-14T09:39:33.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-14T09:39:33.333 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-14T09:39:33.407 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2024-05-14T09:39:33.407 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAwMUNmJo1pIBAApByd3RQ434uV8HX/nFSQwQ== 2024-05-14T09:39:33.407 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2024-05-14T09:39:33.407 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAxMUNm4IC5AhAAvvCFkL52do9aCJBNTOfPAQ== 2024-05-14T09:39:33.407 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2024-05-14T09:39:33.407 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAxMUNmfBubFRAATgxcRCVFKDayVSCbC8Bn7w== 2024-05-14T09:39:33.407 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.e] 2024-05-14T09:39:33.407 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAxMUNm3e0pKRAAbiPBjXOjnZNl6jZFeP24jQ== 2024-05-14T09:39:33.407 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2024-05-14T09:39:33.407 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQA2MUNmHhF9ExAA33WEoBgwARGN4O7qiyl5vA== 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQA5MUNm2qMFJRAAN9kwH2oGrTnMsfF2+WRmFw== 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQA9MUNm72u9BhAANbbznznGJnG7qos7aiyheQ== 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBAMUNmEx2cFhAAC0ayA+r3BYtLILP+AMKZ0Q== 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAwMUNm9UzhLxAAZnVRG2hXY1HYaGLkDzHO1A== 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAyMUNmBN0NABAAvGG5FaHhX2fYmw6GPinsAg== 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAyMUNm7mzJERAApxKa5BgPp6QTXopjWVEQ2Q== 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.f] 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAyMUNmZKhyJBAAVgGlYh4vosrTbPRpbZcLUg== 2024-05-14T09:39:33.408 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2024-05-14T09:39:33.409 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBGMUNmz+AYKxAAZ19jPUnWvTcf5XR2D1V3qg== 2024-05-14T09:39:33.409 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2024-05-14T09:39:33.409 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBKMUNmWsmnABAA0Wi59ZefLnmf0csCneYvHw== 2024-05-14T09:39:33.409 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2024-05-14T09:39:33.409 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBNMUNmYEYhERAAO/hn1y3cSDtnNfxd8yG/Xw== 2024-05-14T09:39:33.409 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2024-05-14T09:39:33.409 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBQMUNmuPduIBAAlXmKamC3PwrC9WHxK6oOfA== 2024-05-14T09:39:33.409 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2024-05-14T09:39:33.409 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAyMUNmogbfNRAAaSDnHQ9PX4udwV9spqAhmw== 2024-05-14T09:39:33.414 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2024-05-14T09:39:33.414 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAwMUNmJo1pIBAApByd3RQ434uV8HX/nFSQwQ== 2024-05-14T09:39:33.414 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-05-14T09:39:33.414 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAxMUNm4IC5AhAAvvCFkL52do9aCJBNTOfPAQ== 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAxMUNmfBubFRAATgxcRCVFKDayVSCbC8Bn7w== 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.e] 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAxMUNm3e0pKRAAbiPBjXOjnZNl6jZFeP24jQ== 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQA2MUNmHhF9ExAA33WEoBgwARGN4O7qiyl5vA== 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQA5MUNm2qMFJRAAN9kwH2oGrTnMsfF2+WRmFw== 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQA9MUNm72u9BhAANbbznznGJnG7qos7aiyheQ== 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBAMUNmEx2cFhAAC0ayA+r3BYtLILP+AMKZ0Q== 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAwMUNm9UzhLxAAZnVRG2hXY1HYaGLkDzHO1A== 2024-05-14T09:39:33.415 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAyMUNmBN0NABAAvGG5FaHhX2fYmw6GPinsAg== 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAyMUNm7mzJERAApxKa5BgPp6QTXopjWVEQ2Q== 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.f] 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAyMUNmZKhyJBAAVgGlYh4vosrTbPRpbZcLUg== 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBGMUNmz+AYKxAAZ19jPUnWvTcf5XR2D1V3qg== 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBKMUNmWsmnABAA0Wi59ZefLnmf0csCneYvHw== 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBNMUNmYEYhERAAO/hn1y3cSDtnNfxd8yG/Xw== 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQBQMUNmuPduIBAAlXmKamC3PwrC9WHxK6oOfA== 2024-05-14T09:39:33.416 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2024-05-14T09:39:33.417 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAyMUNmogbfNRAAaSDnHQ9PX4udwV9spqAhmw== 2024-05-14T09:39:33.418 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T09:39:33.458 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T09:39:33.664 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:33.672 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:33.881 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:33.886 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:34.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:34.101 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:34.307 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:34.312 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:34.524 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:34.531 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:34.740 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:34.746 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:34.957 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:34.963 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:35.167 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T09:39:35.174 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T09:39:35.379 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:35.384 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:35.593 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:35.598 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:35.803 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:35.810 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T09:39:36.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:36.025 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:36.235 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:36.241 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:36.444 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:36.450 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:36.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:36.665 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T09:39:36.877 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T09:39:36.882 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T09:39:37.091 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-14T09:39:37.091 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-14T09:39:37.175 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T09:39:37.395 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-14T09:39:37.476 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-14T09:39:37.565 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T09:39:37.791 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-14T09:39:37.865 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-14T09:39:37.941 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T09:39:38.163 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-14T09:39:38.242 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:39:38.249 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-14T09:39:38.301 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-14T09:39:38.301 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-14T09:39:38.301 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-14T09:39:38.301 DEBUG:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-05-14T09:39:38.306 INFO:tasks.ceph.mon.a:Started 2024-05-14T09:39:38.307 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-14T09:39:38.307 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-14T09:39:38.307 DEBUG:teuthology.orchestra.run.smithi196:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-05-14T09:39:38.312 INFO:tasks.ceph.mon.b:Started 2024-05-14T09:39:38.312 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-14T09:39:38.312 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-14T09:39:38.313 DEBUG:teuthology.orchestra.run.smithi196:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-05-14T09:39:38.317 INFO:tasks.ceph.mon.c:Started 2024-05-14T09:39:38.318 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-14T09:39:38.318 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-14T09:39:38.318 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-05-14T09:39:38.323 INFO:tasks.ceph.mgr.y:Started 2024-05-14T09:39:38.323 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-14T09:39:38.323 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-05-14T09:39:38.328 INFO:tasks.ceph.mgr.x:Started 2024-05-14T09:39:38.328 INFO:tasks.ceph:Setting crush tunables to default 2024-05-14T09:39:38.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd crush tunables default 2024-05-14T09:39:38.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.566+0000 7f0581a00640 1 Processor -- start 2024-05-14T09:39:38.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.566+0000 7f0581a00640 1 -- start start 2024-05-14T09:39:38.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.569+0000 7f0581a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f057c152ed0 0x7f057c1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:38.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.569+0000 7f0581a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c15cd20 0x7f057c0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:38.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.569+0000 7f0581a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057c0c5900 con 0x7f057c0c60a0 2024-05-14T09:39:38.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.569+0000 7f0581a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f057c15a510 con 0x7f057c152ed0 2024-05-14T09:39:38.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.569+0000 7f0581a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f057c06c6f0 con 0x7f057c15cd20 2024-05-14T09:39:38.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.569+0000 7f057aa00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f057c152ed0 msgr2=0x7f057c1532e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-05-14T09:39:38.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.569+0000 7f057b400640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c15cd20 msgr2=0x7f057c0c64b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-05-14T09:39:38.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.569+0000 7f057aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f057c152ed0 0x7f057c1532e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:39:38.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.569+0000 7f057b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c15cd20 0x7f057c0c64b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:39:38.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.570+0000 7f057a000640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f057c0c60a0 legacy=0x7f057c15c610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-05-14T09:39:38.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.770+0000 7f057aa00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f057c152ed0 msgr2=0x7f057c1532e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-05-14T09:39:38.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.770+0000 7f057aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f057c152ed0 0x7f057c1532e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:39:38.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.770+0000 7f057b400640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c15cd20 msgr2=0x7f057c0c64b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-05-14T09:39:38.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.770+0000 7f057b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c15cd20 0x7f057c0c64b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:39:38.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:38.771+0000 7f057a000640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f057c0c60a0 legacy=0x7f057c15c610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-05-14T09:39:39.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:39.171+0000 7f057b400640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c15cd20 msgr2=0x7f057c0c64b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-05-14T09:39:39.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:39.171+0000 7f057aa00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f057c152ed0 msgr2=0x7f057c1532e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-05-14T09:39:39.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:39.171+0000 7f057aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f057c152ed0 0x7f057c1532e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T09:39:39.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:39.171+0000 7f057b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c15cd20 0x7f057c0c64b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T09:39:39.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:39.172+0000 7f057a000640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f057c0c60a0 legacy=0x7f057c15c610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-05-14T09:39:39.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:39.972+0000 7f057b400640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c15cd20 msgr2=0x7f057c0c64b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-05-14T09:39:39.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:39.972+0000 7f057aa00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f057c152ed0 msgr2=0x7f057c1532e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-05-14T09:39:39.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:39.972+0000 7f057b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c15cd20 0x7f057c0c64b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T09:39:39.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:39.972+0000 7f057aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f057c152ed0 0x7f057c1532e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T09:39:39.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:39.973+0000 7f057a000640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f057c0c60a0 legacy=0x7f057c15c610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-05-14T09:39:41.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.569+0000 7f0573e00640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c15cd20 msgr2=0x7f057c0c64b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:41.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.569+0000 7f0573e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c15cd20 0x7f057c0c64b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:41.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.569+0000 7f0573e00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f057c152ed0 msgr2=0x7f057c1532e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:41.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.569+0000 7f0573e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f057c152ed0 0x7f057c1532e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:41.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.569+0000 7f0573e00640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f057c0c60a0 legacy=0x7f057c15c610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:41.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.570+0000 7f0573e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c007450 0x7f055c009960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:41.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.570+0000 7f0573e00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057c15d290 con 0x7f055c0036c0 2024-05-14T09:39:41.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.570+0000 7f0573e00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f057c06c6f0 con 0x7f055c007450 2024-05-14T09:39:41.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.570+0000 7f057aa00640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7f055c0036c0 legacy=0x7f055c005b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.135:6789/0 2024-05-14T09:39:41.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.570+0000 7f057a000640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f055c007450 msgr2=0x7f055c009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-05-14T09:39:41.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.570+0000 7f057a000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c007450 0x7f055c009960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:39:41.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.771+0000 7f057aa00640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7f055c0036c0 legacy=0x7f055c005b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.135:6789/0 2024-05-14T09:39:41.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.771+0000 7f057a000640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f055c007450 msgr2=0x7f055c009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-05-14T09:39:41.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:41.771+0000 7f057a000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c007450 0x7f055c009960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:39:42.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:42.172+0000 7f057aa00640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7f055c0036c0 legacy=0x7f055c005b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.135:6789/0 2024-05-14T09:39:42.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:42.172+0000 7f057a000640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f055c007450 msgr2=0x7f055c009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-05-14T09:39:42.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:42.172+0000 7f057a000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c007450 0x7f055c009960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T09:39:42.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:42.973+0000 7f057aa00640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7f055c0036c0 legacy=0x7f055c005b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.135:6789/0 2024-05-14T09:39:42.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:42.973+0000 7f057a000640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f055c007450 msgr2=0x7f055c009960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-05-14T09:39:42.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:42.973+0000 7f057a000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c007450 0x7f055c009960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T09:39:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.570+0000 7f0573e00640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f055c007450 msgr2=0x7f055c009960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.570+0000 7f0573e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c007450 0x7f055c009960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.570+0000 7f0573e00640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7f055c0036c0 legacy=0x7f055c005b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.570+0000 7f057b400640 1 -- reap_dead start 2024-05-14T09:39:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.570+0000 7f0573e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c009a50 0x7f055c00e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.570+0000 7f0573e00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055c00b080 con 0x7f055c00a010 2024-05-14T09:39:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.570+0000 7f0573e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f057c15d290 con 0x7f055c00ab90 2024-05-14T09:39:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.570+0000 7f0573e00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f057c06c6f0 con 0x7f055c009a50 2024-05-14T09:39:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.570+0000 7f057aa00640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7f055c00a010 legacy=0x7f055c00a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.135:6789/0 2024-05-14T09:39:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.570+0000 7f057b400640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f055c009a50 msgr2=0x7f055c00e410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-05-14T09:39:44.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.570+0000 7f057a000640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f055c00ab90 legacy=0x7f055c006af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-05-14T09:39:44.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.571+0000 7f057b400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c009a50 0x7f055c00e410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:39:44.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.771+0000 7f057aa00640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7f055c00a010 legacy=0x7f055c00a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.135:6789/0 2024-05-14T09:39:44.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.772+0000 7f057b400640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f055c009a50 msgr2=0x7f055c00e410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-05-14T09:39:44.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.772+0000 7f057a000640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f055c00ab90 legacy=0x7f055c006af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-05-14T09:39:44.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:44.772+0000 7f057b400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c009a50 0x7f055c00e410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:39:45.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:45.172+0000 7f057aa00640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7f055c00a010 legacy=0x7f055c00a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.135:6789/0 2024-05-14T09:39:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:45.173+0000 7f057b400640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f055c009a50 msgr2=0x7f055c00e410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-05-14T09:39:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:45.173+0000 7f057a000640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f055c00ab90 legacy=0x7f055c006af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-05-14T09:39:45.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:45.173+0000 7f057b400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c009a50 0x7f055c00e410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T09:39:45.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:45.973+0000 7f057aa00640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7f055c00a010 legacy=0x7f055c00a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.135:6789/0 2024-05-14T09:39:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:45.974+0000 7f057a000640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f055c00ab90 legacy=0x7f055c006af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.196:6789/0 2024-05-14T09:39:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:45.974+0000 7f057b400640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f055c009a50 msgr2=0x7f055c00e410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.135:3300/0 2024-05-14T09:39:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:45.974+0000 7f057b400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c009a50 0x7f055c00e410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T09:39:46.371 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:00:07.837 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:39:46.467 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:00:07.944 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:39:46.473 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:00:07.952 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:39:46.707 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:00:08.173 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:39:46.805 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:00:08.282 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:39:46.810 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:00:08.289 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:39:47.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.570+0000 7f0573e00640 1 -- >> v2:172.21.15.135:3300/0 conn(0x7f055c009a50 msgr2=0x7f055c00e410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.570+0000 7f0573e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f055c009a50 0x7f055c00e410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.570+0000 7f0573e00640 1 -- >> v1:172.21.15.196:6789/0 conn(0x7f055c00ab90 legacy=0x7f055c006af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.570+0000 7f0573e00640 1 -- >> v1:172.21.15.135:6789/0 conn(0x7f055c00a010 legacy=0x7f055c00a420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.571+0000 7f0573e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 0x7f055c00efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.571+0000 7f0573e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.571+0000 7f0573e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f057c06c6f0 con 0x7f055c00ebc0 2024-05-14T09:39:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.571+0000 7f0573e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f055c0100e0 con 0x7f055c00f640 2024-05-14T09:39:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.571+0000 7f057aa00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 msgr2=0x7f055c00efd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-05-14T09:39:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.571+0000 7f057a000640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-05-14T09:39:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.571+0000 7f057aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 0x7f055c00efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:39:47.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.571+0000 7f057a000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:39:47.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.772+0000 7f057aa00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 msgr2=0x7f055c00efd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-05-14T09:39:47.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.772+0000 7f057a000640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-05-14T09:39:47.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.772+0000 7f057aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 0x7f055c00efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:39:47.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:47.772+0000 7f057a000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:39:48.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:48.174+0000 7f057a000640 1 -- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3301/0 2024-05-14T09:39:48.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:48.174+0000 7f057aa00640 1 -- >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 msgr2=0x7f055c00efd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.196:3300/0 2024-05-14T09:39:48.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:48.174+0000 7f057a000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T09:39:48.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:48.174+0000 7f057aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 0x7f055c00efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T09:39:49.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.096+0000 7f057aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 0x7f055c00efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:49.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.100+0000 7f057aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 0x7f055c00efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:41116/0 (socket says 172.21.15.135:41116) 2024-05-14T09:39:49.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.100+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 learned_addr learned my addr 172.21.15.135:0/2762782308 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:39:49.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.127+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:49.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.135+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 msgr2=0x7f055c00efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-14T09:39:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.135+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 msgr2=0x7f055c00efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.135+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 0x7f055c00efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:49.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.135+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 0x7f055c00efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T09:39:49.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.258+0000 7f057a000640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T09:39:49.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.258+0000 7f057a000640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:49.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.258+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:49.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:49.258+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T09:39:50.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.572+0000 7f0573e00640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:50.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.572+0000 7f0573e00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.572+0000 7f0573e00640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 msgr2=0x7f055c00efd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:50.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.572+0000 7f0573e00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00ebc0 0x7f055c00efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:50.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.572+0000 7f0573e00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:50.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.572+0000 7f057b400640 1 -- 172.21.15.135:0/2762782308 reap_dead start 2024-05-14T09:39:50.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.572+0000 7f0573e00640 1 -- 172.21.15.135:0/2762782308 --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055c010b90 con 0x7f055c00a010 2024-05-14T09:39:50.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.572+0000 7f0573e00640 1 -- 172.21.15.135:0/2762782308 --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055c00b080 con 0x7f055c00ab90 2024-05-14T09:39:50.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.572+0000 7f0573e00640 1 -- 172.21.15.135:0/2762782308 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f057c06c6f0 con 0x7f055c00f640 2024-05-14T09:39:50.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.574+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.576+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T09:39:50.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.576+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:50.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.576+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:50.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.576+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:39:50.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.779+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:50.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.782+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T09:39:50.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.782+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:50.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.782+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:50.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:50.783+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:39:51.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:51.186+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:51.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:51.189+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T09:39:51.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:51.189+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:51.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:51.189+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:51.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:51.189+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T09:39:51.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:51.992+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:51.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:51.997+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T09:39:51.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:51.997+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:51.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:51.997+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:51.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:51.997+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T09:39:52.701 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:39:52.709 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:39:53.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.572+0000 7f0573e00640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 msgr2=0x7f055c00fa50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:53.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.572+0000 7f0573e00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f055c00f640 0x7f055c00fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:53.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.572+0000 7f0573e00640 1 -- 172.21.15.135:0/2762782308 >> v1:172.21.15.196:6789/0 conn(0x7f055c00ab90 legacy=0x7f055c006af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:53.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.573+0000 7f0573e00640 1 -- 172.21.15.135:0/2762782308 >> v1:172.21.15.135:6789/0 conn(0x7f055c00a010 legacy=0x7f055c00a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:53.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.573+0000 7f0573e00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:53.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.573+0000 7f0573e00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:53.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.573+0000 7f0573e00640 1 -- 172.21.15.135:0/2762782308 --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f057c06c6f0 con 0x7f055c00c400 2024-05-14T09:39:53.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.573+0000 7f0573e00640 1 -- 172.21.15.135:0/2762782308 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f055c0100e0 con 0x7f055c00f0f0 2024-05-14T09:39:53.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.617+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:53.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.622+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 msgr2=0x7f055c010310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T09:39:53.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.622+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 msgr2=0x7f055c010310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:53.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.622+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:53.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.623+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:39:53.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.674+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:53.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.696+0000 7f057a000640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 msgr2=0x7f055c017030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-14T09:39:53.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.696+0000 7f057a000640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 msgr2=0x7f055c017030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:53.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.696+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:53.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.696+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T09:39:53.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.826+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:53.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.829+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 msgr2=0x7f055c010310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T09:39:53.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.829+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 msgr2=0x7f055c010310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:53.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.829+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:53.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.829+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:39:53.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.904+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:53.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.908+0000 7f057a000640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 msgr2=0x7f055c017030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T09:39:53.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.908+0000 7f057a000640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 msgr2=0x7f055c017030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:53.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.908+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:53.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:53.909+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T09:39:54.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:54.245+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:54.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:54.257+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 msgr2=0x7f055c010310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T09:39:54.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:54.257+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 msgr2=0x7f055c010310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:54.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:54.257+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:54.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:54.257+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T09:39:54.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:54.660+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:54.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:54.798+0000 7f057a000640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 msgr2=0x7f055c017030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T09:39:54.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:54.798+0000 7f057a000640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 msgr2=0x7f055c017030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:54.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:54.798+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:54.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:54.798+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T09:39:55.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.059+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:55.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.070+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 msgr2=0x7f055c010310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-14T09:39:55.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.070+0000 7f057aa00640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 msgr2=0x7f055c010310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T09:39:55.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.070+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T09:39:55.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.070+0000 7f057aa00640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T09:39:55.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.651+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.135:3300/0 conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:55.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.724+0000 7f057a000640 1 -- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 msgr2=0x7f055c010310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T09:39:55.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.724+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> v2:172.21.15.196:3300/0 conn(0x7f055c00f0f0 0x7f055c010310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:55.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.724+0000 7f057a000640 1 -- 172.21.15.135:0/2762782308 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c15d290 con 0x7f055c00c400 2024-05-14T09:39:55.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.752+0000 7f057a000640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c00c400 0x7f055c017030 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f055c009fe0 tx=0x7f056802b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7577b07637af34 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:55.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.963+0000 7f0579600640 1 -- 172.21.15.135:0/2762782308 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568031070 con 0x7f055c00c400 2024-05-14T09:39:55.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.964+0000 7f0579600640 1 -- 172.21.15.135:0/2762782308 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f056802bb90 con 0x7f055c00c400 2024-05-14T09:39:55.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.964+0000 7f0579600640 1 -- 172.21.15.135:0/2762782308 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568035400 con 0x7f055c00c400 2024-05-14T09:39:55.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.965+0000 7f0581a00640 1 -- 172.21.15.135:0/2762782308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c00c400 msgr2=0x7f055c017030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:55.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.965+0000 7f0581a00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c00c400 0x7f055c017030 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f055c009fe0 tx=0x7f056802b090 comp rx=0 tx=0).stop 2024-05-14T09:39:55.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.965+0000 7f057b400640 1 -- 172.21.15.135:0/2762782308 reap_dead start 2024-05-14T09:39:55.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.965+0000 7f0581a00640 1 -- 172.21.15.135:0/2762782308 shutdown_connections 2024-05-14T09:39:55.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.965+0000 7f0581a00640 1 --2- 172.21.15.135:0/2762782308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c00c400 0x7f055c017030 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:55.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.965+0000 7f0581a00640 1 -- 172.21.15.135:0/2762782308 >> 172.21.15.135:0/2762782308 conn(0x7f057c073d40 msgr2=0x7f057c074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:55.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.966+0000 7f0581a00640 1 -- 172.21.15.135:0/2762782308 shutdown_connections 2024-05-14T09:39:55.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.966+0000 7f0581a00640 1 -- 172.21.15.135:0/2762782308 wait complete. 2024-05-14T09:39:55.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.972+0000 7f0581a00640 1 Processor -- start 2024-05-14T09:39:55.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.972+0000 7f0581a00640 1 -- start start 2024-05-14T09:39:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.976+0000 7f0581a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f055c00c400 0x7f057c1e2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.976+0000 7f0581a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c1f1db0 0x7f057c0c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.976+0000 7f0581a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f057c155810 0x7f057c0c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.977+0000 7f0581a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f057c06cc20 con 0x7f057c155810 2024-05-14T09:39:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.977+0000 7f0581a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f057c0c5c10 con 0x7f055c00c400 2024-05-14T09:39:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.977+0000 7f0581a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f057c0c4a60 con 0x7f057c1f1db0 2024-05-14T09:39:55.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.983+0000 7f057a000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c1f1db0 0x7f057c0c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:55.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.984+0000 7f057a000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c1f1db0 0x7f057c0c4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:47426/0 (socket says 172.21.15.135:47426) 2024-05-14T09:39:55.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.984+0000 7f057a000640 1 -- 172.21.15.135:0/3654674165 learned_addr learned my addr 172.21.15.135:0/3654674165 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:39:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.989+0000 7f057b400640 1 --2- 172.21.15.135:0/3654674165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f057c155810 0x7f057c0c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.989+0000 7f057a000640 1 -- 172.21.15.135:0/3654674165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f055c00c400 msgr2=0x7f057c1e2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.989+0000 7f057a000640 1 --2- 172.21.15.135:0/3654674165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f055c00c400 0x7f057c1e2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.989+0000 7f057a000640 1 -- 172.21.15.135:0/3654674165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f057c155810 msgr2=0x7f057c0c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.989+0000 7f057a000640 1 --2- 172.21.15.135:0/3654674165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f057c155810 0x7f057c0c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.989+0000 7f057a000640 1 -- 172.21.15.135:0/3654674165 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c1549d0 con 0x7f057c1f1db0 2024-05-14T09:39:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.989+0000 7f057b400640 1 --2- 172.21.15.135:0/3654674165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f057c155810 0x7f057c0c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T09:39:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:55.994+0000 7f057a000640 1 --2- 172.21.15.135:0/3654674165 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c1f1db0 0x7f057c0c4cd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0568009470 tx=0x7f0568003ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:56.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:56.019+0000 7f0572a00640 1 -- 172.21.15.135:0/3654674165 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568044070 con 0x7f057c1f1db0 2024-05-14T09:39:56.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:56.019+0000 7f0581a00640 1 -- 172.21.15.135:0/3654674165 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057c156180 con 0x7f057c1f1db0 2024-05-14T09:39:56.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:56.019+0000 7f0581a00640 1 -- 172.21.15.135:0/3654674165 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f057c156440 con 0x7f057c1f1db0 2024-05-14T09:39:56.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:56.020+0000 7f0581a00640 1 -- 172.21.15.135:0/3654674165 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057c069a60 con 0x7f057c1f1db0 2024-05-14T09:39:56.159 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:56.158+0000 7fd48fe1f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T09:39:56.284 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:56.283+0000 7f1e7d523040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T09:39:56.346 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:56.346+0000 7fd48fe1f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:39:56.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:56.371+0000 7f0572a00640 1 -- 172.21.15.135:0/3654674165 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f056802bb90 con 0x7f057c1f1db0 2024-05-14T09:39:56.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:56.371+0000 7f0572a00640 1 -- 172.21.15.135:0/3654674165 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056804e060 con 0x7f057c1f1db0 2024-05-14T09:39:56.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:56.382+0000 7f0572a00640 1 -- 172.21.15.135:0/3654674165 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0568047070 con 0x7f057c1f1db0 2024-05-14T09:39:56.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:56.382+0000 7f0572a00640 1 -- 172.21.15.135:0/3654674165 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f05680496f0 con 0x7f057c1f1db0 2024-05-14T09:39:56.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:56.383+0000 7f0572a00640 1 -- 172.21.15.135:0/3654674165 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0568053430 con 0x7f057c1f1db0 2024-05-14T09:39:56.410 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:56.410+0000 7fd48fe1f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T09:39:56.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:56.474+0000 7f0581a00640 1 -- 172.21.15.135:0/3654674165 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f057c073b20 con 0x7f057c1f1db0 2024-05-14T09:39:56.528 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:56.527+0000 7f1e7d523040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:39:56.597 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:56.596+0000 7f1e7d523040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T09:39:56.700 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:56.700+0000 7fd48fe1f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T09:39:56.757 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:56.756+0000 7fd48fe1f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T09:39:56.928 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:56.927+0000 7f1e7d523040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T09:39:56.986 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:56.986+0000 7f1e7d523040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T09:39:57.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:57.294+0000 7f0572a00640 1 -- 172.21.15.135:0/3654674165 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f05680409e0 con 0x7f057c1f1db0 2024-05-14T09:39:57.294 INFO:teuthology.orchestra.run.smithi135.stderr:adjusted tunables profile to default 2024-05-14T09:39:57.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:57.295+0000 7f0581a00640 1 -- 172.21.15.135:0/3654674165 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c1f1db0 msgr2=0x7f057c0c4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:57.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:57.295+0000 7f0581a00640 1 --2- 172.21.15.135:0/3654674165 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c1f1db0 0x7f057c0c4cd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0568009470 tx=0x7f0568003ab0 comp rx=0 tx=0).stop 2024-05-14T09:39:57.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:57.295+0000 7f0581a00640 1 -- 172.21.15.135:0/3654674165 shutdown_connections 2024-05-14T09:39:57.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:57.295+0000 7f0581a00640 1 --2- 172.21.15.135:0/3654674165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f057c155810 0x7f057c0c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:57.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:57.295+0000 7f0581a00640 1 --2- 172.21.15.135:0/3654674165 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f057c1f1db0 0x7f057c0c4cd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:57.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:57.295+0000 7f0581a00640 1 --2- 172.21.15.135:0/3654674165 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f055c00c400 0x7f057c1e2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:57.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:57.295+0000 7f0581a00640 1 -- 172.21.15.135:0/3654674165 >> 172.21.15.135:0/3654674165 conn(0x7f057c073d40 msgr2=0x7f057c15b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:57.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:57.295+0000 7f0581a00640 1 -- 172.21.15.135:0/3654674165 shutdown_connections 2024-05-14T09:39:57.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:39:57.295+0000 7f0581a00640 1 -- 172.21.15.135:0/3654674165 wait complete. 2024-05-14T09:39:57.328 INFO:tasks.ceph:check_enable_crimson: False 2024-05-14T09:39:57.328 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-14T09:39:57.328 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:57.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-14T09:39:57.393 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:57.393 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-14T09:39:57.511 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:57.512 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-14T09:39:57.582 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:39:57.583 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-14T09:39:57.716 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:57.717 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-14T09:39:57.728 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:57.728+0000 7fd48fe1f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T09:39:57.786 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:57.787 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-14T09:39:57.842 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:57.842+0000 7fd48fe1f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T09:39:57.898 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:57.897+0000 7fd48fe1f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T09:39:57.901 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:57.901 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-14T09:39:58.015 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-14T09:39:58.015 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-14T09:39:58.037 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:58.038+0000 7f1e7d523040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T09:39:58.097 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:58.097+0000 7fd48fe1f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T09:39:58.108 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f 0 2024-05-14T09:39:58.146 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:58.146+0000 7f1e7d523040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T09:39:58.155 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:58.155+0000 7fd48fe1f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T09:39:58.210 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:58.211+0000 7f1e7d523040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T09:39:58.216 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:58.216+0000 7fd48fe1f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T09:39:58.344 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:58.344+0000 7fd48fe1f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:39:58.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.406+0000 7f90b9800640 1 Processor -- start 2024-05-14T09:39:58.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.406+0000 7f90b9800640 1 -- start start 2024-05-14T09:39:58.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.408+0000 7f90b9800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f90b4156460 0x7f90b415f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:58.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.408+0000 7f90b9800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:58.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.408+0000 7f90b9800640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b40cd830 con 0x7f90b40ccad0 2024-05-14T09:39:58.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.408+0000 7f90b9800640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f90b406e010 con 0x7f90b4156460 2024-05-14T09:39:58.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.408+0000 7f90b9800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f90b406d470 con 0x7f90b415fce0 2024-05-14T09:39:58.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.409+0000 7f90b8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:58.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.409+0000 7f90b8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:58808/0 (socket says 172.21.15.196:58808) 2024-05-14T09:39:58.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.409+0000 7f90b8e00640 1 -- 172.21.15.196:0/747284187 learned_addr learned my addr 172.21.15.196:0/747284187 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:39:58.412 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:58.412+0000 7f1e7d523040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T09:39:58.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.412+0000 7f90b8e00640 1 -- 172.21.15.196:0/747284187 >> v2:172.21.15.135:3300/0 conn(0x7f90b4156460 msgr2=0x7f90b415f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:58.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.412+0000 7f90b8e00640 1 --2- 172.21.15.196:0/747284187 >> v2:172.21.15.135:3300/0 conn(0x7f90b4156460 0x7f90b415f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:58.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.412+0000 7f90b8e00640 1 -- 172.21.15.196:0/747284187 >> v1:172.21.15.135:6789/0 conn(0x7f90b40ccad0 legacy=0x7f90b406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:39:58.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.412+0000 7f90b8e00640 1 -- 172.21.15.196:0/747284187 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b4156870 con 0x7f90b415fce0 2024-05-14T09:39:58.414 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.415+0000 7f90b8e00640 1 --2- 172.21.15.196:0/747284187 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41600f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f90b40cf100 tx=0x7f90ac02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee2a4c27fd3641ff server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:58.422 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.423+0000 7f90b2a00640 1 -- 172.21.15.196:0/747284187 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac036070 con 0x7f90b415fce0 2024-05-14T09:39:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.423+0000 7f90b2a00640 1 -- 172.21.15.196:0/747284187 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90ac031600 con 0x7f90b415fce0 2024-05-14T09:39:58.423 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.423+0000 7f90b2a00640 1 -- 172.21.15.196:0/747284187 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac0319d0 con 0x7f90b415fce0 2024-05-14T09:39:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.424+0000 7f90b9800640 1 -- 172.21.15.196:0/747284187 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 msgr2=0x7f90b41600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.424+0000 7f90b9800640 1 --2- 172.21.15.196:0/747284187 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41600f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f90b40cf100 tx=0x7f90ac02a710 comp rx=0 tx=0).stop 2024-05-14T09:39:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.424+0000 7f90b9800640 1 -- 172.21.15.196:0/747284187 shutdown_connections 2024-05-14T09:39:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.424+0000 7f90b9800640 1 --2- 172.21.15.196:0/747284187 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41600f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.424+0000 7f90b9800640 1 --2- 172.21.15.196:0/747284187 >> v2:172.21.15.135:3300/0 conn(0x7f90b4156460 0x7f90b415f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.424+0000 7f90b9800640 1 -- 172.21.15.196:0/747284187 >> 172.21.15.196:0/747284187 conn(0x7f90b408e100 msgr2=0x7f90b40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.424+0000 7f90b9800640 1 -- 172.21.15.196:0/747284187 shutdown_connections 2024-05-14T09:39:58.424 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.424+0000 7f90b9800640 1 -- 172.21.15.196:0/747284187 wait complete. 2024-05-14T09:39:58.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.426+0000 7f90b9800640 1 Processor -- start 2024-05-14T09:39:58.426 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.427+0000 7f90b9800640 1 -- start start 2024-05-14T09:39:58.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.428+0000 7f90b9800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90b40ccad0 0x7f90b41f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:58.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.428+0000 7f90b9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90b4156460 0x7f90b40cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:58.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.428+0000 7f90b9800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41e61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:58.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.428+0000 7f90b9800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90b40cddb0 con 0x7f90b4156460 2024-05-14T09:39:58.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.428+0000 7f90b9800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f90b40cdad0 con 0x7f90b40ccad0 2024-05-14T09:39:58.428 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.428+0000 7f90b9800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f90b406d100 con 0x7f90b415fce0 2024-05-14T09:39:58.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.429+0000 7f90b8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41e61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:58.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.429+0000 7f90b3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90b40ccad0 0x7f90b41f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:58.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.429+0000 7f90b8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41e61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:58810/0 (socket says 172.21.15.196:58810) 2024-05-14T09:39:58.429 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.429+0000 7f90b8e00640 1 -- 172.21.15.196:0/1727123149 learned_addr learned my addr 172.21.15.196:0/1727123149 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:39:58.433 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.434+0000 7f90b8e00640 1 -- 172.21.15.196:0/1727123149 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90b40ccad0 msgr2=0x7f90b41f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.434+0000 7f90b8e00640 1 --2- 172.21.15.196:0/1727123149 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90b40ccad0 0x7f90b41f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.434+0000 7f90b8e00640 1 -- 172.21.15.196:0/1727123149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90b4156460 msgr2=0x7f90b40cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.434+0000 7f90b8e00640 1 --2- 172.21.15.196:0/1727123149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90b4156460 0x7f90b40cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:58.434 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.434+0000 7f90b8e00640 1 -- 172.21.15.196:0/1727123149 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b41f66b0 con 0x7f90b415fce0 2024-05-14T09:39:58.436 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.436+0000 7f90b8e00640 1 --2- 172.21.15.196:0/1727123149 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41e61d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f90ac034040 tx=0x7f90ac004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:58.440 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.441+0000 7f90abe00640 1 -- 172.21.15.196:0/1727123149 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac041070 con 0x7f90b415fce0 2024-05-14T09:39:58.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.441+0000 7f90abe00640 1 -- 172.21.15.196:0/1727123149 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90ac03c850 con 0x7f90b415fce0 2024-05-14T09:39:58.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.441+0000 7f90abe00640 1 -- 172.21.15.196:0/1727123149 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac036040 con 0x7f90b415fce0 2024-05-14T09:39:58.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.441+0000 7f90b9800640 1 -- 172.21.15.196:0/1727123149 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b415e350 con 0x7f90b415fce0 2024-05-14T09:39:58.441 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.441+0000 7f90b9800640 1 -- 172.21.15.196:0/1727123149 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b41f5c50 con 0x7f90b415fce0 2024-05-14T09:39:58.442 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.442+0000 7f90b9800640 1 -- 172.21.15.196:0/1727123149 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b415eb90 con 0x7f90b415fce0 2024-05-14T09:39:58.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.446+0000 7f90abe00640 1 -- 172.21.15.196:0/1727123149 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f90ac044070 con 0x7f90b415fce0 2024-05-14T09:39:58.445 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.446+0000 7f90abe00640 1 -- 172.21.15.196:0/1727123149 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f90ac050a80 con 0x7f90b415fce0 2024-05-14T09:39:58.491 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:58.492+0000 7f1e7d523040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T09:39:58.555 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:58.555+0000 7f1e7d523040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T09:39:58.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.591+0000 7f90abe00640 1 -- 172.21.15.196:0/1727123149 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f90ac0314c0 con 0x7f90b415fce0 2024-05-14T09:39:58.677 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:58.677+0000 7f90b9800640 1 -- 172.21.15.196:0/1727123149 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f", "id": 0} v 0) -- 0x7f90b4076290 con 0x7f90b415fce0 2024-05-14T09:39:58.689 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:58.689+0000 7f1e7d523040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T09:39:58.808 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:58.807+0000 7fd48fe1f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T09:39:58.969 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:58.969+0000 7fd48fe1f040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T09:39:59.070 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.070+0000 7f90abe00640 1 -- 172.21.15.196:0/1727123149 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f90ac055020 con 0x7f90b415fce0 2024-05-14T09:39:59.070 INFO:teuthology.orchestra.run.smithi196.stdout:0 2024-05-14T09:39:59.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.071+0000 7f90b9800640 1 -- 172.21.15.196:0/1727123149 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 msgr2=0x7f90b41e61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:59.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.071+0000 7f90b9800640 1 --2- 172.21.15.196:0/1727123149 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41e61d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f90ac034040 tx=0x7f90ac004a40 comp rx=0 tx=0).stop 2024-05-14T09:39:59.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.071+0000 7f90b9800640 1 -- 172.21.15.196:0/1727123149 shutdown_connections 2024-05-14T09:39:59.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.071+0000 7f90b9800640 1 --2- 172.21.15.196:0/1727123149 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f90b415fce0 0x7f90b41e61d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:59.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.071+0000 7f90b9800640 1 --2- 172.21.15.196:0/1727123149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90b4156460 0x7f90b40cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:59.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.071+0000 7f90b9800640 1 --2- 172.21.15.196:0/1727123149 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f90b40ccad0 0x7f90b41f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:59.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.071+0000 7f90b9800640 1 -- 172.21.15.196:0/1727123149 >> 172.21.15.196:0/1727123149 conn(0x7f90b408e100 msgr2=0x7f90b4153180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:59.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.072+0000 7f90b9800640 1 -- 172.21.15.196:0/1727123149 shutdown_connections 2024-05-14T09:39:59.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.072+0000 7f90b9800640 1 -- 172.21.15.196:0/1727123149 wait complete. 2024-05-14T09:39:59.096 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 12b12d4a-1242-4630-afc3-14bf24bfb26e 1 2024-05-14T09:39:59.165 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:59.165+0000 7f1e7d523040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T09:39:59.277 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:59.277+0000 7fd48fe1f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T09:39:59.331 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:59.331+0000 7f1e7d523040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T09:39:59.339 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:59.339+0000 7fd48fe1f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T09:39:59.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.346+0000 7f5678a00640 1 Processor -- start 2024-05-14T09:39:59.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.346+0000 7f5678a00640 1 -- start start 2024-05-14T09:39:59.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.348+0000 7f5678a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c65b0 0x7f5674156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:59.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.348+0000 7f5678a00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f567406c940 con 0x7f56740cd940 2024-05-14T09:39:59.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.348+0000 7f5678a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f567406cc20 con 0x7f56740c6c00 2024-05-14T09:39:59.348 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.348+0000 7f5678a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f567406c6f0 con 0x7f56740c65b0 2024-05-14T09:39:59.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.349+0000 7f5672800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c65b0 0x7f5674156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:59.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.350+0000 7f5672800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c65b0 0x7f5674156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:58820/0 (socket says 172.21.15.196:58820) 2024-05-14T09:39:59.349 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.350+0000 7f5672800640 1 -- 172.21.15.196:0/2108152691 learned_addr learned my addr 172.21.15.196:0/2108152691 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:39:59.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.353+0000 7f5672800640 1 -- 172.21.15.196:0/2108152691 >> v1:172.21.15.196:6789/0 conn(0x7f56740c6c00 legacy=0x7f567406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:59.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.353+0000 7f5672800640 1 -- 172.21.15.196:0/2108152691 >> v1:172.21.15.135:6789/0 conn(0x7f56740cd940 legacy=0x7f567415c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:59.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.353+0000 7f5672800640 1 -- 172.21.15.196:0/2108152691 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567406cf00 con 0x7f56740c65b0 2024-05-14T09:39:59.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.355+0000 7f5672800640 1 --2- 172.21.15.196:0/2108152691 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c65b0 0x7f5674156570 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56640098a0 tx=0x7f566402a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11cf10c01b6d6b6b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:59.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.360+0000 7f5671400640 1 -- 172.21.15.196:0/2108152691 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5664037070 con 0x7f56740c65b0 2024-05-14T09:39:59.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.360+0000 7f5671400640 1 -- 172.21.15.196:0/2108152691 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5664032640 con 0x7f56740c65b0 2024-05-14T09:39:59.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.360+0000 7f5671400640 1 -- 172.21.15.196:0/2108152691 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5664032a10 con 0x7f56740c65b0 2024-05-14T09:39:59.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.361+0000 7f5678a00640 1 -- 172.21.15.196:0/2108152691 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c65b0 msgr2=0x7f5674156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:59.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.361+0000 7f5678a00640 1 --2- 172.21.15.196:0/2108152691 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c65b0 0x7f5674156570 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f56640098a0 tx=0x7f566402a2e0 comp rx=0 tx=0).stop 2024-05-14T09:39:59.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.361+0000 7f5678a00640 1 -- 172.21.15.196:0/2108152691 shutdown_connections 2024-05-14T09:39:59.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.361+0000 7f5678a00640 1 --2- 172.21.15.196:0/2108152691 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c65b0 0x7f5674156570 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:59.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.361+0000 7f5678a00640 1 -- 172.21.15.196:0/2108152691 >> 172.21.15.196:0/2108152691 conn(0x7f567408e180 msgr2=0x7f56740d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:39:59.362 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.361+0000 7f5678a00640 1 -- 172.21.15.196:0/2108152691 shutdown_connections 2024-05-14T09:39:59.362 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.362+0000 7f5678a00640 1 -- 172.21.15.196:0/2108152691 wait complete. 2024-05-14T09:39:59.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.365+0000 7f5678a00640 1 Processor -- start 2024-05-14T09:39:59.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.365+0000 7f5678a00640 1 -- start start 2024-05-14T09:39:59.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.367+0000 7f5678a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56740c65b0 0x7f56740d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:59.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.367+0000 7f5678a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c6c00 0x7f56741e5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:59.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.367+0000 7f5678a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56740cd940 0x7f56741ec440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:39:59.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.367+0000 7f5678a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f567415c960 con 0x7f56740c65b0 2024-05-14T09:39:59.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.367+0000 7f5678a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f567406d4c0 con 0x7f56740cd940 2024-05-14T09:39:59.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.367+0000 7f5678a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f567415cae0 con 0x7f56740c6c00 2024-05-14T09:39:59.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.368+0000 7f5671e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c6c00 0x7f56741e5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:59.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.368+0000 7f5673200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56740cd940 0x7f56741ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:59.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.368+0000 7f5671e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c6c00 0x7f56741e5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:58830/0 (socket says 172.21.15.196:58830) 2024-05-14T09:39:59.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.368+0000 7f5671e00640 1 -- 172.21.15.196:0/3834867624 learned_addr learned my addr 172.21.15.196:0/3834867624 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:39:59.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.369+0000 7f5672800640 1 --2- 172.21.15.196:0/3834867624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56740c65b0 0x7f56740d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:39:59.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.374+0000 7f5673200640 1 -- 172.21.15.196:0/3834867624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c6c00 msgr2=0x7f56741e5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:59.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.374+0000 7f5673200640 1 --2- 172.21.15.196:0/3834867624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c6c00 0x7f56741e5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:59.373 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.374+0000 7f5673200640 1 -- 172.21.15.196:0/3834867624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56740c65b0 msgr2=0x7f56740d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:39:59.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.374+0000 7f5673200640 1 --2- 172.21.15.196:0/3834867624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56740c65b0 0x7f56740d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:39:59.374 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.374+0000 7f5673200640 1 -- 172.21.15.196:0/3834867624 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56740d04a0 con 0x7f56740cd940 2024-05-14T09:39:59.376 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.377+0000 7f5673200640 1 --2- 172.21.15.196:0/3834867624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56740cd940 0x7f56741ec440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f566c00c760 tx=0x7f566c00cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:39:59.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.383+0000 7f566aa00640 1 -- 172.21.15.196:0/3834867624 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c003b70 con 0x7f56740cd940 2024-05-14T09:39:59.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.383+0000 7f566aa00640 1 -- 172.21.15.196:0/3834867624 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c003d10 con 0x7f56740cd940 2024-05-14T09:39:59.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.383+0000 7f566aa00640 1 -- 172.21.15.196:0/3834867624 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c00aa70 con 0x7f56740cd940 2024-05-14T09:39:59.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.383+0000 7f5678a00640 1 -- 172.21.15.196:0/3834867624 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56741e5bc0 con 0x7f56740cd940 2024-05-14T09:39:59.383 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.383+0000 7f5678a00640 1 -- 172.21.15.196:0/3834867624 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56741f3430 con 0x7f56740cd940 2024-05-14T09:39:59.384 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.384+0000 7f5678a00640 1 -- 172.21.15.196:0/3834867624 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5674069980 con 0x7f56740cd940 2024-05-14T09:39:59.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.388+0000 7f566aa00640 1 -- 172.21.15.196:0/3834867624 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f566c00ac10 con 0x7f56740cd940 2024-05-14T09:39:59.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.388+0000 7f566aa00640 1 -- 172.21.15.196:0/3834867624 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f566c012460 con 0x7f56740cd940 2024-05-14T09:39:59.484 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:59.484+0000 7fd48fe1f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T09:39:59.634 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.634+0000 7f566aa00640 1 -- 172.21.15.196:0/3834867624 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f566c005090 con 0x7f56740cd940 2024-05-14T09:39:59.646 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:59.646+0000 7f1e7d523040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T09:39:59.709 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:59.709+0000 7f1e7d523040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T09:39:59.717 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.718+0000 7f5678a00640 1 -- 172.21.15.196:0/3834867624 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "12b12d4a-1242-4630-afc3-14bf24bfb26e", "id": 1} v 0) -- 0x7f5674160650 con 0x7f56740cd940 2024-05-14T09:39:59.845 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:39:59.846+0000 7f1e7d523040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T09:39:59.898 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:59.898+0000 7fd48fe1f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T09:39:59.958 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:39:59.958+0000 7fd48fe1f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T09:39:59.998 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:39:59.999+0000 7f566aa00640 1 -- 172.21.15.196:0/3834867624 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12b12d4a-1242-4630-afc3-14bf24bfb26e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f566c005270 con 0x7f56740cd940 2024-05-14T09:39:59.999 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-05-14T09:40:00.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.000+0000 7f5678a00640 1 -- 172.21.15.196:0/3834867624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56740cd940 msgr2=0x7f56741ec440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:00.000 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.000+0000 7f5678a00640 1 --2- 172.21.15.196:0/3834867624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56740cd940 0x7f56741ec440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f566c00c760 tx=0x7f566c00cc20 comp rx=0 tx=0).stop 2024-05-14T09:40:00.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.000+0000 7f5678a00640 1 -- 172.21.15.196:0/3834867624 shutdown_connections 2024-05-14T09:40:00.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.001+0000 7f5678a00640 1 --2- 172.21.15.196:0/3834867624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56740cd940 0x7f56741ec440 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.001+0000 7f5678a00640 1 --2- 172.21.15.196:0/3834867624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f56740c6c00 0x7f56741e5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.001+0000 7f5678a00640 1 --2- 172.21.15.196:0/3834867624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56740c65b0 0x7f56740d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.001+0000 7f5678a00640 1 -- 172.21.15.196:0/3834867624 >> 172.21.15.196:0/3834867624 conn(0x7f567408e180 msgr2=0x7f567414c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:00.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.001+0000 7f5678a00640 1 -- 172.21.15.196:0/3834867624 shutdown_connections 2024-05-14T09:40:00.001 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.001+0000 7f5678a00640 1 -- 172.21.15.196:0/3834867624 wait complete. 2024-05-14T09:40:00.027 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 0e05891c-f772-4ff0-926b-8503fcb9223b 2 2024-05-14T09:40:00.143 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:40:00.143+0000 7fd48fe1f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T09:40:00.209 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:40:00.209+0000 7f1e7d523040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T09:40:00.270 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:40:00.270+0000 7f1e7d523040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T09:40:00.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.302+0000 7f5bd0200640 1 Processor -- start 2024-05-14T09:40:00.302 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.302+0000 7f5bd0200640 1 -- start start 2024-05-14T09:40:00.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.305+0000 7f5bd0200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5bc806e280 0x7f5bc80c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:00.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.305+0000 7f5bd0200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bc8156750 0x7f5bc8166ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:00.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.305+0000 7f5bd0200640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bc80c3f30 con 0x7f5bc80c39d0 2024-05-14T09:40:00.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.305+0000 7f5bd0200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f5bc815cda0 con 0x7f5bc806e280 2024-05-14T09:40:00.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.305+0000 7f5bd0200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc80c4210 con 0x7f5bc8156750 2024-05-14T09:40:00.305 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.306+0000 7f5bcd800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5bc806e280 0x7f5bc80c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:00.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.306+0000 7f5bcd800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5bc806e280 0x7f5bc80c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:47314/0 (socket says 172.21.15.196:47314) 2024-05-14T09:40:00.306 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.306+0000 7f5bcd800640 1 -- 172.21.15.196:0/4234343357 learned_addr learned my addr 172.21.15.196:0/4234343357 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:40:00.308 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.308+0000 7f5bce200640 1 --2- 172.21.15.196:0/4234343357 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bc8156750 0x7f5bc8166ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:00.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.310+0000 7f5bcd800640 1 -- 172.21.15.196:0/4234343357 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bc8156750 msgr2=0x7f5bc8166ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:00.309 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.310+0000 7f5bcd800640 1 --2- 172.21.15.196:0/4234343357 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bc8156750 0x7f5bc8166ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.310+0000 7f5bcd800640 1 -- 172.21.15.196:0/4234343357 >> v1:172.21.15.135:6789/0 conn(0x7f5bc80c39d0 legacy=0x7f5bc80c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:00.310 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.310+0000 7f5bcd800640 1 -- 172.21.15.196:0/4234343357 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc815c470 con 0x7f5bc806e280 2024-05-14T09:40:00.311 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.312+0000 7f5bcd800640 1 --2- 172.21.15.196:0/4234343357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bc806e280 0x7f5bc80c9090 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009870 tx=0x7f5bbc02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d080c67a2ae4480 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:00.316 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.317+0000 7f5bc7e00640 1 -- 172.21.15.196:0/4234343357 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc037070 con 0x7f5bc806e280 2024-05-14T09:40:00.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.317+0000 7f5bc7e00640 1 -- 172.21.15.196:0/4234343357 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bbc02ae50 con 0x7f5bc806e280 2024-05-14T09:40:00.317 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.317+0000 7f5bc7e00640 1 -- 172.21.15.196:0/4234343357 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc032860 con 0x7f5bc806e280 2024-05-14T09:40:00.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.318+0000 7f5bd0200640 1 -- 172.21.15.196:0/4234343357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bc806e280 msgr2=0x7f5bc80c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:00.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.318+0000 7f5bd0200640 1 --2- 172.21.15.196:0/4234343357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bc806e280 0x7f5bc80c9090 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009870 tx=0x7f5bbc02a300 comp rx=0 tx=0).stop 2024-05-14T09:40:00.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.318+0000 7f5bd0200640 1 -- 172.21.15.196:0/4234343357 shutdown_connections 2024-05-14T09:40:00.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.318+0000 7f5bd0200640 1 --2- 172.21.15.196:0/4234343357 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bc8156750 0x7f5bc8166ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.318+0000 7f5bd0200640 1 --2- 172.21.15.196:0/4234343357 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bc806e280 0x7f5bc80c9090 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.318+0000 7f5bd0200640 1 -- 172.21.15.196:0/4234343357 >> 172.21.15.196:0/4234343357 conn(0x7f5bc80cb190 msgr2=0x7f5bc80cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:00.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.318+0000 7f5bd0200640 1 -- 172.21.15.196:0/4234343357 shutdown_connections 2024-05-14T09:40:00.318 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.318+0000 7f5bd0200640 1 -- 172.21.15.196:0/4234343357 wait complete. 2024-05-14T09:40:00.319 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:40:00.318+0000 7fd48fe1f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T09:40:00.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.320+0000 7f5bd0200640 1 Processor -- start 2024-05-14T09:40:00.320 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.321+0000 7f5bd0200640 1 -- start start 2024-05-14T09:40:00.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.322+0000 7f5bd0200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bc806e280 0x7f5bc815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:00.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.322+0000 7f5bd0200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bc80c39d0 0x7f5bc815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:00.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.322+0000 7f5bd0200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bc8156750 0x7f5bc81f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:00.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.322+0000 7f5bd0200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc815d230 con 0x7f5bc806e280 2024-05-14T09:40:00.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.322+0000 7f5bd0200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc815ca30 con 0x7f5bc8156750 2024-05-14T09:40:00.322 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.322+0000 7f5bd0200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc8071e60 con 0x7f5bc80c39d0 2024-05-14T09:40:00.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.323+0000 7f5bcce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bc80c39d0 0x7f5bc815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:00.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.323+0000 7f5bce200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bc8156750 0x7f5bc81f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:00.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.323+0000 7f5bcce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bc80c39d0 0x7f5bc815a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:58852/0 (socket says 172.21.15.196:58852) 2024-05-14T09:40:00.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.323+0000 7f5bcce00640 1 -- 172.21.15.196:0/989342387 learned_addr learned my addr 172.21.15.196:0/989342387 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:40:00.323 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.324+0000 7f5bcd800640 1 --2- 172.21.15.196:0/989342387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bc806e280 0x7f5bc815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:00.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.328+0000 7f5bce200640 1 -- 172.21.15.196:0/989342387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bc80c39d0 msgr2=0x7f5bc815a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:00.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.328+0000 7f5bce200640 1 --2- 172.21.15.196:0/989342387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bc80c39d0 0x7f5bc815a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.328+0000 7f5bce200640 1 -- 172.21.15.196:0/989342387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bc806e280 msgr2=0x7f5bc815ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:00.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.328+0000 7f5bce200640 1 --2- 172.21.15.196:0/989342387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bc806e280 0x7f5bc815ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.328 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.328+0000 7f5bce200640 1 -- 172.21.15.196:0/989342387 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc815a8d0 con 0x7f5bc8156750 2024-05-14T09:40:00.330 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.331+0000 7f5bce200640 1 --2- 172.21.15.196:0/989342387 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bc8156750 0x7f5bc81f6c70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0007cf0 tx=0x7f5bc000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:00.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.335+0000 7f5bc5600640 1 -- 172.21.15.196:0/989342387 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc000edd0 con 0x7f5bc8156750 2024-05-14T09:40:00.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.335+0000 7f5bc5600640 1 -- 172.21.15.196:0/989342387 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc0003990 con 0x7f5bc8156750 2024-05-14T09:40:00.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.335+0000 7f5bc5600640 1 -- 172.21.15.196:0/989342387 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0003d80 con 0x7f5bc8156750 2024-05-14T09:40:00.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.335+0000 7f5bd0200640 1 -- 172.21.15.196:0/989342387 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc81f3000 con 0x7f5bc8156750 2024-05-14T09:40:00.335 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.335+0000 7f5bd0200640 1 -- 172.21.15.196:0/989342387 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc81f35c0 con 0x7f5bc8156750 2024-05-14T09:40:00.336 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.336+0000 7f5bd0200640 1 -- 172.21.15.196:0/989342387 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc80c53b0 con 0x7f5bc8156750 2024-05-14T09:40:00.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.341+0000 7f5bc5600640 1 -- 172.21.15.196:0/989342387 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5bc001b020 con 0x7f5bc8156750 2024-05-14T09:40:00.341 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.341+0000 7f5bc5600640 1 -- 172.21.15.196:0/989342387 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f5bc0014dc0 con 0x7f5bc8156750 2024-05-14T09:40:00.381 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:40:00.381+0000 7fd48fe1f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T09:40:00.461 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:40:00.461+0000 7fd48fe1f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T09:40:00.467 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:40:00.468+0000 7f1e7d523040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T09:40:00.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.481+0000 7f5bc5600640 1 -- 172.21.15.196:0/989342387 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5bc80c53b0 con 0x7f5bc8156750 2024-05-14T09:40:00.514 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:40:00.514+0000 7fd48fe1f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T09:40:00.565 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.565+0000 7f5bd0200640 1 -- 172.21.15.196:0/989342387 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e05891c-f772-4ff0-926b-8503fcb9223b", "id": 2} v 0) -- 0x7f5bc8069a60 con 0x7f5bc8156750 2024-05-14T09:40:00.641 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:40:00.641+0000 7f1e7d523040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T09:40:00.703 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:40:00.703+0000 7f1e7d523040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T09:40:00.766 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.766+0000 7f5bc5600640 1 -- 172.21.15.196:0/989342387 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e05891c-f772-4ff0-926b-8503fcb9223b", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f5bc00148d0 con 0x7f5bc8156750 2024-05-14T09:40:00.766 INFO:teuthology.orchestra.run.smithi196.stdout:2 2024-05-14T09:40:00.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.768+0000 7f5bd0200640 1 -- 172.21.15.196:0/989342387 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bc8156750 msgr2=0x7f5bc81f6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:00.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.768+0000 7f5bd0200640 1 --2- 172.21.15.196:0/989342387 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bc8156750 0x7f5bc81f6c70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0007cf0 tx=0x7f5bc000e4b0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.768 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.768+0000 7f5bd0200640 1 -- 172.21.15.196:0/989342387 shutdown_connections 2024-05-14T09:40:00.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.768+0000 7f5bd0200640 1 --2- 172.21.15.196:0/989342387 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bc8156750 0x7f5bc81f6c70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.768+0000 7f5bd0200640 1 --2- 172.21.15.196:0/989342387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bc80c39d0 0x7f5bc815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.768+0000 7f5bd0200640 1 --2- 172.21.15.196:0/989342387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bc806e280 0x7f5bc815ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:00.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.768+0000 7f5bd0200640 1 -- 172.21.15.196:0/989342387 >> 172.21.15.196:0/989342387 conn(0x7f5bc80cb190 msgr2=0x7f5bc8142430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:00.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.768+0000 7f5bd0200640 1 -- 172.21.15.196:0/989342387 shutdown_connections 2024-05-14T09:40:00.769 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:00.769+0000 7f5bd0200640 1 -- 172.21.15.196:0/989342387 wait complete. 2024-05-14T09:40:00.791 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:40:00.791+0000 7f1e7d523040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T09:40:00.791 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 8fa7fe0d-d8c8-4292-9761-e19514a8ee4c 3 2024-05-14T09:40:00.847 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:40:00.847+0000 7f1e7d523040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T09:40:01.037 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.038+0000 7ffb35000640 1 Processor -- start 2024-05-14T09:40:01.038 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.038+0000 7ffb35000640 1 -- start start 2024-05-14T09:40:01.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.039+0000 7ffb35000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb3006d100 0x7ffb3015f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:01.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.039+0000 7ffb35000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffb300c3cc0 0x7ffb300c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:01.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.039+0000 7ffb35000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb300c3170 con 0x7ffb301565c0 2024-05-14T09:40:01.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.040+0000 7ffb35000640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ffb301569d0 con 0x7ffb300c3cc0 2024-05-14T09:40:01.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.040+0000 7ffb35000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffb3015fe00 con 0x7ffb3006d100 2024-05-14T09:40:01.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.040+0000 7ffb2f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb3006d100 0x7ffb3015f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:01.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.041+0000 7ffb2f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb3006d100 0x7ffb3015f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:58860/0 (socket says 172.21.15.196:58860) 2024-05-14T09:40:01.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.041+0000 7ffb2f400640 1 -- 172.21.15.196:0/3037402959 learned_addr learned my addr 172.21.15.196:0/3037402959 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:40:01.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.042+0000 7ffb2fe00640 1 --2- 172.21.15.196:0/3037402959 >> v2:172.21.15.135:3300/0 conn(0x7ffb300c3cc0 0x7ffb300c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:01.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.044+0000 7ffb2f400640 1 -- 172.21.15.196:0/3037402959 >> v2:172.21.15.135:3300/0 conn(0x7ffb300c3cc0 msgr2=0x7ffb300c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:01.043 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.044+0000 7ffb2f400640 1 --2- 172.21.15.196:0/3037402959 >> v2:172.21.15.135:3300/0 conn(0x7ffb300c3cc0 0x7ffb300c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:01.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.044+0000 7ffb2f400640 1 -- 172.21.15.196:0/3037402959 >> v1:172.21.15.135:6789/0 conn(0x7ffb301565c0 legacy=0x7ffb300c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:01.044 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.044+0000 7ffb2f400640 1 -- 172.21.15.196:0/3037402959 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb301600e0 con 0x7ffb3006d100 2024-05-14T09:40:01.045 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.046+0000 7ffb2f400640 1 --2- 172.21.15.196:0/3037402959 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb3006d100 0x7ffb3015f7e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009e50 tx=0x7ffb2002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2abdad59ea89d928 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:01.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.050+0000 7ffb2e000640 1 -- 172.21.15.196:0/3037402959 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20036070 con 0x7ffb3006d100 2024-05-14T09:40:01.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.050+0000 7ffb2e000640 1 -- 172.21.15.196:0/3037402959 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb20031600 con 0x7ffb3006d100 2024-05-14T09:40:01.050 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.050+0000 7ffb2e000640 1 -- 172.21.15.196:0/3037402959 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb200319d0 con 0x7ffb3006d100 2024-05-14T09:40:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.051+0000 7ffb35000640 1 -- 172.21.15.196:0/3037402959 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb3006d100 msgr2=0x7ffb3015f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:01.051 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.051+0000 7ffb35000640 1 --2- 172.21.15.196:0/3037402959 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb3006d100 0x7ffb3015f7e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009e50 tx=0x7ffb2002a680 comp rx=0 tx=0).stop 2024-05-14T09:40:01.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.051+0000 7ffb35000640 1 -- 172.21.15.196:0/3037402959 shutdown_connections 2024-05-14T09:40:01.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.051+0000 7ffb35000640 1 --2- 172.21.15.196:0/3037402959 >> v2:172.21.15.135:3300/0 conn(0x7ffb300c3cc0 0x7ffb300c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:01.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.051+0000 7ffb35000640 1 --2- 172.21.15.196:0/3037402959 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb3006d100 0x7ffb3015f7e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:01.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.051+0000 7ffb35000640 1 -- 172.21.15.196:0/3037402959 >> 172.21.15.196:0/3037402959 conn(0x7ffb30073ec0 msgr2=0x7ffb300742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:01.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.051+0000 7ffb35000640 1 -- 172.21.15.196:0/3037402959 shutdown_connections 2024-05-14T09:40:01.052 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.051+0000 7ffb35000640 1 -- 172.21.15.196:0/3037402959 wait complete. 2024-05-14T09:40:01.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.054+0000 7ffb35000640 1 Processor -- start 2024-05-14T09:40:01.053 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.054+0000 7ffb35000640 1 -- start start 2024-05-14T09:40:01.055 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:40:01.054+0000 7fd48fe1f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T09:40:01.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.055+0000 7ffb35000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb3006d100 0x7ffb301f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:01.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.055+0000 7ffb35000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb300c3cc0 0x7ffb3015df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:01.055 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.055+0000 7ffb35000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb301565c0 0x7ffb3014c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:01.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.055+0000 7ffb35000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb300c8950 con 0x7ffb3006d100 2024-05-14T09:40:01.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.055+0000 7ffb35000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffb300c8670 con 0x7ffb301565c0 2024-05-14T09:40:01.056 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.055+0000 7ffb35000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffb301606a0 con 0x7ffb300c3cc0 2024-05-14T09:40:01.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.056+0000 7ffb2ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb300c3cc0 0x7ffb3015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:01.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.056+0000 7ffb2fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb301565c0 0x7ffb3014c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:01.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.057+0000 7ffb2fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb301565c0 0x7ffb3014c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:47330/0 (socket says 172.21.15.196:47330) 2024-05-14T09:40:01.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.057+0000 7ffb2fe00640 1 -- 172.21.15.196:0/1917418990 learned_addr learned my addr 172.21.15.196:0/1917418990 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:40:01.057 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.057+0000 7ffb2f400640 1 --2- 172.21.15.196:0/1917418990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb3006d100 0x7ffb301f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:01.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.063+0000 7ffb2ea00640 1 -- 172.21.15.196:0/1917418990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb301565c0 msgr2=0x7ffb3014c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:01.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.063+0000 7ffb2ea00640 1 --2- 172.21.15.196:0/1917418990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb301565c0 0x7ffb3014c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:01.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.063+0000 7ffb2ea00640 1 -- 172.21.15.196:0/1917418990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb3006d100 msgr2=0x7ffb301f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:01.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.063+0000 7ffb2ea00640 1 --2- 172.21.15.196:0/1917418990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb3006d100 0x7ffb301f2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:01.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.063+0000 7ffb2ea00640 1 -- 172.21.15.196:0/1917418990 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb301f27d0 con 0x7ffb300c3cc0 2024-05-14T09:40:01.063 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.063+0000 7ffb2fe00640 1 --2- 172.21.15.196:0/1917418990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb301565c0 0x7ffb3014c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:40:01.066 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.066+0000 7ffb2ea00640 1 --2- 172.21.15.196:0/1917418990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb300c3cc0 0x7ffb3015df60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800b3e0 tx=0x7ffb1800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:01.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.071+0000 7ffb27400640 1 -- 172.21.15.196:0/1917418990 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18015020 con 0x7ffb300c3cc0 2024-05-14T09:40:01.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.071+0000 7ffb27400640 1 -- 172.21.15.196:0/1917418990 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb18011830 con 0x7ffb300c3cc0 2024-05-14T09:40:01.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.071+0000 7ffb27400640 1 -- 172.21.15.196:0/1917418990 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18011c20 con 0x7ffb300c3cc0 2024-05-14T09:40:01.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.071+0000 7ffb35000640 1 -- 172.21.15.196:0/1917418990 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb300c59f0 con 0x7ffb300c3cc0 2024-05-14T09:40:01.071 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.071+0000 7ffb35000640 1 -- 172.21.15.196:0/1917418990 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb300c5fb0 con 0x7ffb300c3cc0 2024-05-14T09:40:01.072 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.073+0000 7ffb35000640 1 -- 172.21.15.196:0/1917418990 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb30076290 con 0x7ffb300c3cc0 2024-05-14T09:40:01.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.077+0000 7ffb27400640 1 -- 172.21.15.196:0/1917418990 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffb18018020 con 0x7ffb300c3cc0 2024-05-14T09:40:01.076 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.077+0000 7ffb27400640 1 -- 172.21.15.196:0/1917418990 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7ffb1801ab90 con 0x7ffb300c3cc0 2024-05-14T09:40:01.191 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:40:01.191+0000 7fd48fe1f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T09:40:01.238 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.239+0000 7ffb27400640 1 -- 172.21.15.196:0/1917418990 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ffb1801f020 con 0x7ffb300c3cc0 2024-05-14T09:40:01.357 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:01.357+0000 7ffb35000640 1 -- 172.21.15.196:0/1917418990 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8fa7fe0d-d8c8-4292-9761-e19514a8ee4c", "id": 3} v 0) -- 0x7ffb300c2ec0 con 0x7ffb300c3cc0 2024-05-14T09:40:01.474 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:40:01.474+0000 7f1e7d523040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T09:40:01.608 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-05-14T09:40:01.608+0000 7f1e7d523040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T09:40:02.269 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.269+0000 7ffb27400640 1 -- 172.21.15.196:0/1917418990 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mgrmap(e 2) ==== 49122+0+0 (secure 0 0 0) 0x7ffb1801a630 con 0x7ffb300c3cc0 2024-05-14T09:40:02.507 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.507+0000 7ffb27400640 1 -- 172.21.15.196:0/1917418990 <== mon.2 v2:172.21.15.196:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8fa7fe0d-d8c8-4292-9761-e19514a8ee4c", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7ffb18024dc0 con 0x7ffb300c3cc0 2024-05-14T09:40:02.507 INFO:teuthology.orchestra.run.smithi196.stdout:3 2024-05-14T09:40:02.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.509+0000 7ffb35000640 1 -- 172.21.15.196:0/1917418990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb300c3cc0 msgr2=0x7ffb3015df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:02.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.509+0000 7ffb35000640 1 --2- 172.21.15.196:0/1917418990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb300c3cc0 0x7ffb3015df60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800b3e0 tx=0x7ffb1800b8a0 comp rx=0 tx=0).stop 2024-05-14T09:40:02.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.509+0000 7ffb35000640 1 -- 172.21.15.196:0/1917418990 shutdown_connections 2024-05-14T09:40:02.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.509+0000 7ffb35000640 1 --2- 172.21.15.196:0/1917418990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb301565c0 0x7ffb3014c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:02.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.509+0000 7ffb35000640 1 --2- 172.21.15.196:0/1917418990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb300c3cc0 0x7ffb3015df60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:02.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.509+0000 7ffb35000640 1 --2- 172.21.15.196:0/1917418990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb3006d100 0x7ffb301f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:02.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.509+0000 7ffb35000640 1 -- 172.21.15.196:0/1917418990 >> 172.21.15.196:0/1917418990 conn(0x7ffb30073ec0 msgr2=0x7ffb300ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:02.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.509+0000 7ffb35000640 1 -- 172.21.15.196:0/1917418990 shutdown_connections 2024-05-14T09:40:02.509 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.510+0000 7ffb35000640 1 -- 172.21.15.196:0/1917418990 wait complete. 2024-05-14T09:40:02.540 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 061a08d5-a3d9-43d1-a153-857d5ce2bf1c 4 2024-05-14T09:40:02.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.803+0000 7f6cc6400640 1 Processor -- start 2024-05-14T09:40:02.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.804+0000 7f6cc6400640 1 -- start start 2024-05-14T09:40:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.806+0000 7f6cc6400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6cc01532e0 0x7f6cc015c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.806+0000 7f6cc6400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc015cb50 0x7f6cc01639a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.806+0000 7f6cc6400640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc00c5900 con 0x7f6cc0152ed0 2024-05-14T09:40:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.806+0000 7f6cc6400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f6cc015a510 con 0x7f6cc01532e0 2024-05-14T09:40:02.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.806+0000 7f6cc6400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc006c6f0 con 0x7f6cc015cb50 2024-05-14T09:40:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.807+0000 7f6cb7e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6cc01532e0 0x7f6cc015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.807+0000 7f6cb7e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6cc01532e0 0x7f6cc015c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:47342/0 (socket says 172.21.15.196:47342) 2024-05-14T09:40:02.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.807+0000 7f6cb7e00640 1 -- 172.21.15.196:0/1874737107 learned_addr learned my addr 172.21.15.196:0/1874737107 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:40:02.808 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.809+0000 7f6cbfe00640 1 --2- 172.21.15.196:0/1874737107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc015cb50 0x7f6cc01639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:02.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.810+0000 7f6cb7e00640 1 -- 172.21.15.196:0/1874737107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc015cb50 msgr2=0x7f6cc01639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:02.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.810+0000 7f6cb7e00640 1 --2- 172.21.15.196:0/1874737107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc015cb50 0x7f6cc01639a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:02.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.810+0000 7f6cb7e00640 1 -- 172.21.15.196:0/1874737107 >> v1:172.21.15.135:6789/0 conn(0x7f6cc0152ed0 legacy=0x7f6cc00c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:02.810 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.810+0000 7f6cb7e00640 1 -- 172.21.15.196:0/1874737107 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc015d290 con 0x7f6cc01532e0 2024-05-14T09:40:02.813 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.813+0000 7f6cb7e00640 1 --2- 172.21.15.196:0/1874737107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc01532e0 0x7f6cc015c610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009870 tx=0x7f6ca802c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc1dabf04f93374b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:02.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.817+0000 7f6cbea00640 1 -- 172.21.15.196:0/1874737107 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8038070 con 0x7f6cc01532e0 2024-05-14T09:40:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.817+0000 7f6cbea00640 1 -- 172.21.15.196:0/1874737107 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca8031710 con 0x7f6cc01532e0 2024-05-14T09:40:02.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.817+0000 7f6cbea00640 1 -- 172.21.15.196:0/1874737107 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8031ae0 con 0x7f6cc01532e0 2024-05-14T09:40:02.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.818+0000 7f6cc6400640 1 -- 172.21.15.196:0/1874737107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc01532e0 msgr2=0x7f6cc015c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:02.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.818+0000 7f6cc6400640 1 --2- 172.21.15.196:0/1874737107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc01532e0 0x7f6cc015c610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009870 tx=0x7f6ca802c460 comp rx=0 tx=0).stop 2024-05-14T09:40:02.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.819+0000 7f6cc6400640 1 -- 172.21.15.196:0/1874737107 shutdown_connections 2024-05-14T09:40:02.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.819+0000 7f6cc6400640 1 --2- 172.21.15.196:0/1874737107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc015cb50 0x7f6cc01639a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:02.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.819+0000 7f6cc6400640 1 --2- 172.21.15.196:0/1874737107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc01532e0 0x7f6cc015c610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:02.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.819+0000 7f6cc6400640 1 -- 172.21.15.196:0/1874737107 >> 172.21.15.196:0/1874737107 conn(0x7f6cc0073d40 msgr2=0x7f6cc0074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:02.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.819+0000 7f6cc6400640 1 -- 172.21.15.196:0/1874737107 shutdown_connections 2024-05-14T09:40:02.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.819+0000 7f6cc6400640 1 -- 172.21.15.196:0/1874737107 wait complete. 2024-05-14T09:40:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.821+0000 7f6cc6400640 1 Processor -- start 2024-05-14T09:40:02.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.821+0000 7f6cc6400640 1 -- start start 2024-05-14T09:40:02.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.823+0000 7f6cc6400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc0152ed0 0x7f6cc0155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:02.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.823+0000 7f6cc6400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cc01532e0 0x7f6cc01f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:02.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.823+0000 7f6cc6400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc015cb50 0x7f6cc00c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:02.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.823+0000 7f6cc6400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc006c940 con 0x7f6cc01532e0 2024-05-14T09:40:02.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.823+0000 7f6cc6400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc00c5c10 con 0x7f6cc015cb50 2024-05-14T09:40:02.823 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.823+0000 7f6cc6400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc006cc20 con 0x7f6cc0152ed0 2024-05-14T09:40:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.828+0000 7f6cbfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc015cb50 0x7f6cc00c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.829+0000 7f6cbfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc015cb50 0x7f6cc00c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:47348/0 (socket says 172.21.15.196:47348) 2024-05-14T09:40:02.828 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.829+0000 7f6cbfe00640 1 -- 172.21.15.196:0/3074422746 learned_addr learned my addr 172.21.15.196:0/3074422746 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:40:02.830 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.830+0000 7f6cbf400640 1 --2- 172.21.15.196:0/3074422746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc0152ed0 0x7f6cc0155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:02.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.835+0000 7f6cbf400640 1 -- 172.21.15.196:0/3074422746 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc015cb50 msgr2=0x7f6cc00c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:02.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.835+0000 7f6cbf400640 1 --2- 172.21.15.196:0/3074422746 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc015cb50 0x7f6cc00c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:02.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.835+0000 7f6cbf400640 1 -- 172.21.15.196:0/3074422746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cc01532e0 msgr2=0x7f6cc01f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:02.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.835+0000 7f6cbf400640 1 --2- 172.21.15.196:0/3074422746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cc01532e0 0x7f6cc01f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:02.835 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.835+0000 7f6cbf400640 1 -- 172.21.15.196:0/3074422746 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc01f3540 con 0x7f6cc0152ed0 2024-05-14T09:40:02.838 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.838+0000 7f6cbf400640 1 --2- 172.21.15.196:0/3074422746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc0152ed0 0x7f6cc0155180 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000b410 tx=0x7f6cb000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:02.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.842+0000 7f6cb7400640 1 -- 172.21.15.196:0/3074422746 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0015020 con 0x7f6cc0152ed0 2024-05-14T09:40:02.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.842+0000 7f6cc6400640 1 -- 172.21.15.196:0/3074422746 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc01561b0 con 0x7f6cc0152ed0 2024-05-14T09:40:02.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.842+0000 7f6cc6400640 1 -- 172.21.15.196:0/3074422746 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc014d3a0 con 0x7f6cc0152ed0 2024-05-14T09:40:02.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.843+0000 7f6cb7400640 1 -- 172.21.15.196:0/3074422746 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb0011830 con 0x7f6cc0152ed0 2024-05-14T09:40:02.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.843+0000 7f6cb7400640 1 -- 172.21.15.196:0/3074422746 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0011be0 con 0x7f6cc0152ed0 2024-05-14T09:40:02.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.844+0000 7f6cc6400640 1 -- 172.21.15.196:0/3074422746 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c98005290 con 0x7f6cc0152ed0 2024-05-14T09:40:02.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.858+0000 7f6cb7400640 1 -- 172.21.15.196:0/3074422746 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 2) ==== 49122+0+0 (secure 0 0 0) 0x7f6cb0018020 con 0x7f6cc0152ed0 2024-05-14T09:40:02.860 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.860+0000 7f6cb7400640 1 -- 172.21.15.196:0/3074422746 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f6cb0024440 con 0x7f6cc0152ed0 2024-05-14T09:40:02.986 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:02.986+0000 7f6cb7400640 1 -- 172.21.15.196:0/3074422746 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6cb001f020 con 0x7f6cc0152ed0 2024-05-14T09:40:03.079 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:03.079+0000 7f6cc6400640 1 -- 172.21.15.196:0/3074422746 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "061a08d5-a3d9-43d1-a153-857d5ce2bf1c", "id": 4} v 0) -- 0x7f6c98005580 con 0x7f6cc0152ed0 2024-05-14T09:40:03.908 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:03.909+0000 7f6cb7400640 1 -- 172.21.15.196:0/3074422746 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mgrmap(e 3) ==== 97912+0+0 (secure 0 0 0) 0x7f6cb0024770 con 0x7f6cc0152ed0 2024-05-14T09:40:04.095 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.095+0000 7f6cb7400640 1 -- 172.21.15.196:0/3074422746 <== mon.2 v2:172.21.15.196:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "061a08d5-a3d9-43d1-a153-857d5ce2bf1c", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f6cb0063930 con 0x7f6cc0152ed0 2024-05-14T09:40:04.095 INFO:teuthology.orchestra.run.smithi196.stdout:4 2024-05-14T09:40:04.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.096+0000 7f6cc6400640 1 -- 172.21.15.196:0/3074422746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc0152ed0 msgr2=0x7f6cc0155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:04.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.096+0000 7f6cc6400640 1 --2- 172.21.15.196:0/3074422746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc0152ed0 0x7f6cc0155180 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000b410 tx=0x7f6cb000b8d0 comp rx=0 tx=0).stop 2024-05-14T09:40:04.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.097+0000 7f6cc6400640 1 -- 172.21.15.196:0/3074422746 shutdown_connections 2024-05-14T09:40:04.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.097+0000 7f6cc6400640 1 --2- 172.21.15.196:0/3074422746 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6cc015cb50 0x7f6cc00c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:04.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.097+0000 7f6cc6400640 1 --2- 172.21.15.196:0/3074422746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cc01532e0 0x7f6cc01f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:04.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.097+0000 7f6cc6400640 1 --2- 172.21.15.196:0/3074422746 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6cc0152ed0 0x7f6cc0155180 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:04.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.097+0000 7f6cc6400640 1 -- 172.21.15.196:0/3074422746 >> 172.21.15.196:0/3074422746 conn(0x7f6cc0073d40 msgr2=0x7f6cc00c4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:04.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.097+0000 7f6cc6400640 1 -- 172.21.15.196:0/3074422746 shutdown_connections 2024-05-14T09:40:04.097 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.097+0000 7f6cc6400640 1 -- 172.21.15.196:0/3074422746 wait complete. 2024-05-14T09:40:04.125 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 46f9b266-db51-42fe-8a9b-65c2cf2ddfb6 5 2024-05-14T09:40:04.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.385+0000 7fd5ab800640 1 Processor -- start 2024-05-14T09:40:04.385 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.386+0000 7fd5ab800640 1 -- start start 2024-05-14T09:40:04.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.388+0000 7fd5ab800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5a4160e90 0x7fd5a40c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:04.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.388+0000 7fd5ab800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd5a4157610 0x7fd5a40c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:04.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.388+0000 7fd5ab800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a40c91b0 con 0x7fd5a40c98e0 2024-05-14T09:40:04.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.388+0000 7fd5ab800640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fd5a4157a20 con 0x7fd5a4157610 2024-05-14T09:40:04.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.388+0000 7fd5ab800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a406ee20 con 0x7fd5a4160e90 2024-05-14T09:40:04.388 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.389+0000 7fd5a3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5a4160e90 0x7fd5a40c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:04.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.389+0000 7fd5a8e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fd5a40c98e0 0x7fd5a4160780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:51792/0 (socket says 172.21.15.196:51792) 2024-05-14T09:40:04.389 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.389+0000 7fd5a8e00640 1 -- 172.21.15.196:0/230426570 learned_addr learned my addr 172.21.15.196:0/230426570 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-05-14T09:40:04.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.392+0000 7fd5a3e00640 1 -- 172.21.15.196:0/230426570 >> v2:172.21.15.135:3300/0 conn(0x7fd5a4157610 msgr2=0x7fd5a40c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:04.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.392+0000 7fd5a3e00640 1 --2- 172.21.15.196:0/230426570 >> v2:172.21.15.135:3300/0 conn(0x7fd5a4157610 0x7fd5a40c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:04.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.392+0000 7fd5a3e00640 1 -- 172.21.15.196:0/230426570 >> v1:172.21.15.196:6789/0 conn(0x7fd5a40c98e0 legacy=0x7fd5a4160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:04.392 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.392+0000 7fd5a3e00640 1 -- 172.21.15.196:0/230426570 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a4074900 con 0x7fd5a4160e90 2024-05-14T09:40:04.395 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.395+0000 7fd5a3e00640 1 --2- 172.21.15.196:0/230426570 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5a4160e90 0x7fd5a40c8310 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd5900097a0 tx=0x7fd59002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcb0c0a97db13c3c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:04.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.400+0000 7fd5a3400640 1 -- 172.21.15.196:0/230426570 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd590037070 con 0x7fd5a4160e90 2024-05-14T09:40:04.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.400+0000 7fd5a3400640 1 -- 172.21.15.196:0/230426570 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd590032440 con 0x7fd5a4160e90 2024-05-14T09:40:04.400 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.400+0000 7fd5a3400640 1 -- 172.21.15.196:0/230426570 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd590032810 con 0x7fd5a4160e90 2024-05-14T09:40:04.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.401+0000 7fd5ab800640 1 -- 172.21.15.196:0/230426570 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5a4160e90 msgr2=0x7fd5a40c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:04.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.401+0000 7fd5ab800640 1 --2- 172.21.15.196:0/230426570 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5a4160e90 0x7fd5a40c8310 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd5900097a0 tx=0x7fd59002a230 comp rx=0 tx=0).stop 2024-05-14T09:40:04.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.401+0000 7fd5ab800640 1 -- 172.21.15.196:0/230426570 shutdown_connections 2024-05-14T09:40:04.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.401+0000 7fd5ab800640 1 --2- 172.21.15.196:0/230426570 >> v2:172.21.15.135:3300/0 conn(0x7fd5a4157610 0x7fd5a40c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:04.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.401+0000 7fd5ab800640 1 --2- 172.21.15.196:0/230426570 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5a4160e90 0x7fd5a40c8310 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:04.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.401+0000 7fd5ab800640 1 -- 172.21.15.196:0/230426570 >> 172.21.15.196:0/230426570 conn(0x7fd5a4073d40 msgr2=0x7fd5a4074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:04.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.401+0000 7fd5ab800640 1 -- 172.21.15.196:0/230426570 shutdown_connections 2024-05-14T09:40:04.401 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.401+0000 7fd5ab800640 1 -- 172.21.15.196:0/230426570 wait complete. 2024-05-14T09:40:04.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.405+0000 7fd5ab800640 1 Processor -- start 2024-05-14T09:40:04.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.405+0000 7fd5ab800640 1 -- start start 2024-05-14T09:40:04.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.407+0000 7fd5ab800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5a40c98e0 0x7fd5a415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:04.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.407+0000 7fd5ab800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5a4157610 0x7fd5a41545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:04.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.407+0000 7fd5ab800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5a4160e90 0x7fd5a4157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:04.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.407+0000 7fd5ab800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a4164920 con 0x7fd5a40c98e0 2024-05-14T09:40:04.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.407+0000 7fd5ab800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a40c9450 con 0x7fd5a4160e90 2024-05-14T09:40:04.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.407+0000 7fd5ab800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a40c73d0 con 0x7fd5a4157610 2024-05-14T09:40:04.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.408+0000 7fd5a9800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5a4160e90 0x7fd5a4157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:04.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.408+0000 7fd5a9800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5a4160e90 0x7fd5a4157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:47350/0 (socket says 172.21.15.196:47350) 2024-05-14T09:40:04.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.408+0000 7fd5a9800640 1 -- 172.21.15.196:0/763404320 learned_addr learned my addr 172.21.15.196:0/763404320 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:40:04.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.413+0000 7fd5a9800640 1 -- 172.21.15.196:0/763404320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5a4157610 msgr2=0x7fd5a41545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:04.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.413+0000 7fd5a9800640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5a4157610 0x7fd5a41545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:04.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.413+0000 7fd5a9800640 1 -- 172.21.15.196:0/763404320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5a40c98e0 msgr2=0x7fd5a415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:04.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.413+0000 7fd5a9800640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5a40c98e0 0x7fd5a415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:04.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.413+0000 7fd5a9800640 1 -- 172.21.15.196:0/763404320 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a4162580 con 0x7fd5a4160e90 2024-05-14T09:40:04.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.416+0000 7fd5a9800640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5a4160e90 0x7fd5a4157bb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00ba10 tx=0x7fd59c00bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:04.419 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.420+0000 7fd5a0c00640 1 -- 172.21.15.196:0/763404320 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c019070 con 0x7fd5a4160e90 2024-05-14T09:40:04.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.420+0000 7fd5a0c00640 1 -- 172.21.15.196:0/763404320 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59c00cb20 con 0x7fd5a4160e90 2024-05-14T09:40:04.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.420+0000 7fd5a0c00640 1 -- 172.21.15.196:0/763404320 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c014440 con 0x7fd5a4160e90 2024-05-14T09:40:04.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.420+0000 7fd5ab800640 1 -- 172.21.15.196:0/763404320 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a415d740 con 0x7fd5a4160e90 2024-05-14T09:40:04.420 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.420+0000 7fd5ab800640 1 -- 172.21.15.196:0/763404320 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a415c720 con 0x7fd5a4160e90 2024-05-14T09:40:04.421 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.421+0000 7fd5ab800640 1 -- 172.21.15.196:0/763404320 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a406d790 con 0x7fd5a4160e90 2024-05-14T09:40:04.701 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.701+0000 7fd5a0c00640 1 -- 172.21.15.196:0/763404320 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 3) ==== 97912+0+0 (secure 0 0 0) 0x7fd59c01c070 con 0x7fd5a4160e90 2024-05-14T09:40:04.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.726+0000 7fd5a0c00640 1 -- 172.21.15.196:0/763404320 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fd59c05c1f0 con 0x7fd5a4160e90 2024-05-14T09:40:04.726 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.726+0000 7fd5a0c00640 1 -- 172.21.15.196:0/763404320 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd5a406d790 con 0x7fd5a4160e90 2024-05-14T09:40:04.814 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:04.815+0000 7fd5ab800640 1 -- 172.21.15.196:0/763404320 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46f9b266-db51-42fe-8a9b-65c2cf2ddfb6", "id": 5} v 0) -- 0x7fd5a4070460 con 0x7fd5a4160e90 2024-05-14T09:40:05.886 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:40:05.886+0000 7fd42fa00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-14T09:40:06.039 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.040+0000 7fd5a0c00640 1 -- 172.21.15.196:0/763404320 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fd59c006d10 con 0x7fd5a4160e90 2024-05-14T09:40:06.040 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.040+0000 7fd5a0c00640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fd584076fe0 0x7fd584079400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:06.041 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.041+0000 7fd5a8e00640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fd584076fe0 0x7fd584079400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:06.042 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.043+0000 7fd5a8e00640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fd584076fe0 0x7fd584079400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd594001540 tx=0x7fd594007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:06.210 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.210+0000 7fd5a0c00640 1 -- 172.21.15.196:0/763404320 <== mon.1 v2:172.21.15.196:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46f9b266-db51-42fe-8a9b-65c2cf2ddfb6", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fd5a4070460 con 0x7fd5a4160e90 2024-05-14T09:40:06.210 INFO:teuthology.orchestra.run.smithi196.stdout:5 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.211+0000 7fd5ab800640 1 -- 172.21.15.196:0/763404320 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fd584076fe0 msgr2=0x7fd584079400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.211+0000 7fd5ab800640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fd584076fe0 0x7fd584079400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd594001540 tx=0x7fd594007a40 comp rx=0 tx=0).stop 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.211+0000 7fd5ab800640 1 -- 172.21.15.196:0/763404320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5a4160e90 msgr2=0x7fd5a4157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.211+0000 7fd5ab800640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5a4160e90 0x7fd5a4157bb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00ba10 tx=0x7fd59c00bed0 comp rx=0 tx=0).stop 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.212+0000 7fd5ab800640 1 -- 172.21.15.196:0/763404320 shutdown_connections 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.212+0000 7fd5ab800640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fd584076fe0 0x7fd584079400 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.212+0000 7fd5ab800640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd5a4160e90 0x7fd5a4157bb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.212+0000 7fd5ab800640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd5a4157610 0x7fd5a41545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.212+0000 7fd5ab800640 1 --2- 172.21.15.196:0/763404320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5a40c98e0 0x7fd5a415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.212+0000 7fd5ab800640 1 -- 172.21.15.196:0/763404320 >> 172.21.15.196:0/763404320 conn(0x7fd5a4073d40 msgr2=0x7fd5a4161b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.212+0000 7fd5ab800640 1 -- 172.21.15.196:0/763404320 shutdown_connections 2024-05-14T09:40:06.212 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.212+0000 7fd5ab800640 1 -- 172.21.15.196:0/763404320 wait complete. 2024-05-14T09:40:06.241 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 722ee974-e43e-4391-b03b-3c2095efb4df 6 2024-05-14T09:40:06.354 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T09:40:06.350+0000 7fd42fa00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-14T09:40:06.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.495+0000 7f89da600640 1 Processor -- start 2024-05-14T09:40:06.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.496+0000 7f89da600640 1 -- start start 2024-05-14T09:40:06.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.498+0000 7f89da600640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f89d41532e0 0x7f89d415c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:06.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.498+0000 7f89da600640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d40c5900 con 0x7f89d4152ed0 2024-05-14T09:40:06.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.498+0000 7f89da600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d415d290 con 0x7f89d415cb50 2024-05-14T09:40:06.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.498+0000 7f89da600640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f89d415a510 con 0x7f89d41532e0 2024-05-14T09:40:06.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.500+0000 7f89d3e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f89d415cb50 0x7f89d41639a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:51802/0 (socket says 172.21.15.196:51802) 2024-05-14T09:40:06.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.500+0000 7f89d3e00640 1 -- 172.21.15.196:0/617343877 learned_addr learned my addr 172.21.15.196:0/617343877 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-05-14T09:40:06.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.502+0000 7f89d2a00640 1 --2- 172.21.15.196:0/617343877 >> v2:172.21.15.135:3300/0 conn(0x7f89d41532e0 0x7f89d415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:06.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.504+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25631675 0 0) 0x7f89d415d290 con 0x7f89d415cb50 2024-05-14T09:40:06.504 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.504+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b8003520 con 0x7f89d415cb50 2024-05-14T09:40:06.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.510+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3149052769 0 0) 0x7f89b8003520 con 0x7f89d415cb50 2024-05-14T09:40:06.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.510+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 >> v2:172.21.15.135:3300/0 conn(0x7f89d41532e0 msgr2=0x7f89d415c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:06.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.510+0000 7f89d2000640 1 --2- 172.21.15.196:0/617343877 >> v2:172.21.15.135:3300/0 conn(0x7f89d41532e0 0x7f89d415c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:06.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.510+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 >> v1:172.21.15.135:6789/0 conn(0x7f89d4152ed0 legacy=0x7f89d40c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:06.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.511+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d41536f0 con 0x7f89d415cb50 2024-05-14T09:40:06.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.511+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f89cc0016f0 con 0x7f89d415cb50 2024-05-14T09:40:06.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.511+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 >> v1:172.21.15.196:6789/0 conn(0x7f89d415cb50 legacy=0x7f89d41639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:06.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.511+0000 7f89d2000640 1 --2- 172.21.15.196:0/617343877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89b8003aa0 0x7f89b8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:06.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.511+0000 7f89d2000640 1 --2- 172.21.15.196:0/617343877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89b8004800 0x7f89b8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:06.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.511+0000 7f89d2000640 1 --2- 172.21.15.196:0/617343877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89b80052a0 0x7f89b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:06.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.511+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89b800c1f0 con 0x7f89b8004800 2024-05-14T09:40:06.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.511+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f89b800c3a0 con 0x7f89b80052a0 2024-05-14T09:40:06.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.511+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f89b800c5a0 con 0x7f89b8003aa0 2024-05-14T09:40:06.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.512+0000 7f89d3400640 1 --2- 172.21.15.196:0/617343877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89b8003aa0 0x7f89b8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:06.514 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.515+0000 7f89d3e00640 1 --2- 172.21.15.196:0/617343877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89b80052a0 0x7f89b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:06.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.515+0000 7f89d3400640 1 -- 172.21.15.196:0/617343877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89b80052a0 msgr2=0x7f89b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:06.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.515+0000 7f89d3400640 1 --2- 172.21.15.196:0/617343877 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89b80052a0 0x7f89b800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:06.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.515+0000 7f89d3400640 1 -- 172.21.15.196:0/617343877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89b8004800 msgr2=0x7f89b8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:06.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.515+0000 7f89d3400640 1 --2- 172.21.15.196:0/617343877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89b8004800 0x7f89b8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:06.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.515+0000 7f89d3400640 1 -- 172.21.15.196:0/617343877 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b8003520 con 0x7f89b8003aa0 2024-05-14T09:40:06.515 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.516+0000 7f89d3e00640 1 -- 172.21.15.196:0/617343877 reap_dead start 2024-05-14T09:40:06.518 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.519+0000 7f89d3400640 1 --2- 172.21.15.196:0/617343877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89b8003aa0 0x7f89b8003f10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f89c4001790 tx=0x7f89b8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a9a058d8185e4d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:06.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.524+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c40013b0 con 0x7f89b8003aa0 2024-05-14T09:40:06.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.524+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c40052d0 con 0x7f89b8003aa0 2024-05-14T09:40:06.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.524+0000 7f89d2000640 1 -- 172.21.15.196:0/617343877 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c402aac0 con 0x7f89b8003aa0 2024-05-14T09:40:06.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.525+0000 7f89da600640 1 -- 172.21.15.196:0/617343877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89b8003aa0 msgr2=0x7f89b8003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:06.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.525+0000 7f89da600640 1 --2- 172.21.15.196:0/617343877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89b8003aa0 0x7f89b8003f10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f89c4001790 tx=0x7f89b8005830 comp rx=0 tx=0).stop 2024-05-14T09:40:06.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.526+0000 7f89da600640 1 -- 172.21.15.196:0/617343877 shutdown_connections 2024-05-14T09:40:06.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.526+0000 7f89da600640 1 --2- 172.21.15.196:0/617343877 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89b8003aa0 0x7f89b8003f10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:06.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.526+0000 7f89da600640 1 -- 172.21.15.196:0/617343877 >> 172.21.15.196:0/617343877 conn(0x7f89d4073d40 msgr2=0x7f89d4074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:06.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.526+0000 7f89da600640 1 -- 172.21.15.196:0/617343877 shutdown_connections 2024-05-14T09:40:06.526 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.526+0000 7f89da600640 1 -- 172.21.15.196:0/617343877 wait complete. 2024-05-14T09:40:06.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.530+0000 7f89da600640 1 Processor -- start 2024-05-14T09:40:06.529 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.530+0000 7f89da600640 1 -- start start 2024-05-14T09:40:06.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.532+0000 7f89da600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89b8003aa0 0x7f89d41f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:06.532 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.532+0000 7f89da600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89d406d160 0x7f89d41f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:06.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.532+0000 7f89da600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89d406d570 0x7f89d41f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:06.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.532+0000 7f89da600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40c5c10 con 0x7f89d406d160 2024-05-14T09:40:06.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.533+0000 7f89da600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f89d406c6f0 con 0x7f89d406d570 2024-05-14T09:40:06.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.533+0000 7f89da600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f89d406cc20 con 0x7f89b8003aa0 2024-05-14T09:40:06.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.533+0000 7f89d3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89b8003aa0 0x7f89d41f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:06.533 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.534+0000 7f89d3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89d406d570 0x7f89d41f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:06.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.534+0000 7f89d3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89d406d570 0x7f89d41f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:47356/0 (socket says 172.21.15.196:47356) 2024-05-14T09:40:06.534 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.534+0000 7f89d3e00640 1 -- 172.21.15.196:0/708907212 learned_addr learned my addr 172.21.15.196:0/708907212 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:40:06.537 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.538+0000 7f89d2a00640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89d406d160 0x7f89d41f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:06.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.538+0000 7f89d3e00640 1 -- 172.21.15.196:0/708907212 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89b8003aa0 msgr2=0x7f89d41f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:06.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.538+0000 7f89d3e00640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89b8003aa0 0x7f89d41f5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:06.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.538+0000 7f89d3e00640 1 -- 172.21.15.196:0/708907212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89d406d160 msgr2=0x7f89d41f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:06.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.538+0000 7f89d3e00640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89d406d160 0x7f89d41f4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:06.538 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.538+0000 7f89d3e00640 1 -- 172.21.15.196:0/708907212 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d41f6460 con 0x7f89d406d570 2024-05-14T09:40:06.541 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.541+0000 7f89d3e00640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89d406d570 0x7f89d41f4e70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f89d4156b60 tx=0x7f89cc00d9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:06.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.544+0000 7f89cb400640 1 -- 172.21.15.196:0/708907212 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0074e0 con 0x7f89d406d570 2024-05-14T09:40:06.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.544+0000 7f89da600640 1 -- 172.21.15.196:0/708907212 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d41f2fc0 con 0x7f89d406d570 2024-05-14T09:40:06.544 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.544+0000 7f89da600640 1 -- 172.21.15.196:0/708907212 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d40c8c00 con 0x7f89d406d570 2024-05-14T09:40:06.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.545+0000 7f89da600640 1 -- 172.21.15.196:0/708907212 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d4069a60 con 0x7f89d406d570 2024-05-14T09:40:06.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.546+0000 7f89cb400640 1 -- 172.21.15.196:0/708907212 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc0047e0 con 0x7f89d406d570 2024-05-14T09:40:06.545 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.546+0000 7f89cb400640 1 -- 172.21.15.196:0/708907212 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc004b90 con 0x7f89d406d570 2024-05-14T09:40:06.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.885+0000 7f89cb400640 1 -- 172.21.15.196:0/708907212 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f89cc01b020 con 0x7f89d406d570 2024-05-14T09:40:06.887 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.887+0000 7f89cb400640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f89b4076270 0x7f89b4078780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:06.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.888+0000 7f89d3400640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f89b4076270 0x7f89b4078780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:06.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.890+0000 7f89d3400640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f89b4076270 0x7f89b4078780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f89c4032000 tx=0x7f89c402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:06.941 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.941+0000 7f89cb400640 1 -- 172.21.15.196:0/708907212 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f89cc05f4a0 con 0x7f89d406d570 2024-05-14T09:40:06.942 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:06.942+0000 7f89cb400640 1 -- 172.21.15.196:0/708907212 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f89cc022070 con 0x7f89d406d570 2024-05-14T09:40:07.162 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.162+0000 7f89da600640 1 -- 172.21.15.196:0/708907212 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "722ee974-e43e-4391-b03b-3c2095efb4df", "id": 6} v 0) -- 0x7f89d40c86b0 con 0x7f89d406d570 2024-05-14T09:40:07.458 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.458+0000 7f89cb400640 1 -- 172.21.15.196:0/708907212 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "722ee974-e43e-4391-b03b-3c2095efb4df", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f89cc0611e0 con 0x7f89d406d570 2024-05-14T09:40:07.459 INFO:teuthology.orchestra.run.smithi196.stdout:6 2024-05-14T09:40:07.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 -- 172.21.15.196:0/708907212 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f89b4076270 msgr2=0x7f89b4078780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:07.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f89b4076270 0x7f89b4078780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f89c4032000 tx=0x7f89c402e000 comp rx=0 tx=0).stop 2024-05-14T09:40:07.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 -- 172.21.15.196:0/708907212 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89d406d570 msgr2=0x7f89d41f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:07.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89d406d570 0x7f89d41f4e70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f89d4156b60 tx=0x7f89cc00d9d0 comp rx=0 tx=0).stop 2024-05-14T09:40:07.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 -- 172.21.15.196:0/708907212 shutdown_connections 2024-05-14T09:40:07.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f89b4076270 0x7f89b4078780 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:07.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f89d406d570 0x7f89d41f4e70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:07.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89d406d160 0x7f89d41f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:07.462 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 --2- 172.21.15.196:0/708907212 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f89b8003aa0 0x7f89d41f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:07.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 -- 172.21.15.196:0/708907212 >> 172.21.15.196:0/708907212 conn(0x7f89d4073d40 msgr2=0x7f89d415a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:07.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 -- 172.21.15.196:0/708907212 shutdown_connections 2024-05-14T09:40:07.463 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.462+0000 7f89da600640 1 -- 172.21.15.196:0/708907212 wait complete. 2024-05-14T09:40:07.491 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new a7339c9e-f78e-4d4f-a32e-63464c3a601f 7 2024-05-14T09:40:07.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.749+0000 7ff427200640 1 Processor -- start 2024-05-14T09:40:07.749 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.749+0000 7ff427200640 1 -- start start 2024-05-14T09:40:07.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.751+0000 7ff427200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff4280cdbb0 0x7ff4280c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:07.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.751+0000 7ff427200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff42806d6c0 0x7ff42806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:07.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.751+0000 7ff427200640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff428160370 con 0x7ff4281564f0 2024-05-14T09:40:07.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.751+0000 7ff427200640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff42806e010 con 0x7ff42806d6c0 2024-05-14T09:40:07.751 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.751+0000 7ff427200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff4280b4510 con 0x7ff4280cdbb0 2024-05-14T09:40:07.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.795+0000 7ff426800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff42806d6c0 0x7ff42806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:07.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.796+0000 7ff426800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff42806d6c0 0x7ff42806dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.196:34824/0 (socket says 172.21.15.196:34824) 2024-05-14T09:40:07.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.796+0000 7ff426800640 1 -- 172.21.15.196:0/1937391091 learned_addr learned my addr 172.21.15.196:0/1937391091 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:40:07.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.806+0000 7ff426800640 1 -- 172.21.15.196:0/1937391091 >> v2:172.21.15.196:3300/0 conn(0x7ff4280cdbb0 msgr2=0x7ff4280c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:07.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.806+0000 7ff426800640 1 --2- 172.21.15.196:0/1937391091 >> v2:172.21.15.196:3300/0 conn(0x7ff4280cdbb0 0x7ff4280c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:07.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.806+0000 7ff426800640 1 -- 172.21.15.196:0/1937391091 >> v1:172.21.15.135:6789/0 conn(0x7ff4281564f0 legacy=0x7ff42815f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:07.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.806+0000 7ff426800640 1 -- 172.21.15.196:0/1937391091 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff428160610 con 0x7ff42806d6c0 2024-05-14T09:40:07.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.820+0000 7ff426800640 1 --2- 172.21.15.196:0/1937391091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff42806d6c0 0x7ff42806dad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff4280d2770 tx=0x7ff42002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd1636c70690a1d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:07.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.841+0000 7ff424a00640 1 -- 172.21.15.196:0/1937391091 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff420036070 con 0x7ff42806d6c0 2024-05-14T09:40:07.840 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.841+0000 7ff424a00640 1 -- 172.21.15.196:0/1937391091 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff420031600 con 0x7ff42806d6c0 2024-05-14T09:40:07.841 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.841+0000 7ff424a00640 1 -- 172.21.15.196:0/1937391091 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4200319d0 con 0x7ff42806d6c0 2024-05-14T09:40:07.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.842+0000 7ff427200640 1 -- 172.21.15.196:0/1937391091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff42806d6c0 msgr2=0x7ff42806dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:07.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.842+0000 7ff427200640 1 --2- 172.21.15.196:0/1937391091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff42806d6c0 0x7ff42806dad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff4280d2770 tx=0x7ff42002a730 comp rx=0 tx=0).stop 2024-05-14T09:40:07.842 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.842+0000 7ff427200640 1 -- 172.21.15.196:0/1937391091 shutdown_connections 2024-05-14T09:40:07.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.842+0000 7ff427200640 1 --2- 172.21.15.196:0/1937391091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff42806d6c0 0x7ff42806dad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:07.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.842+0000 7ff427200640 1 --2- 172.21.15.196:0/1937391091 >> v2:172.21.15.196:3300/0 conn(0x7ff4280cdbb0 0x7ff4280c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:07.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.842+0000 7ff427200640 1 -- 172.21.15.196:0/1937391091 >> 172.21.15.196:0/1937391091 conn(0x7ff4280ce630 msgr2=0x7ff4280cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:07.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.843+0000 7ff427200640 1 -- 172.21.15.196:0/1937391091 shutdown_connections 2024-05-14T09:40:07.843 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.843+0000 7ff427200640 1 -- 172.21.15.196:0/1937391091 wait complete. 2024-05-14T09:40:07.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.846+0000 7ff427200640 1 Processor -- start 2024-05-14T09:40:07.846 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.847+0000 7ff427200640 1 -- start start 2024-05-14T09:40:07.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.849+0000 7ff427200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff42806d6c0 0x7ff42814e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:07.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.849+0000 7ff427200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4280cdbb0 0x7ff42814cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:07.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.849+0000 7ff427200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4281564f0 0x7ff4280b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:07.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.849+0000 7ff427200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff4280cd110 con 0x7ff4281564f0 2024-05-14T09:40:07.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.849+0000 7ff427200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff4280cd3f0 con 0x7ff42806d6c0 2024-05-14T09:40:07.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.849+0000 7ff427200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff42806d1a0 con 0x7ff4280cdbb0 2024-05-14T09:40:07.851 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.852+0000 7ff425400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4280cdbb0 0x7ff42814cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:07.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.853+0000 7ff425400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4280cdbb0 0x7ff42814cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:54200/0 (socket says 172.21.15.196:54200) 2024-05-14T09:40:07.852 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.853+0000 7ff425400640 1 -- 172.21.15.196:0/2097637810 learned_addr learned my addr 172.21.15.196:0/2097637810 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-14T09:40:07.853 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.853+0000 7ff425e00640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff42806d6c0 0x7ff42814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:07.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.858+0000 7ff425400640 1 -- 172.21.15.196:0/2097637810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff42806d6c0 msgr2=0x7ff42814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:07.857 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.858+0000 7ff425400640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff42806d6c0 0x7ff42814e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:07.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.858+0000 7ff425400640 1 -- 172.21.15.196:0/2097637810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4281564f0 msgr2=0x7ff4280b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:07.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.858+0000 7ff425400640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4281564f0 0x7ff4280b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:07.858 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.858+0000 7ff425400640 1 -- 172.21.15.196:0/2097637810 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4281599b0 con 0x7ff4280cdbb0 2024-05-14T09:40:07.861 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.862+0000 7ff425400640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4280cdbb0 0x7ff42814cb90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c3a0 tx=0x7ff41400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:07.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.870+0000 7ff41e000640 1 -- 172.21.15.196:0/2097637810 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4140052d0 con 0x7ff4280cdbb0 2024-05-14T09:40:07.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.870+0000 7ff41e000640 1 -- 172.21.15.196:0/2097637810 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff414007020 con 0x7ff4280cdbb0 2024-05-14T09:40:07.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.870+0000 7ff41e000640 1 -- 172.21.15.196:0/2097637810 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4140054b0 con 0x7ff4280cdbb0 2024-05-14T09:40:07.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.870+0000 7ff427200640 1 -- 172.21.15.196:0/2097637810 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4281f5ee0 con 0x7ff4280cdbb0 2024-05-14T09:40:07.870 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.870+0000 7ff427200640 1 -- 172.21.15.196:0/2097637810 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4281f64a0 con 0x7ff4280cdbb0 2024-05-14T09:40:07.871 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.872+0000 7ff427200640 1 -- 172.21.15.196:0/2097637810 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4280cc270 con 0x7ff4280cdbb0 2024-05-14T09:40:07.901 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.901+0000 7ff41e000640 1 -- 172.21.15.196:0/2097637810 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7ff414007410 con 0x7ff4280cdbb0 2024-05-14T09:40:07.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.903+0000 7ff41e000640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff408076290 0x7ff4080787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:07.903 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.904+0000 7ff425e00640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff408076290 0x7ff4080787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:07.905 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:07.905+0000 7ff425e00640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff408076290 0x7ff4080787a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff4180098e0 tx=0x7ff418009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:08.248 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.248+0000 7ff41e000640 1 -- 172.21.15.196:0/2097637810 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff41405c700 con 0x7ff4280cdbb0 2024-05-14T09:40:08.249 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.249+0000 7ff41e000640 1 -- 172.21.15.196:0/2097637810 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff4280cc270 con 0x7ff4280cdbb0 2024-05-14T09:40:08.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.476+0000 7ff427200640 1 -- 172.21.15.196:0/2097637810 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a7339c9e-f78e-4d4f-a32e-63464c3a601f", "id": 7} v 0) -- 0x7ff428159740 con 0x7ff4280cdbb0 2024-05-14T09:40:08.755 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.755+0000 7ff41e000640 1 -- 172.21.15.196:0/2097637810 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7339c9e-f78e-4d4f-a32e-63464c3a601f", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff414020070 con 0x7ff4280cdbb0 2024-05-14T09:40:08.756 INFO:teuthology.orchestra.run.smithi196.stdout:7 2024-05-14T09:40:08.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 -- 172.21.15.196:0/2097637810 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff408076290 msgr2=0x7ff4080787a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:08.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff408076290 0x7ff4080787a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff4180098e0 tx=0x7ff418009060 comp rx=0 tx=0).stop 2024-05-14T09:40:08.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 -- 172.21.15.196:0/2097637810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4280cdbb0 msgr2=0x7ff42814cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:08.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4280cdbb0 0x7ff42814cb90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c3a0 tx=0x7ff41400c860 comp rx=0 tx=0).stop 2024-05-14T09:40:08.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 -- 172.21.15.196:0/2097637810 shutdown_connections 2024-05-14T09:40:08.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff408076290 0x7ff4080787a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:08.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4281564f0 0x7ff4280b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:08.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4280cdbb0 0x7ff42814cb90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:08.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 --2- 172.21.15.196:0/2097637810 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff42806d6c0 0x7ff42814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:08.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 -- 172.21.15.196:0/2097637810 >> 172.21.15.196:0/2097637810 conn(0x7ff4280ce630 msgr2=0x7ff4280b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:08.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 -- 172.21.15.196:0/2097637810 shutdown_connections 2024-05-14T09:40:08.760 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-14T09:40:08.759+0000 7ff427200640 1 -- 172.21.15.196:0/2097637810 wait complete. 2024-05-14T09:40:08.789 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-14T09:40:08.790 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-05-14T09:40:08.797 INFO:tasks.ceph.osd.0:Started 2024-05-14T09:40:08.798 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-14T09:40:08.798 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-05-14T09:40:08.806 INFO:tasks.ceph.osd.1:Started 2024-05-14T09:40:08.806 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-14T09:40:08.806 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-05-14T09:40:08.811 INFO:tasks.ceph.osd.2:Started 2024-05-14T09:40:08.811 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-14T09:40:08.811 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-05-14T09:40:08.817 INFO:tasks.ceph.osd.3:Started 2024-05-14T09:40:08.817 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-14T09:40:08.817 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-05-14T09:40:08.822 INFO:tasks.ceph.osd.4:Started 2024-05-14T09:40:08.822 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-14T09:40:08.822 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-05-14T09:40:08.827 INFO:tasks.ceph.osd.5:Started 2024-05-14T09:40:08.827 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-14T09:40:08.828 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-05-14T09:40:08.832 INFO:tasks.ceph.osd.6:Started 2024-05-14T09:40:08.832 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-14T09:40:08.833 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-05-14T09:40:08.837 INFO:tasks.ceph.osd.7:Started 2024-05-14T09:40:08.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:40:09.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.187+0000 7f217bc00640 1 Processor -- start 2024-05-14T09:40:09.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.187+0000 7f217bc00640 1 -- start start 2024-05-14T09:40:09.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.188+0000 7f217bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174074810 0x7f2174154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:09.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.188+0000 7f217bc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f21740c84d0 0x7f21740c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:09.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.189+0000 7f217bc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217415b160 con 0x7f2174071fe0 2024-05-14T09:40:09.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.189+0000 7f217bc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f217415ac30 con 0x7f21740c84d0 2024-05-14T09:40:09.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.189+0000 7f217bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f217415ae80 con 0x7f2174074810 2024-05-14T09:40:09.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.190+0000 7f2173e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174074810 0x7f2174154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:09.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.190+0000 7f2179c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f21740c84d0 0x7f21740c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:09.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.190+0000 7f2173e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174074810 0x7f2174154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:39524/0 (socket says 172.21.15.135:39524) 2024-05-14T09:40:09.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.190+0000 7f2173e00640 1 -- 172.21.15.135:0/1683893751 learned_addr learned my addr 172.21.15.135:0/1683893751 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:09.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.194+0000 7f2173e00640 1 -- 172.21.15.135:0/1683893751 >> v2:172.21.15.196:3300/0 conn(0x7f21740c84d0 msgr2=0x7f21740c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:09.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.194+0000 7f2173e00640 1 --2- 172.21.15.135:0/1683893751 >> v2:172.21.15.196:3300/0 conn(0x7f21740c84d0 0x7f21740c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:09.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.194+0000 7f2173e00640 1 -- 172.21.15.135:0/1683893751 >> v1:172.21.15.196:6789/0 conn(0x7f2174071fe0 legacy=0x7f21740c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:09.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.194+0000 7f2173e00640 1 -- 172.21.15.135:0/1683893751 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21740c8ce0 con 0x7f2174074810 2024-05-14T09:40:09.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.197+0000 7f2173e00640 1 --2- 172.21.15.135:0/1683893751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174074810 0x7f2174154550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2160009870 tx=0x7f216002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953648df68fdd3b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:09.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.204+0000 7f2173400640 1 -- 172.21.15.135:0/1683893751 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160037070 con 0x7f2174074810 2024-05-14T09:40:09.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.204+0000 7f2173400640 1 -- 172.21.15.135:0/1683893751 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2160032440 con 0x7f2174074810 2024-05-14T09:40:09.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.204+0000 7f2173400640 1 -- 172.21.15.135:0/1683893751 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160032810 con 0x7f2174074810 2024-05-14T09:40:09.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.205+0000 7f217bc00640 1 -- 172.21.15.135:0/1683893751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174074810 msgr2=0x7f2174154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:09.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.205+0000 7f217bc00640 1 --2- 172.21.15.135:0/1683893751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174074810 0x7f2174154550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2160009870 tx=0x7f216002a250 comp rx=0 tx=0).stop 2024-05-14T09:40:09.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.205+0000 7f217bc00640 1 -- 172.21.15.135:0/1683893751 shutdown_connections 2024-05-14T09:40:09.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.205+0000 7f217bc00640 1 --2- 172.21.15.135:0/1683893751 >> v2:172.21.15.196:3300/0 conn(0x7f21740c84d0 0x7f21740c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:09.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.205+0000 7f217bc00640 1 --2- 172.21.15.135:0/1683893751 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174074810 0x7f2174154550 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:09.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.205+0000 7f217bc00640 1 -- 172.21.15.135:0/1683893751 >> 172.21.15.135:0/1683893751 conn(0x7f2174073cf0 msgr2=0x7f2174074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:09.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.205+0000 7f217bc00640 1 -- 172.21.15.135:0/1683893751 shutdown_connections 2024-05-14T09:40:09.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.205+0000 7f217bc00640 1 -- 172.21.15.135:0/1683893751 wait complete. 2024-05-14T09:40:09.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.207+0000 7f217bc00640 1 Processor -- start 2024-05-14T09:40:09.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.207+0000 7f217bc00640 1 -- start start 2024-05-14T09:40:09.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.209+0000 7f217bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174071fe0 0x7f217415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:09.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.209+0000 7f217bc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2174074810 0x7f217415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:09.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.209+0000 7f217bc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21740c84d0 0x7f217414cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:09.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.209+0000 7f217bc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21740c88e0 con 0x7f21740c84d0 2024-05-14T09:40:09.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.209+0000 7f217bc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f21740c92a0 con 0x7f2174074810 2024-05-14T09:40:09.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.209+0000 7f217bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f217406c6f0 con 0x7f2174071fe0 2024-05-14T09:40:09.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.210+0000 7f2173e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2174074810 0x7f217415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:09.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.210+0000 7f2179200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174071fe0 0x7f217415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:09.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.211+0000 7f2173e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2174074810 0x7f217415ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:38388/0 (socket says 172.21.15.135:38388) 2024-05-14T09:40:09.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.211+0000 7f2173e00640 1 -- 172.21.15.135:0/2002481739 learned_addr learned my addr 172.21.15.135:0/2002481739 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:09.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.217+0000 7f2173e00640 1 -- 172.21.15.135:0/2002481739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174071fe0 msgr2=0x7f217415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:09.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.217+0000 7f2173e00640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174071fe0 0x7f217415cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:09.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.217+0000 7f2173e00640 1 -- 172.21.15.135:0/2002481739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21740c84d0 msgr2=0x7f217414cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:09.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.217+0000 7f2173e00640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21740c84d0 0x7f217414cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:09.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.217+0000 7f2173e00640 1 -- 172.21.15.135:0/2002481739 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21741f5f00 con 0x7f2174074810 2024-05-14T09:40:09.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.221+0000 7f2173e00640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2174074810 0x7f217415ba30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2160009990 tx=0x7f21600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:09.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.229+0000 7f2170c00640 1 -- 172.21.15.135:0/2002481739 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160037040 con 0x7f2174074810 2024-05-14T09:40:09.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.229+0000 7f2170c00640 1 -- 172.21.15.135:0/2002481739 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2160042070 con 0x7f2174074810 2024-05-14T09:40:09.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.229+0000 7f217bc00640 1 -- 172.21.15.135:0/2002481739 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217415bf70 con 0x7f2174074810 2024-05-14T09:40:09.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.229+0000 7f2170c00640 1 -- 172.21.15.135:0/2002481739 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216003b930 con 0x7f2174074810 2024-05-14T09:40:09.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.229+0000 7f217bc00640 1 -- 172.21.15.135:0/2002481739 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217415e300 con 0x7f2174074810 2024-05-14T09:40:09.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.230+0000 7f217bc00640 1 -- 172.21.15.135:0/2002481739 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2174069a90 con 0x7f2174074810 2024-05-14T09:40:09.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.602+0000 7f2170c00640 1 -- 172.21.15.135:0/2002481739 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f216003bad0 con 0x7f2174074810 2024-05-14T09:40:09.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.603+0000 7f2170c00640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2154076290 0x7f21540787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:09.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.604+0000 7f2179200640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2154076290 0x7f21540787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:09.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.606+0000 7f2179200640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2154076290 0x7f21540787a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2168000f60 tx=0x7f2168009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:09.607 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-05-14T09:40:09.608+0000 7fde58e1e640 -1 Falling back to public interface 2024-05-14T09:40:09.621 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-05-14T09:40:09.621+0000 7f30261dc640 -1 Falling back to public interface 2024-05-14T09:40:09.639 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-14T09:40:09.639+0000 7f947980d640 -1 Falling back to public interface 2024-05-14T09:40:09.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.648+0000 7f2170c00640 1 -- 172.21.15.135:0/2002481739 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f21600804b0 con 0x7f2174074810 2024-05-14T09:40:09.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.650+0000 7f2170c00640 1 -- 172.21.15.135:0/2002481739 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2160082110 con 0x7f2174074810 2024-05-14T09:40:09.665 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-05-14T09:40:09.663+0000 7fdbcb613640 -1 Falling back to public interface 2024-05-14T09:40:09.666 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-14T09:40:09.666+0000 7fbf821cb640 -1 Falling back to public interface 2024-05-14T09:40:09.667 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-05-14T09:40:09.667+0000 7fb8a72af640 -1 Falling back to public interface 2024-05-14T09:40:09.673 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-05-14T09:40:09.673+0000 7fa4dee0c640 -1 Falling back to public interface 2024-05-14T09:40:09.691 INFO:tasks.ceph.osd.2.smithi135.stderr:2024-05-14T09:40:09.691+0000 7fb952f21640 -1 Falling back to public interface 2024-05-14T09:40:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.856+0000 7f217bc00640 1 -- 172.21.15.135:0/2002481739 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21740b91c0 con 0x7f2174074810 2024-05-14T09:40:09.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.962+0000 7f2170c00640 1 -- 172.21.15.135:0/2002481739 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f216008a100 con 0x7f2174074810 2024-05-14T09:40:09.963 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:40:09.963 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":10,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:40:08.507187+0000","last_up_change":"0.000000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:40:09.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 -- 172.21.15.135:0/2002481739 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2154076290 msgr2=0x7f21540787a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:09.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2154076290 0x7f21540787a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2168000f60 tx=0x7f2168009040 comp rx=0 tx=0).stop 2024-05-14T09:40:09.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 -- 172.21.15.135:0/2002481739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2174074810 msgr2=0x7f217415ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:09.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2174074810 0x7f217415ba30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2160009990 tx=0x7f21600046c0 comp rx=0 tx=0).stop 2024-05-14T09:40:09.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 -- 172.21.15.135:0/2002481739 shutdown_connections 2024-05-14T09:40:09.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2154076290 0x7f21540787a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:09.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2174074810 0x7f217415ba30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:09.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21740c84d0 0x7f217414cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:09.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 --2- 172.21.15.135:0/2002481739 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2174071fe0 0x7f217415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:09.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 -- 172.21.15.135:0/2002481739 >> 172.21.15.135:0/2002481739 conn(0x7f2174073cf0 msgr2=0x7f217414dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:09.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 -- 172.21.15.135:0/2002481739 shutdown_connections 2024-05-14T09:40:09.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:09.965+0000 7f217bc00640 1 -- 172.21.15.135:0/2002481739 wait complete. 2024-05-14T09:40:09.989 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-14T09:40:09.990 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-14T09:40:10.796 DEBUG:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-14T09:40:11.028 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.028+0000 7f9cd8a00640 1 Processor -- start 2024-05-14T09:40:11.028 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.028+0000 7f9cd8a00640 1 -- start start 2024-05-14T09:40:11.032 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.032+0000 7f9cd8a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9cd4071f80 0x7f9cd4153520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:11.033 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.032+0000 7f9cd8a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9cd40c5220 0x7f9cd40c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:11.033 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.032+0000 7f9cd8a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd4159c70 con 0x7f9cd40c4bd0 2024-05-14T09:40:11.033 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.032+0000 7f9cd8a00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd40c5b10 con 0x7f9cd40c5220 2024-05-14T09:40:11.033 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.033+0000 7f9cd8a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd415a1f0 con 0x7f9cd4071f80 2024-05-14T09:40:11.098 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.098+0000 7f9cd1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9cd4071f80 0x7f9cd4153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:11.099 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.099+0000 7f9cd1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9cd4071f80 0x7f9cd4153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:39548/0 (socket says 172.21.15.135:39548) 2024-05-14T09:40:11.099 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.099+0000 7f9cd1400640 1 -- 172.21.15.135:0/3558579492 learned_addr learned my addr 172.21.15.135:0/3558579492 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:11.099 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.100+0000 7f9cd2800640 1 --2- 172.21.15.135:0/3558579492 >> v2:172.21.15.135:3300/0 conn(0x7f9cd40c5220 0x7f9cd40c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:11.103 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.103+0000 7f9cd2800640 1 -- 172.21.15.135:0/3558579492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9cd4071f80 msgr2=0x7f9cd4153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:11.103 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.103+0000 7f9cd2800640 1 --2- 172.21.15.135:0/3558579492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9cd4071f80 0x7f9cd4153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:11.103 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.103+0000 7f9cd2800640 1 -- 172.21.15.135:0/3558579492 >> v1:172.21.15.196:6789/0 conn(0x7f9cd40c4bd0 legacy=0x7f9cd4070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:11.103 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.103+0000 7f9cd2800640 1 -- 172.21.15.135:0/3558579492 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd4159f10 con 0x7f9cd40c5220 2024-05-14T09:40:11.105 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.106+0000 7f9cd2800640 1 --2- 172.21.15.135:0/3558579492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd40c5220 0x7f9cd40c5fa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009d90 tx=0x7f9ccc02a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf79340cfeda2d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:11.112 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.112+0000 7f9cd0a00640 1 -- 172.21.15.135:0/3558579492 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc007740 con 0x7f9cd40c5220 2024-05-14T09:40:11.112 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.112+0000 7f9cd0a00640 1 -- 172.21.15.135:0/3558579492 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc0078e0 con 0x7f9cd40c5220 2024-05-14T09:40:11.112 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.112+0000 7f9cd0a00640 1 -- 172.21.15.135:0/3558579492 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc007cb0 con 0x7f9cd40c5220 2024-05-14T09:40:11.114 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.114+0000 7f9cd8a00640 1 -- 172.21.15.135:0/3558579492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd40c5220 msgr2=0x7f9cd40c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:11.114 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.114+0000 7f9cd8a00640 1 --2- 172.21.15.135:0/3558579492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd40c5220 0x7f9cd40c5fa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009d90 tx=0x7f9ccc02a5b0 comp rx=0 tx=0).stop 2024-05-14T09:40:11.115 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.114+0000 7f9cd8a00640 1 -- 172.21.15.135:0/3558579492 shutdown_connections 2024-05-14T09:40:11.115 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.114+0000 7f9cd8a00640 1 --2- 172.21.15.135:0/3558579492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd40c5220 0x7f9cd40c5fa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:11.115 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.114+0000 7f9cd8a00640 1 --2- 172.21.15.135:0/3558579492 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9cd4071f80 0x7f9cd4153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:11.115 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.114+0000 7f9cd8a00640 1 -- 172.21.15.135:0/3558579492 >> 172.21.15.135:0/3558579492 conn(0x7f9cd40ca530 msgr2=0x7f9cd40ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:11.115 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.114+0000 7f9cd8a00640 1 -- 172.21.15.135:0/3558579492 shutdown_connections 2024-05-14T09:40:11.115 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.114+0000 7f9cd8a00640 1 -- 172.21.15.135:0/3558579492 wait complete. 2024-05-14T09:40:11.118 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.118+0000 7f9cd8a00640 1 Processor -- start 2024-05-14T09:40:11.118 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.118+0000 7f9cd8a00640 1 -- start start 2024-05-14T09:40:11.121 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.121+0000 7f9cd8a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9cd4071f80 0x7f9cd415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:11.122 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.121+0000 7f9cd8a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9cd40c4bd0 0x7f9cd41f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:11.122 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.121+0000 7f9cd8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd40c5220 0x7f9cd414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:11.122 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.122+0000 7f9cd8a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd40716e0 con 0x7f9cd40c5220 2024-05-14T09:40:11.122 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.122+0000 7f9cd8a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd40c9d40 con 0x7f9cd4071f80 2024-05-14T09:40:11.122 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.122+0000 7f9cd8a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd4071860 con 0x7f9cd40c4bd0 2024-05-14T09:40:11.122 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.123+0000 7f9cd2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd40c5220 0x7f9cd414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:11.123 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.123+0000 7f9cd1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9cd40c4bd0 0x7f9cd41f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:11.123 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.123+0000 7f9cd2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd40c5220 0x7f9cd414f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53782/0 (socket says 172.21.15.135:53782) 2024-05-14T09:40:11.123 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.123+0000 7f9cd2800640 1 -- 172.21.15.135:0/2213675876 learned_addr learned my addr 172.21.15.135:0/2213675876 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:11.127 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.127+0000 7f9cd2800640 1 -- 172.21.15.135:0/2213675876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9cd40c4bd0 msgr2=0x7f9cd41f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:11.128 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.127+0000 7f9cd2800640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9cd40c4bd0 0x7f9cd41f2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:11.128 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.127+0000 7f9cd2800640 1 -- 172.21.15.135:0/2213675876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9cd4071f80 msgr2=0x7f9cd415a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:11.128 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.127+0000 7f9cd2800640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9cd4071f80 0x7f9cd415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:11.128 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.127+0000 7f9cd2800640 1 -- 172.21.15.135:0/2213675876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd415bef0 con 0x7f9cd40c5220 2024-05-14T09:40:11.130 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.130+0000 7f9cd2800640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd40c5220 0x7f9cd414f530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009d90 tx=0x7f9ccc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:11.134 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.134+0000 7f9cca000640 1 -- 172.21.15.135:0/2213675876 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc03f070 con 0x7f9cd40c5220 2024-05-14T09:40:11.134 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.134+0000 7f9cd8a00640 1 -- 172.21.15.135:0/2213675876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd41568b0 con 0x7f9cd40c5220 2024-05-14T09:40:11.135 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.134+0000 7f9cd8a00640 1 -- 172.21.15.135:0/2213675876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd41f26e0 con 0x7f9cd40c5220 2024-05-14T09:40:11.135 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.134+0000 7f9cca000640 1 -- 172.21.15.135:0/2213675876 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc031b40 con 0x7f9cd40c5220 2024-05-14T09:40:11.135 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.135+0000 7f9cca000640 1 -- 172.21.15.135:0/2213675876 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc031cf0 con 0x7f9cd40c5220 2024-05-14T09:40:11.136 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.137+0000 7f9cd8a00640 1 -- 172.21.15.135:0/2213675876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd415c0c0 con 0x7f9cd40c5220 2024-05-14T09:40:11.173 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.173+0000 7f9cca000640 1 -- 172.21.15.135:0/2213675876 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f9ccc043410 con 0x7f9cd40c5220 2024-05-14T09:40:11.174 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.174+0000 7f9cca000640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9cb4076240 0x7f9cb4078750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:11.174 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.175+0000 7f9cd1e00640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9cb4076240 0x7f9cb4078750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:11.176 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.176+0000 7f9cd1e00640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9cb4076240 0x7f9cb4078750 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009650 tx=0x7f9cc4006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:11.585 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.585+0000 7f9cca000640 1 -- 172.21.15.135:0/2213675876 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9ccc0b74b0 con 0x7f9cd40c5220 2024-05-14T09:40:11.586 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.586+0000 7f9cca000640 1 -- 172.21.15.135:0/2213675876 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9ccc051080 con 0x7f9cd40c5220 2024-05-14T09:40:11.821 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.821+0000 7f9cd8a00640 1 -- 172.21.15.135:0/2213675876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9cd4069b00 con 0x7f9cd40c5220 2024-05-14T09:40:11.884 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.883+0000 7f9cca000640 1 -- 172.21.15.135:0/2213675876 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9ccc082820 con 0x7f9cd40c5220 2024-05-14T09:40:11.884 INFO:teuthology.misc.health.smithi135.stdout: 2024-05-14T09:40:11.884 INFO:teuthology.misc.health.smithi135.stdout:{"epoch":10,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:40:08.507187+0000","last_up_change":"0.000000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:40:11.888 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.887+0000 7f9cd8a00640 1 -- 172.21.15.135:0/2213675876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9cb4076240 msgr2=0x7f9cb4078750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:11.888 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.887+0000 7f9cd8a00640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9cb4076240 0x7f9cb4078750 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009650 tx=0x7f9cc4006ba0 comp rx=0 tx=0).stop 2024-05-14T09:40:11.888 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.887+0000 7f9cd8a00640 1 -- 172.21.15.135:0/2213675876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd40c5220 msgr2=0x7f9cd414f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:11.888 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.887+0000 7f9cd8a00640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd40c5220 0x7f9cd414f530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009d90 tx=0x7f9ccc004a40 comp rx=0 tx=0).stop 2024-05-14T09:40:11.888 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.887+0000 7f9cd8a00640 1 -- 172.21.15.135:0/2213675876 shutdown_connections 2024-05-14T09:40:11.888 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.887+0000 7f9cd8a00640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9cb4076240 0x7f9cb4078750 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:11.889 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.887+0000 7f9cd8a00640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd40c5220 0x7f9cd414f530 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:11.889 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.887+0000 7f9cd8a00640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9cd40c4bd0 0x7f9cd41f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:11.889 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.887+0000 7f9cd8a00640 1 --2- 172.21.15.135:0/2213675876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9cd4071f80 0x7f9cd415a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:11.889 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.887+0000 7f9cd8a00640 1 -- 172.21.15.135:0/2213675876 >> 172.21.15.135:0/2213675876 conn(0x7f9cd40ca530 msgr2=0x7f9cd40c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:11.889 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.888+0000 7f9cd8a00640 1 -- 172.21.15.135:0/2213675876 shutdown_connections 2024-05-14T09:40:11.889 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:11.888+0000 7f9cd8a00640 1 -- 172.21.15.135:0/2213675876 wait complete. 2024-05-14T09:40:11.910 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-14T09:40:13.252 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-14T09:40:13.252+0000 7fbf821cb640 -1 osd.1 0 log_to_monitors true 2024-05-14T09:40:13.301 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-05-14T09:40:13.302+0000 7fdbcb613640 -1 osd.5 0 log_to_monitors true 2024-05-14T09:40:13.332 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-05-14T09:40:13.333+0000 7fa4dee0c640 -1 osd.6 0 log_to_monitors true 2024-05-14T09:40:13.387 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-05-14T09:40:13.387+0000 7fb8a72af640 -1 osd.4 0 log_to_monitors true 2024-05-14T09:40:13.450 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-05-14T09:40:13.450+0000 7fde58e1e640 -1 osd.3 0 log_to_monitors true 2024-05-14T09:40:13.469 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-05-14T09:40:13.469+0000 7f30261dc640 -1 osd.7 0 log_to_monitors true 2024-05-14T09:40:13.504 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-14T09:40:13.504+0000 7f947980d640 -1 osd.0 0 log_to_monitors true 2024-05-14T09:40:13.578 INFO:tasks.ceph.osd.2.smithi135.stderr:2024-05-14T09:40:13.578+0000 7fb952f21640 -1 osd.2 0 log_to_monitors true 2024-05-14T09:40:15.922 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-05-14T09:40:15.922+0000 7fdbc6800640 -1 osd.5 0 waiting for initial osdmap 2024-05-14T09:40:15.984 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-05-14T09:40:15.984+0000 7fdbbbe00640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:40:15.994 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-14T09:40:15.994+0000 7fbf7da00640 -1 osd.1 0 waiting for initial osdmap 2024-05-14T09:40:16.200 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-14T09:40:16.200+0000 7fbf73000640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:40:17.445 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-05-14T09:40:17.446+0000 7f3021000640 -1 osd.7 0 waiting for initial osdmap 2024-05-14T09:40:17.460 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-05-14T09:40:17.461+0000 7f3017000640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:40:17.542 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-14T09:40:17.542+0000 7f9474c00640 -1 osd.0 0 waiting for initial osdmap 2024-05-14T09:40:17.554 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-05-14T09:40:17.554+0000 7fde54200640 -1 osd.3 0 waiting for initial osdmap 2024-05-14T09:40:17.628 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-05-14T09:40:17.628+0000 7fa4d9600640 -1 osd.6 0 waiting for initial osdmap 2024-05-14T09:40:17.655 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-05-14T09:40:17.656+0000 7fb8a2200640 -1 osd.4 0 waiting for initial osdmap 2024-05-14T09:40:17.656 INFO:tasks.ceph.osd.2.smithi135.stderr:2024-05-14T09:40:17.657+0000 7fb94de00640 -1 osd.2 0 waiting for initial osdmap 2024-05-14T09:40:17.667 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-14T09:40:17.667+0000 7f946a200640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:40:17.670 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-05-14T09:40:17.671+0000 7fde49800640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:40:17.697 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-05-14T09:40:17.697+0000 7fa4cf600640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:40:17.701 INFO:tasks.ceph.osd.2.smithi135.stderr:2024-05-14T09:40:17.701+0000 7fb943e00640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:40:17.741 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-05-14T09:40:17.741+0000 7fb898200640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T09:40:18.717 DEBUG:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-14T09:40:18.972 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.971+0000 7ffa5b800640 1 Processor -- start 2024-05-14T09:40:18.972 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.972+0000 7ffa5b800640 1 -- start start 2024-05-14T09:40:18.974 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.974+0000 7ffa5b800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffa5406dc20 0x7ffa54156750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:18.974 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.974+0000 7ffa5b800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa540c8840 0x7ffa5415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:18.974 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.974+0000 7ffa5b800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa5415d410 con 0x7ffa5406c6f0 2024-05-14T09:40:18.974 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.974+0000 7ffa5b800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ffa54156c90 con 0x7ffa5406dc20 2024-05-14T09:40:18.974 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.974+0000 7ffa5b800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffa540c8420 con 0x7ffa540c8840 2024-05-14T09:40:18.976 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.976+0000 7ffa53e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa540c8840 0x7ffa5415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:18.976 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.977+0000 7ffa53e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa540c8840 0x7ffa5415ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38328/0 (socket says 172.21.15.135:38328) 2024-05-14T09:40:18.976 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.977+0000 7ffa53e00640 1 -- 172.21.15.135:0/3290064895 learned_addr learned my addr 172.21.15.135:0/3290064895 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:18.984 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.983+0000 7ffa53e00640 1 -- 172.21.15.135:0/3290064895 >> v2:172.21.15.196:3300/0 conn(0x7ffa5406dc20 msgr2=0x7ffa54156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:18.984 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.983+0000 7ffa53e00640 1 --2- 172.21.15.135:0/3290064895 >> v2:172.21.15.196:3300/0 conn(0x7ffa5406dc20 0x7ffa54156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:18.984 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.983+0000 7ffa53e00640 1 -- 172.21.15.135:0/3290064895 >> v1:172.21.15.196:6789/0 conn(0x7ffa5406c6f0 legacy=0x7ffa54070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:18.984 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.983+0000 7ffa53e00640 1 -- 172.21.15.135:0/3290064895 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa540c9790 con 0x7ffa540c8840 2024-05-14T09:40:18.989 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:18.989+0000 7ffa53e00640 1 --2- 172.21.15.135:0/3290064895 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa540c8840 0x7ffa5415ced0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009e50 tx=0x7ffa3c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81506ca108d819ba server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:19.000 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.000+0000 7ffa53400640 1 -- 172.21.15.135:0/3290064895 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c036070 con 0x7ffa540c8840 2024-05-14T09:40:19.000 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.000+0000 7ffa53400640 1 -- 172.21.15.135:0/3290064895 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa3c031600 con 0x7ffa540c8840 2024-05-14T09:40:19.000 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.000+0000 7ffa53400640 1 -- 172.21.15.135:0/3290064895 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0319d0 con 0x7ffa540c8840 2024-05-14T09:40:19.002 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.001+0000 7ffa5b800640 1 -- 172.21.15.135:0/3290064895 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa540c8840 msgr2=0x7ffa5415ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:19.002 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.001+0000 7ffa5b800640 1 --2- 172.21.15.135:0/3290064895 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa540c8840 0x7ffa5415ced0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009e50 tx=0x7ffa3c02a680 comp rx=0 tx=0).stop 2024-05-14T09:40:19.002 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.002+0000 7ffa5b800640 1 -- 172.21.15.135:0/3290064895 shutdown_connections 2024-05-14T09:40:19.002 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.002+0000 7ffa5b800640 1 --2- 172.21.15.135:0/3290064895 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa540c8840 0x7ffa5415ced0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:19.002 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.002+0000 7ffa5b800640 1 --2- 172.21.15.135:0/3290064895 >> v2:172.21.15.196:3300/0 conn(0x7ffa5406dc20 0x7ffa54156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:19.002 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.002+0000 7ffa5b800640 1 -- 172.21.15.135:0/3290064895 >> 172.21.15.135:0/3290064895 conn(0x7ffa540ca530 msgr2=0x7ffa540ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:19.002 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.002+0000 7ffa5b800640 1 -- 172.21.15.135:0/3290064895 shutdown_connections 2024-05-14T09:40:19.002 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.002+0000 7ffa5b800640 1 -- 172.21.15.135:0/3290064895 wait complete. 2024-05-14T09:40:19.005 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.006+0000 7ffa5b800640 1 Processor -- start 2024-05-14T09:40:19.006 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.006+0000 7ffa5b800640 1 -- start start 2024-05-14T09:40:19.008 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.008+0000 7ffa5b800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa5406c6f0 0x7ffa5414dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:19.008 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.008+0000 7ffa5b800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa5406dc20 0x7ffa5415fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:19.008 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.008+0000 7ffa5b800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa540c8840 0x7ffa54160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:19.009 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.008+0000 7ffa5b800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5415c6d0 con 0x7ffa540c8840 2024-05-14T09:40:19.009 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.008+0000 7ffa5b800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa540c9d30 con 0x7ffa5406c6f0 2024-05-14T09:40:19.009 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.008+0000 7ffa5b800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffa54072200 con 0x7ffa5406dc20 2024-05-14T09:40:19.009 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.009+0000 7ffa59800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa540c8840 0x7ffa54160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:19.010 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.010+0000 7ffa59800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa540c8840 0x7ffa54160320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60362/0 (socket says 172.21.15.135:60362) 2024-05-14T09:40:19.010 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.010+0000 7ffa59800640 1 -- 172.21.15.135:0/2017255978 learned_addr learned my addr 172.21.15.135:0/2017255978 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:19.010 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.011+0000 7ffa53e00640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa5406dc20 0x7ffa5415fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:19.015 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.015+0000 7ffa59800640 1 -- 172.21.15.135:0/2017255978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa5406dc20 msgr2=0x7ffa5415fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:19.015 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.015+0000 7ffa59800640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa5406dc20 0x7ffa5415fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:19.015 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.015+0000 7ffa59800640 1 -- 172.21.15.135:0/2017255978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa5406c6f0 msgr2=0x7ffa5414dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:19.015 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.015+0000 7ffa59800640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa5406c6f0 0x7ffa5414dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:19.015 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.015+0000 7ffa59800640 1 -- 172.21.15.135:0/2017255978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5414e280 con 0x7ffa540c8840 2024-05-14T09:40:19.020 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.020+0000 7ffa59800640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa540c8840 0x7ffa54160320 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00b440 tx=0x7ffa4c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:19.028 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.028+0000 7ffa50c00640 1 -- 172.21.15.135:0/2017255978 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c015020 con 0x7ffa540c8840 2024-05-14T09:40:19.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.028+0000 7ffa50c00640 1 -- 172.21.15.135:0/2017255978 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c011850 con 0x7ffa540c8840 2024-05-14T09:40:19.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.028+0000 7ffa50c00640 1 -- 172.21.15.135:0/2017255978 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c011c40 con 0x7ffa540c8840 2024-05-14T09:40:19.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.028+0000 7ffa5b800640 1 -- 172.21.15.135:0/2017255978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5415d680 con 0x7ffa540c8840 2024-05-14T09:40:19.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.029+0000 7ffa5b800640 1 -- 172.21.15.135:0/2017255978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa5414b960 con 0x7ffa540c8840 2024-05-14T09:40:19.030 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.030+0000 7ffa5b800640 1 -- 172.21.15.135:0/2017255978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa54069b00 con 0x7ffa540c8840 2024-05-14T09:40:19.367 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.367+0000 7ffa50c00640 1 -- 172.21.15.135:0/2017255978 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7ffa4c018020 con 0x7ffa540c8840 2024-05-14T09:40:19.368 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.369+0000 7ffa50c00640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa300762c0 0x7ffa300787d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:19.369 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.369+0000 7ffa58e00640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa300762c0 0x7ffa300787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:19.371 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.371+0000 7ffa58e00640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa300762c0 0x7ffa300787d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009670 tx=0x7ffa44006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:19.408 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.407+0000 7ffa50c00640 1 -- 172.21.15.135:0/2017255978 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3446+0+0 (secure 0 0 0) 0x7ffa4c011de0 con 0x7ffa540c8840 2024-05-14T09:40:19.409 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.409+0000 7ffa50c00640 1 -- 172.21.15.135:0/2017255978 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffa4c01f070 con 0x7ffa540c8840 2024-05-14T09:40:19.629 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:19.629+0000 7ffa5b800640 1 -- 172.21.15.135:0/2017255978 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa540c47c0 con 0x7ffa540c8840 2024-05-14T09:40:20.124 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.124+0000 7ffa50c00640 1 -- 172.21.15.135:0/2017255978 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10427 (secure 0 0 0) 0x7ffa4c060f40 con 0x7ffa540c8840 2024-05-14T09:40:20.125 INFO:teuthology.misc.health.smithi135.stdout: 2024-05-14T09:40:20.125 INFO:teuthology.misc.health.smithi135.stdout:{"epoch":15,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:40:17.767400+0000","last_up_change":"2024-05-14T09:40:17.767400+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":7.690000057220459,"score_stable":7.690000057220459,"optimal_score":0.12999999523162842,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:40:20.128 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 -- 172.21.15.135:0/2017255978 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa300762c0 msgr2=0x7ffa300787d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:20.129 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa300762c0 0x7ffa300787d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009670 tx=0x7ffa44006bf0 comp rx=0 tx=0).stop 2024-05-14T09:40:20.129 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 -- 172.21.15.135:0/2017255978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa540c8840 msgr2=0x7ffa54160320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:20.129 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa540c8840 0x7ffa54160320 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00b440 tx=0x7ffa4c00b900 comp rx=0 tx=0).stop 2024-05-14T09:40:20.129 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 -- 172.21.15.135:0/2017255978 shutdown_connections 2024-05-14T09:40:20.129 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa300762c0 0x7ffa300787d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:20.129 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa540c8840 0x7ffa54160320 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:20.129 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa5406dc20 0x7ffa5415fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:20.129 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 --2- 172.21.15.135:0/2017255978 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa5406c6f0 0x7ffa5414dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:20.129 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 -- 172.21.15.135:0/2017255978 >> 172.21.15.135:0/2017255978 conn(0x7ffa540ca530 msgr2=0x7ffa540c4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:20.129 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 -- 172.21.15.135:0/2017255978 shutdown_connections 2024-05-14T09:40:20.129 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:20.128+0000 7ffa5b800640 1 -- 172.21.15.135:0/2017255978 wait complete. 2024-05-14T09:40:20.152 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-05-14T09:40:22.820 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:40:22.828 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:40:26.958 DEBUG:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-14T09:40:27.202 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.201+0000 7f07dfe00640 1 Processor -- start 2024-05-14T09:40:27.202 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.202+0000 7f07dfe00640 1 -- start start 2024-05-14T09:40:27.204 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.204+0000 7f07dfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e0156370 0x7f07e015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:27.204 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.204+0000 7f07dfe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f07e015c820 0x7f07e00c5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:27.204 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.204+0000 7f07dfe00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e00c7580 con 0x7f07e0156780 2024-05-14T09:40:27.204 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.204+0000 7f07dfe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f07e00c80f0 con 0x7f07e015c820 2024-05-14T09:40:27.204 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.204+0000 7f07dfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f07e00c7e10 con 0x7f07e0156370 2024-05-14T09:40:27.205 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.205+0000 7f07de000640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f07e0156780 0x7f07e00c4910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:45060/0 (socket says 172.21.15.135:45060) 2024-05-14T09:40:27.205 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.205+0000 7f07de000640 1 -- 172.21.15.135:0/1121103556 learned_addr learned my addr 172.21.15.135:0/1121103556 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:40:27.206 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.206+0000 7f07df400640 1 --2- 172.21.15.135:0/1121103556 >> v2:172.21.15.196:3300/0 conn(0x7f07e015c820 0x7f07e00c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:27.207 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.207+0000 7f07dea00640 1 --2- 172.21.15.135:0/1121103556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e0156370 0x7f07e015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:27.210 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.210+0000 7f07dd600640 1 -- 172.21.15.135:0/1121103556 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677181507 0 0) 0x7f07e00c7580 con 0x7f07e0156780 2024-05-14T09:40:27.210 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.210+0000 7f07dd600640 1 -- 172.21.15.135:0/1121103556 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07c4003520 con 0x7f07e0156780 2024-05-14T09:40:27.214 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.214+0000 7f07df400640 1 -- 172.21.15.135:0/1121103556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e0156370 msgr2=0x7f07e015c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:27.214 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.214+0000 7f07df400640 1 --2- 172.21.15.135:0/1121103556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e0156370 0x7f07e015c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:27.214 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.214+0000 7f07df400640 1 -- 172.21.15.135:0/1121103556 >> v1:172.21.15.135:6789/0 conn(0x7f07e0156780 legacy=0x7f07e00c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:27.215 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.214+0000 7f07df400640 1 -- 172.21.15.135:0/1121103556 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e00c95f0 con 0x7f07e015c820 2024-05-14T09:40:27.219 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.219+0000 7f07df400640 1 --2- 172.21.15.135:0/1121103556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07e015c820 0x7f07e00c5020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009d90 tx=0x7f07d802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b121ed5b905e049 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:27.231 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.231+0000 7f07dd600640 1 -- 172.21.15.135:0/1121103556 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8007740 con 0x7f07e015c820 2024-05-14T09:40:27.231 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.231+0000 7f07dd600640 1 -- 172.21.15.135:0/1121103556 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d80078e0 con 0x7f07e015c820 2024-05-14T09:40:27.231 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.231+0000 7f07dd600640 1 -- 172.21.15.135:0/1121103556 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8007cb0 con 0x7f07e015c820 2024-05-14T09:40:27.233 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.232+0000 7f07dfe00640 1 -- 172.21.15.135:0/1121103556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07e015c820 msgr2=0x7f07e00c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:27.233 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.232+0000 7f07dfe00640 1 --2- 172.21.15.135:0/1121103556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07e015c820 0x7f07e00c5020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009d90 tx=0x7f07d802a660 comp rx=0 tx=0).stop 2024-05-14T09:40:27.233 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.232+0000 7f07dfe00640 1 -- 172.21.15.135:0/1121103556 shutdown_connections 2024-05-14T09:40:27.233 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.232+0000 7f07dfe00640 1 --2- 172.21.15.135:0/1121103556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07e015c820 0x7f07e00c5020 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:27.233 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.232+0000 7f07dfe00640 1 --2- 172.21.15.135:0/1121103556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e0156370 0x7f07e015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:27.234 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.232+0000 7f07dfe00640 1 -- 172.21.15.135:0/1121103556 >> 172.21.15.135:0/1121103556 conn(0x7f07e00c9f10 msgr2=0x7f07e00ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:27.234 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.232+0000 7f07dfe00640 1 -- 172.21.15.135:0/1121103556 shutdown_connections 2024-05-14T09:40:27.234 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.232+0000 7f07dfe00640 1 -- 172.21.15.135:0/1121103556 wait complete. 2024-05-14T09:40:27.235 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.235+0000 7f07dfe00640 1 Processor -- start 2024-05-14T09:40:27.235 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.235+0000 7f07dfe00640 1 -- start start 2024-05-14T09:40:27.237 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.237+0000 7f07dfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e0156370 0x7f07e01592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:27.237 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.237+0000 7f07dfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07e0156780 0x7f07e015fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:27.237 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.237+0000 7f07dfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e015c820 0x7f07e01e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:27.238 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.237+0000 7f07dfe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07e00c5560 con 0x7f07e015c820 2024-05-14T09:40:27.238 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.237+0000 7f07dfe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f07e0071be0 con 0x7f07e0156780 2024-05-14T09:40:27.238 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.237+0000 7f07dfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f07e015cc30 con 0x7f07e0156370 2024-05-14T09:40:27.238 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.238+0000 7f07de000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07e0156780 0x7f07e015fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:27.240 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.239+0000 7f07dea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e0156370 0x7f07e01592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:27.240 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.239+0000 7f07de000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07e0156780 0x7f07e015fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:42434/0 (socket says 172.21.15.135:42434) 2024-05-14T09:40:27.240 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.239+0000 7f07de000640 1 -- 172.21.15.135:0/3551311944 learned_addr learned my addr 172.21.15.135:0/3551311944 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:27.251 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.251+0000 7f07de000640 1 -- 172.21.15.135:0/3551311944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e0156370 msgr2=0x7f07e01592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:27.251 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.251+0000 7f07de000640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e0156370 0x7f07e01592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:27.251 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.251+0000 7f07de000640 1 -- 172.21.15.135:0/3551311944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e015c820 msgr2=0x7f07e01e8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:27.251 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.251+0000 7f07de000640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e015c820 0x7f07e01e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:27.252 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.251+0000 7f07de000640 1 -- 172.21.15.135:0/3551311944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e0159820 con 0x7f07e0156780 2024-05-14T09:40:27.257 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.257+0000 7f07de000640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07e0156780 0x7f07e015fa60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f07c800c430 tx=0x7f07c800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:27.268 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.267+0000 7f07d6a00640 1 -- 172.21.15.135:0/3551311944 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c8017070 con 0x7f07e0156780 2024-05-14T09:40:27.268 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.267+0000 7f07d6a00640 1 -- 172.21.15.135:0/3551311944 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c8005ce0 con 0x7f07e0156780 2024-05-14T09:40:27.268 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.267+0000 7f07d6a00640 1 -- 172.21.15.135:0/3551311944 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c80072d0 con 0x7f07e0156780 2024-05-14T09:40:27.269 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.267+0000 7f07dfe00640 1 -- 172.21.15.135:0/3551311944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e01544c0 con 0x7f07e0156780 2024-05-14T09:40:27.269 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.268+0000 7f07dfe00640 1 -- 172.21.15.135:0/3551311944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e01f2ae0 con 0x7f07e0156780 2024-05-14T09:40:27.269 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.269+0000 7f07dfe00640 1 -- 172.21.15.135:0/3551311944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e00719d0 con 0x7f07e0156780 2024-05-14T09:40:27.631 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.631+0000 7f07d6a00640 1 -- 172.21.15.135:0/3551311944 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f07c801a070 con 0x7f07e0156780 2024-05-14T09:40:27.633 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.633+0000 7f07d6a00640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07bc076320 0x7f07bc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:27.633 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.633+0000 7f07dea00640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07bc076320 0x7f07bc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:27.635 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.635+0000 7f07dea00640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07bc076320 0x7f07bc078830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009aa0 tx=0x7f07d0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:27.655 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.655+0000 7f07d6a00640 1 -- 172.21.15.135:0/3551311944 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f07c8066720 con 0x7f07e0156780 2024-05-14T09:40:27.669 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.669+0000 7f07d6a00640 1 -- 172.21.15.135:0/3551311944 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f07e00719d0 con 0x7f07e0156780 2024-05-14T09:40:27.928 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:27.927+0000 7f07dfe00640 1 -- 172.21.15.135:0/3551311944 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07e0069980 con 0x7f07e0156780 2024-05-14T09:40:28.329 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.328+0000 7f07d6a00640 1 -- 172.21.15.135:0/3551311944 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12932 (secure 0 0 0) 0x7f07c8022080 con 0x7f07e0156780 2024-05-14T09:40:28.329 INFO:teuthology.misc.health.smithi135.stdout: 2024-05-14T09:40:28.329 INFO:teuthology.misc.health.smithi135.stdout:{"epoch":19,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:40:23.678312+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:40:28.332 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 -- 172.21.15.135:0/3551311944 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07bc076320 msgr2=0x7f07bc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:28.333 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07bc076320 0x7f07bc078830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009aa0 tx=0x7f07d0009190 comp rx=0 tx=0).stop 2024-05-14T09:40:28.333 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 -- 172.21.15.135:0/3551311944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07e0156780 msgr2=0x7f07e015fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:28.333 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07e0156780 0x7f07e015fa60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f07c800c430 tx=0x7f07c800c8f0 comp rx=0 tx=0).stop 2024-05-14T09:40:28.333 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 -- 172.21.15.135:0/3551311944 shutdown_connections 2024-05-14T09:40:28.333 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07bc076320 0x7f07bc078830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:28.333 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07e0156780 0x7f07e015fa60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:28.333 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07e015c820 0x7f07e01e8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:28.333 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 --2- 172.21.15.135:0/3551311944 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07e0156370 0x7f07e01592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:28.333 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 -- 172.21.15.135:0/3551311944 >> 172.21.15.135:0/3551311944 conn(0x7f07e00c9f10 msgr2=0x7f07e01537c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:28.333 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 -- 172.21.15.135:0/3551311944 shutdown_connections 2024-05-14T09:40:28.333 INFO:teuthology.misc.health.smithi135.stderr:2024-05-14T09:40:28.332+0000 7f07dfe00640 1 -- 172.21.15.135:0/3551311944 wait complete. 2024-05-14T09:40:28.357 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-14T09:40:28.357 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-14T09:40:28.357 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-14T09:40:28.357 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-14T09:40:28.357 DEBUG:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-05-14T09:40:28.365 INFO:tasks.ceph.mds.a:Started 2024-05-14T09:40:28.365 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-14T09:40:28.365 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-14T09:40:28.365 DEBUG:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-05-14T09:40:28.372 INFO:tasks.ceph.mds.c:Started 2024-05-14T09:40:28.372 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-14T09:40:28.372 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-14T09:40:28.372 DEBUG:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-05-14T09:40:28.376 INFO:tasks.ceph.mds.e:Started 2024-05-14T09:40:28.376 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-14T09:40:28.376 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-14T09:40:28.377 DEBUG:teuthology.orchestra.run.smithi196:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-05-14T09:40:28.384 INFO:tasks.ceph.mds.b:Started 2024-05-14T09:40:28.384 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-14T09:40:28.384 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-14T09:40:28.385 DEBUG:teuthology.orchestra.run.smithi196:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-05-14T09:40:28.391 INFO:tasks.ceph.mds.d:Started 2024-05-14T09:40:28.391 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-14T09:40:28.392 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-14T09:40:28.392 DEBUG:teuthology.orchestra.run.smithi196:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-05-14T09:40:28.398 INFO:tasks.ceph.mds.f:Started 2024-05-14T09:40:28.398 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-14T09:40:28.399 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T09:40:28.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.644+0000 7fac63200640 1 Processor -- start 2024-05-14T09:40:28.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.644+0000 7fac63200640 1 -- start start 2024-05-14T09:40:28.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.647+0000 7fac63200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac5c06dbf0 0x7fac5c15fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:28.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.647+0000 7fac63200640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c160610 con 0x7fac5c15f7f0 2024-05-14T09:40:28.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.648+0000 7fac63200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c0cdbe0 con 0x7fac5c0c66d0 2024-05-14T09:40:28.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.648+0000 7fac63200640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c160140 con 0x7fac5c06dbf0 2024-05-14T09:40:28.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.649+0000 7fac62800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fac5c06dbf0 0x7fac5c15fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:28.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.649+0000 7fac61e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fac5c0c66d0 0x7fac5c156300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:44302/0 (socket says 172.21.15.135:44302) 2024-05-14T09:40:28.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.649+0000 7fac61e00640 1 -- 172.21.15.135:0/4088491853 learned_addr learned my addr 172.21.15.135:0/4088491853 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:40:28.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.654+0000 7fac62800640 1 -- 172.21.15.135:0/4088491853 >> v1:172.21.15.196:6789/0 conn(0x7fac5c0c66d0 legacy=0x7fac5c156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:28.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.654+0000 7fac62800640 1 -- 172.21.15.135:0/4088491853 >> v1:172.21.15.135:6789/0 conn(0x7fac5c15f7f0 legacy=0x7fac5c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:28.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.654+0000 7fac62800640 1 -- 172.21.15.135:0/4088491853 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c160370 con 0x7fac5c06dbf0 2024-05-14T09:40:28.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.663+0000 7fac62800640 1 --2- 172.21.15.135:0/4088491853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c06dbf0 0x7fac5c15fc00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac58009d90 tx=0x7fac5802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69776ce899422922 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:28.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.670+0000 7fac60a00640 1 -- 172.21.15.135:0/4088491853 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58037070 con 0x7fac5c06dbf0 2024-05-14T09:40:28.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.670+0000 7fac60a00640 1 -- 172.21.15.135:0/4088491853 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac58007740 con 0x7fac5c06dbf0 2024-05-14T09:40:28.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.670+0000 7fac60a00640 1 -- 172.21.15.135:0/4088491853 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58007b10 con 0x7fac5c06dbf0 2024-05-14T09:40:28.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.671+0000 7fac63200640 1 -- 172.21.15.135:0/4088491853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c06dbf0 msgr2=0x7fac5c15fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:28.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.671+0000 7fac63200640 1 --2- 172.21.15.135:0/4088491853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c06dbf0 0x7fac5c15fc00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac58009d90 tx=0x7fac5802a780 comp rx=0 tx=0).stop 2024-05-14T09:40:28.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.671+0000 7fac63200640 1 -- 172.21.15.135:0/4088491853 shutdown_connections 2024-05-14T09:40:28.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.671+0000 7fac63200640 1 --2- 172.21.15.135:0/4088491853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c06dbf0 0x7fac5c15fc00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:28.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.671+0000 7fac63200640 1 -- 172.21.15.135:0/4088491853 >> 172.21.15.135:0/4088491853 conn(0x7fac5c0ce650 msgr2=0x7fac5c0cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:28.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.671+0000 7fac63200640 1 -- 172.21.15.135:0/4088491853 shutdown_connections 2024-05-14T09:40:28.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.671+0000 7fac63200640 1 -- 172.21.15.135:0/4088491853 wait complete. 2024-05-14T09:40:28.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.675+0000 7fac63200640 1 Processor -- start 2024-05-14T09:40:28.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.675+0000 7fac63200640 1 -- start start 2024-05-14T09:40:28.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.677+0000 7fac63200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c06dbf0 0x7fac5c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:28.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.677+0000 7fac63200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c0c66d0 0x7fac5c1f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:28.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.677+0000 7fac63200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c15f7f0 0x7fac5c1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:28.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.677+0000 7fac63200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0cde80 con 0x7fac5c15f7f0 2024-05-14T09:40:28.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.677+0000 7fac63200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0cd250 con 0x7fac5c0c66d0 2024-05-14T09:40:28.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.677+0000 7fac63200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c0cd6b0 con 0x7fac5c06dbf0 2024-05-14T09:40:28.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.678+0000 7fac62800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c15f7f0 0x7fac5c1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:28.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.679+0000 7fac61e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c06dbf0 0x7fac5c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:28.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.679+0000 7fac62800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c15f7f0 0x7fac5c1519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60420/0 (socket says 172.21.15.135:60420) 2024-05-14T09:40:28.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.679+0000 7fac62800640 1 -- 172.21.15.135:0/229069826 learned_addr learned my addr 172.21.15.135:0/229069826 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:28.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.679+0000 7fac61400640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c0c66d0 0x7fac5c1f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:28.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.684+0000 7fac62800640 1 -- 172.21.15.135:0/229069826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c06dbf0 msgr2=0x7fac5c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:28.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.684+0000 7fac62800640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c06dbf0 0x7fac5c150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:28.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.684+0000 7fac62800640 1 -- 172.21.15.135:0/229069826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c0c66d0 msgr2=0x7fac5c1f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:28.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.684+0000 7fac62800640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c0c66d0 0x7fac5c1f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:28.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.684+0000 7fac62800640 1 -- 172.21.15.135:0/229069826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c1f36c0 con 0x7fac5c15f7f0 2024-05-14T09:40:28.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.687+0000 7fac62800640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c15f7f0 0x7fac5c1519c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac58009e80 tx=0x7fac58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:28.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.694+0000 7fac56000640 1 -- 172.21.15.135:0/229069826 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58037070 con 0x7fac5c15f7f0 2024-05-14T09:40:28.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.694+0000 7fac56000640 1 -- 172.21.15.135:0/229069826 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac58042070 con 0x7fac5c15f7f0 2024-05-14T09:40:28.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.694+0000 7fac63200640 1 -- 172.21.15.135:0/229069826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c0d0480 con 0x7fac5c15f7f0 2024-05-14T09:40:28.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.694+0000 7fac56000640 1 -- 172.21.15.135:0/229069826 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58032dd0 con 0x7fac5c15f7f0 2024-05-14T09:40:28.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.694+0000 7fac63200640 1 -- 172.21.15.135:0/229069826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c0d0740 con 0x7fac5c15f7f0 2024-05-14T09:40:28.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:28.695+0000 7fac63200640 1 -- 172.21.15.135:0/229069826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c14cd20 con 0x7fac5c15f7f0 2024-05-14T09:40:29.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.032+0000 7fac56000640 1 -- 172.21.15.135:0/229069826 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fac58047460 con 0x7fac5c15f7f0 2024-05-14T09:40:29.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.034+0000 7fac56000640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fac40076350 0x7fac40078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:29.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.034+0000 7fac61e00640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fac40076350 0x7fac40078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:29.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.035+0000 7fac61e00640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fac40076350 0x7fac40078860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac50000f60 tx=0x7fac50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:29.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.058+0000 7fac56000640 1 -- 172.21.15.135:0/229069826 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fac580076e0 con 0x7fac5c15f7f0 2024-05-14T09:40:29.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.058+0000 7fac56000640 1 -- 172.21.15.135:0/229069826 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fac5c14cd20 con 0x7fac5c15f7f0 2024-05-14T09:40:29.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.543+0000 7fac63200640 1 -- 172.21.15.135:0/229069826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac5c069980 con 0x7fac5c15f7f0 2024-05-14T09:40:29.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.561+0000 7fac56000640 1 -- 172.21.15.135:0/229069826 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7fac58082280 con 0x7fac5c15f7f0 2024-05-14T09:40:29.561 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:40:29.561 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-14T09:40:29.562 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 1 2024-05-14T09:40:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 -- 172.21.15.135:0/229069826 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fac40076350 msgr2=0x7fac40078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fac40076350 0x7fac40078860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac50000f60 tx=0x7fac50009040 comp rx=0 tx=0).stop 2024-05-14T09:40:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 -- 172.21.15.135:0/229069826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c15f7f0 msgr2=0x7fac5c1519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c15f7f0 0x7fac5c1519c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac58009e80 tx=0x7fac58004a40 comp rx=0 tx=0).stop 2024-05-14T09:40:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 -- 172.21.15.135:0/229069826 shutdown_connections 2024-05-14T09:40:29.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fac40076350 0x7fac40078860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fac5c0c66d0 0x7fac5c1f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac5c15f7f0 0x7fac5c1519c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 --2- 172.21.15.135:0/229069826 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fac5c06dbf0 0x7fac5c150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 -- 172.21.15.135:0/229069826 >> 172.21.15.135:0/229069826 conn(0x7fac5c0ce650 msgr2=0x7fac5c0cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 -- 172.21.15.135:0/229069826 shutdown_connections 2024-05-14T09:40:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:29.565+0000 7fac63200640 1 -- 172.21.15.135:0/229069826 wait complete. 2024-05-14T09:40:31.602 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T09:40:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.891+0000 7f969a000640 1 Processor -- start 2024-05-14T09:40:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.891+0000 7f969a000640 1 -- start start 2024-05-14T09:40:31.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.893+0000 7f969a000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f96940b26f0 0x7f96940c5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:31.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.893+0000 7f969a000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9694156730 0x7f96940c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:31.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.893+0000 7f969a000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9694156b40 con 0x7f96940c6560 2024-05-14T09:40:31.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.893+0000 7f969a000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f969415c5e0 con 0x7f96940b26f0 2024-05-14T09:40:31.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.893+0000 7f969a000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f969415c8c0 con 0x7f9694156730 2024-05-14T09:40:31.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.894+0000 7f9698c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f96940b26f0 0x7f96940c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:31.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.894+0000 7f9693e00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f96940c6560 0x7f96940cb050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:45080/0 (socket says 172.21.15.135:45080) 2024-05-14T09:40:31.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.894+0000 7f9693e00640 1 -- 172.21.15.135:0/3865071684 learned_addr learned my addr 172.21.15.135:0/3865071684 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:40:31.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.894+0000 7f9699600640 1 --2- 172.21.15.135:0/3865071684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9694156730 0x7f96940c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.898+0000 7f9693400640 1 -- 172.21.15.135:0/3865071684 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1074404249 0 0) 0x7f9694156b40 con 0x7f96940c6560 2024-05-14T09:40:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.898+0000 7f9693400640 1 -- 172.21.15.135:0/3865071684 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f967c003520 con 0x7f96940c6560 2024-05-14T09:40:31.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.899+0000 7f9699600640 1 -- 172.21.15.135:0/3865071684 >> v2:172.21.15.196:3300/0 conn(0x7f96940b26f0 msgr2=0x7f96940c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:31.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.899+0000 7f9699600640 1 --2- 172.21.15.135:0/3865071684 >> v2:172.21.15.196:3300/0 conn(0x7f96940b26f0 0x7f96940c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:31.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.899+0000 7f9699600640 1 -- 172.21.15.135:0/3865071684 >> v1:172.21.15.135:6789/0 conn(0x7f96940c6560 legacy=0x7f96940cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:31.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.899+0000 7f9699600640 1 -- 172.21.15.135:0/3865071684 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969415cba0 con 0x7f9694156730 2024-05-14T09:40:31.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.903+0000 7f9699600640 1 --2- 172.21.15.135:0/3865071684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9694156730 0x7f96940c4810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f968c009d90 tx=0x7f968c02a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58346211cd54f047 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.911+0000 7f9693400640 1 -- 172.21.15.135:0/3865071684 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c007740 con 0x7f9694156730 2024-05-14T09:40:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.911+0000 7f9693400640 1 -- 172.21.15.135:0/3865071684 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968c0078e0 con 0x7f9694156730 2024-05-14T09:40:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.911+0000 7f9693400640 1 -- 172.21.15.135:0/3865071684 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c007cb0 con 0x7f9694156730 2024-05-14T09:40:31.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.912+0000 7f969a000640 1 -- 172.21.15.135:0/3865071684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9694156730 msgr2=0x7f96940c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:31.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.912+0000 7f969a000640 1 --2- 172.21.15.135:0/3865071684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9694156730 0x7f96940c4810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f968c009d90 tx=0x7f968c02a6f0 comp rx=0 tx=0).stop 2024-05-14T09:40:31.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.912+0000 7f969a000640 1 -- 172.21.15.135:0/3865071684 shutdown_connections 2024-05-14T09:40:31.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.912+0000 7f969a000640 1 --2- 172.21.15.135:0/3865071684 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9694156730 0x7f96940c4810 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:31.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.912+0000 7f969a000640 1 --2- 172.21.15.135:0/3865071684 >> v2:172.21.15.196:3300/0 conn(0x7f96940b26f0 0x7f96940c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:31.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.912+0000 7f969a000640 1 -- 172.21.15.135:0/3865071684 >> 172.21.15.135:0/3865071684 conn(0x7f96940733e0 msgr2=0x7f96940737f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:31.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.913+0000 7f969a000640 1 -- 172.21.15.135:0/3865071684 shutdown_connections 2024-05-14T09:40:31.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.913+0000 7f969a000640 1 -- 172.21.15.135:0/3865071684 wait complete. 2024-05-14T09:40:31.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.916+0000 7f969a000640 1 Processor -- start 2024-05-14T09:40:31.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.916+0000 7f969a000640 1 -- start start 2024-05-14T09:40:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.919+0000 7f969a000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96940b26f0 0x7f96940ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.919+0000 7f969a000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96940c6560 0x7f96941f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.919+0000 7f969a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9694156730 0x7f96941e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.919+0000 7f969a000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f96940cb760 con 0x7f9694156730 2024-05-14T09:40:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.919+0000 7f969a000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f969415d160 con 0x7f96940c6560 2024-05-14T09:40:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.919+0000 7f969a000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f96940cb8e0 con 0x7f96940b26f0 2024-05-14T09:40:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.920+0000 7f9699600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9694156730 0x7f96941e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.920+0000 7f9698c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96940b26f0 0x7f96940ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.920+0000 7f9693e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96940c6560 0x7f96941f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:31.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.921+0000 7f9698c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96940b26f0 0x7f96940ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:39494/0 (socket says 172.21.15.135:39494) 2024-05-14T09:40:31.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.921+0000 7f9698c00640 1 -- 172.21.15.135:0/1683758416 learned_addr learned my addr 172.21.15.135:0/1683758416 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:31.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.927+0000 7f9699600640 1 -- 172.21.15.135:0/1683758416 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96940b26f0 msgr2=0x7f96940ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:31.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.927+0000 7f9699600640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96940b26f0 0x7f96940ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:31.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.927+0000 7f9699600640 1 -- 172.21.15.135:0/1683758416 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96940c6560 msgr2=0x7f96941f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:31.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.927+0000 7f9699600640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96940c6560 0x7f96941f30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:31.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.927+0000 7f9699600640 1 -- 172.21.15.135:0/1683758416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96940cf230 con 0x7f9694156730 2024-05-14T09:40:31.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.930+0000 7f9699600640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9694156730 0x7f96941e78d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f968c031000 tx=0x7f968c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:31.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.933+0000 7f9690c00640 1 -- 172.21.15.135:0/1683758416 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c040030 con 0x7f9694156730 2024-05-14T09:40:31.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.933+0000 7f969a000640 1 -- 172.21.15.135:0/1683758416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96940cd690 con 0x7f9694156730 2024-05-14T09:40:31.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.933+0000 7f969a000640 1 -- 172.21.15.135:0/1683758416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96941f3c40 con 0x7f9694156730 2024-05-14T09:40:31.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.935+0000 7f969a000640 1 -- 172.21.15.135:0/1683758416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96940cbe10 con 0x7f9694156730 2024-05-14T09:40:31.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.936+0000 7f9690c00640 1 -- 172.21.15.135:0/1683758416 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968c007840 con 0x7f9694156730 2024-05-14T09:40:31.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:31.936+0000 7f9690c00640 1 -- 172.21.15.135:0/1683758416 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c04a060 con 0x7f9694156730 2024-05-14T09:40:32.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.257+0000 7f9690c00640 1 -- 172.21.15.135:0/1683758416 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f968c043030 con 0x7f9694156730 2024-05-14T09:40:32.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.259+0000 7f9690c00640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f96740762d0 0x7f96740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:32.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.259+0000 7f9698c00640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f96740762d0 0x7f96740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:32.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.260+0000 7f9698c00640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f96740762d0 0x7f96740787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9688009b60 tx=0x7f9688009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:32.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.274+0000 7f9690c00640 1 -- 172.21.15.135:0/1683758416 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f968c07dc90 con 0x7f9694156730 2024-05-14T09:40:32.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.275+0000 7f9690c00640 1 -- 172.21.15.135:0/1683758416 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f96940cbe10 con 0x7f9694156730 2024-05-14T09:40:32.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.523+0000 7f969a000640 1 -- 172.21.15.135:0/1683758416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9694069980 con 0x7f9694156730 2024-05-14T09:40:32.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.530+0000 7f9690c00640 1 -- 172.21.15.135:0/1683758416 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f968c081a00 con 0x7f9694156730 2024-05-14T09:40:32.531 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:40:32.531 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-14T09:40:32.531 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 1 2024-05-14T09:40:32.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.533+0000 7f969a000640 1 -- 172.21.15.135:0/1683758416 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f96740762d0 msgr2=0x7f96740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:32.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.533+0000 7f969a000640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f96740762d0 0x7f96740787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9688009b60 tx=0x7f9688009190 comp rx=0 tx=0).stop 2024-05-14T09:40:32.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.533+0000 7f969a000640 1 -- 172.21.15.135:0/1683758416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9694156730 msgr2=0x7f96941e78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:32.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.533+0000 7f969a000640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9694156730 0x7f96941e78d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f968c031000 tx=0x7f968c004a40 comp rx=0 tx=0).stop 2024-05-14T09:40:32.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.533+0000 7f969a000640 1 -- 172.21.15.135:0/1683758416 shutdown_connections 2024-05-14T09:40:32.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.534+0000 7f969a000640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f96740762d0 0x7f96740787e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:32.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.534+0000 7f969a000640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f96940c6560 0x7f96941f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:32.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.534+0000 7f969a000640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9694156730 0x7f96941e78d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:32.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.534+0000 7f969a000640 1 --2- 172.21.15.135:0/1683758416 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f96940b26f0 0x7f96940ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:32.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.534+0000 7f969a000640 1 -- 172.21.15.135:0/1683758416 >> 172.21.15.135:0/1683758416 conn(0x7f96940733e0 msgr2=0x7f9694154640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:32.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.534+0000 7f969a000640 1 -- 172.21.15.135:0/1683758416 shutdown_connections 2024-05-14T09:40:32.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:32.534+0000 7f969a000640 1 -- 172.21.15.135:0/1683758416 wait complete. 2024-05-14T09:40:34.572 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T09:40:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.878+0000 7f329fe00640 1 Processor -- start 2024-05-14T09:40:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.878+0000 7f329fe00640 1 -- start start 2024-05-14T09:40:34.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.880+0000 7f329fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f32a0158e70 0x7f32a00c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:34.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.880+0000 7f329fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32a00c9900 0x7f32a00c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:34.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.880+0000 7f329fe00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a0159720 con 0x7f32a01530b0 2024-05-14T09:40:34.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.880+0000 7f329fe00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f32a00c83d0 con 0x7f32a0158e70 2024-05-14T09:40:34.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.880+0000 7f329fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f32a0159a00 con 0x7f32a00c9900 2024-05-14T09:40:34.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.881+0000 7f329ea00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f32a01530b0 0x7f32a006da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:51976/0 (socket says 172.21.15.135:51976) 2024-05-14T09:40:34.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.881+0000 7f329ea00640 1 -- 172.21.15.135:0/41924612 learned_addr learned my addr 172.21.15.135:0/41924612 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:40:34.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.886+0000 7f329e000640 1 --2- 172.21.15.135:0/41924612 >> v2:172.21.15.135:3300/0 conn(0x7f32a0158e70 0x7f32a00c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:34.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.886+0000 7f329d600640 1 -- 172.21.15.135:0/41924612 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1674455680 0 0) 0x7f32a0159720 con 0x7f32a01530b0 2024-05-14T09:40:34.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.886+0000 7f329d600640 1 -- 172.21.15.135:0/41924612 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3284003520 con 0x7f32a01530b0 2024-05-14T09:40:34.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.891+0000 7f329e000640 1 -- 172.21.15.135:0/41924612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32a00c9900 msgr2=0x7f32a00c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:34.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.891+0000 7f329e000640 1 --2- 172.21.15.135:0/41924612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32a00c9900 0x7f32a00c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:34.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.891+0000 7f329e000640 1 -- 172.21.15.135:0/41924612 >> v1:172.21.15.135:6789/0 conn(0x7f32a01530b0 legacy=0x7f32a006da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:34.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.891+0000 7f329e000640 1 -- 172.21.15.135:0/41924612 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a0159ce0 con 0x7f32a0158e70 2024-05-14T09:40:34.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.898+0000 7f329e000640 1 --2- 172.21.15.135:0/41924612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a0158e70 0x7f32a00c93c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f328c0097a0 tx=0x7f328c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91e49bb627efd5d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:34.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.906+0000 7f329d600640 1 -- 172.21.15.135:0/41924612 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c037070 con 0x7f32a0158e70 2024-05-14T09:40:34.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.906+0000 7f329d600640 1 -- 172.21.15.135:0/41924612 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f328c032440 con 0x7f32a0158e70 2024-05-14T09:40:34.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.906+0000 7f329d600640 1 -- 172.21.15.135:0/41924612 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c032810 con 0x7f32a0158e70 2024-05-14T09:40:34.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.907+0000 7f329fe00640 1 -- 172.21.15.135:0/41924612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a0158e70 msgr2=0x7f32a00c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:34.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.907+0000 7f329fe00640 1 --2- 172.21.15.135:0/41924612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a0158e70 0x7f32a00c93c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f328c0097a0 tx=0x7f328c02a180 comp rx=0 tx=0).stop 2024-05-14T09:40:34.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.907+0000 7f329fe00640 1 -- 172.21.15.135:0/41924612 shutdown_connections 2024-05-14T09:40:34.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.907+0000 7f329fe00640 1 --2- 172.21.15.135:0/41924612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32a00c9900 0x7f32a00c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:34.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.907+0000 7f329fe00640 1 --2- 172.21.15.135:0/41924612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a0158e70 0x7f32a00c93c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:34.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.908+0000 7f329fe00640 1 -- 172.21.15.135:0/41924612 >> 172.21.15.135:0/41924612 conn(0x7f32a0074620 msgr2=0x7f32a00c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:34.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.908+0000 7f329fe00640 1 -- 172.21.15.135:0/41924612 shutdown_connections 2024-05-14T09:40:34.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.908+0000 7f329fe00640 1 -- 172.21.15.135:0/41924612 wait complete. 2024-05-14T09:40:34.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.910+0000 7f329fe00640 1 Processor -- start 2024-05-14T09:40:34.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.910+0000 7f329fe00640 1 -- start start 2024-05-14T09:40:34.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.912+0000 7f329fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32a00c9900 0x7f32a0157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:34.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.912+0000 7f329fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32a01530b0 0x7f32a015ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:34.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.912+0000 7f329fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a0158e70 0x7f32a015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:34.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.912+0000 7f329fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32a01534c0 con 0x7f32a0158e70 2024-05-14T09:40:34.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.912+0000 7f329fe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f32a00c8060 con 0x7f32a00c9900 2024-05-14T09:40:34.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.912+0000 7f329fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f32a0159280 con 0x7f32a01530b0 2024-05-14T09:40:34.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.913+0000 7f329f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a0158e70 0x7f32a015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:34.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.914+0000 7f329f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a0158e70 0x7f32a015b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57120/0 (socket says 172.21.15.135:57120) 2024-05-14T09:40:34.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.914+0000 7f329f400640 1 -- 172.21.15.135:0/3059154515 learned_addr learned my addr 172.21.15.135:0/3059154515 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:34.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.920+0000 7f329f400640 1 -- 172.21.15.135:0/3059154515 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32a01530b0 msgr2=0x7f32a015ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:34.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.920+0000 7f329f400640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32a01530b0 0x7f32a015ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:34.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.920+0000 7f329f400640 1 -- 172.21.15.135:0/3059154515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32a00c9900 msgr2=0x7f32a0157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:34.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.920+0000 7f329f400640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32a00c9900 0x7f32a0157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:34.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.920+0000 7f329f400640 1 -- 172.21.15.135:0/3059154515 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a0157eb0 con 0x7f32a0158e70 2024-05-14T09:40:34.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.924+0000 7f329f400640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a0158e70 0x7f32a015b660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f329800ba10 tx=0x7f329800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:34.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.930+0000 7f3297400640 1 -- 172.21.15.135:0/3059154515 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3298019070 con 0x7f32a0158e70 2024-05-14T09:40:34.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.930+0000 7f3297400640 1 -- 172.21.15.135:0/3059154515 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329800cb60 con 0x7f32a0158e70 2024-05-14T09:40:34.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.930+0000 7f329fe00640 1 -- 172.21.15.135:0/3059154515 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a015b110 con 0x7f32a0158e70 2024-05-14T09:40:34.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.930+0000 7f3297400640 1 -- 172.21.15.135:0/3059154515 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3298014440 con 0x7f32a0158e70 2024-05-14T09:40:34.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.930+0000 7f329fe00640 1 -- 172.21.15.135:0/3059154515 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a015a2d0 con 0x7f32a0158e70 2024-05-14T09:40:34.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:34.931+0000 7f329fe00640 1 -- 172.21.15.135:0/3059154515 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a0152920 con 0x7f32a0158e70 2024-05-14T09:40:35.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.323+0000 7f3297400640 1 -- 172.21.15.135:0/3059154515 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f329801c070 con 0x7f32a0158e70 2024-05-14T09:40:35.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.325+0000 7f3297400640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3280076320 0x7f3280078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:35.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.325+0000 7f329ea00640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3280076320 0x7f3280078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:35.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.326+0000 7f329ea00640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3280076320 0x7f3280078830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3290001220 tx=0x7f32900078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:35.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.351+0000 7f3297400640 1 -- 172.21.15.135:0/3059154515 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f3298067220 con 0x7f32a0158e70 2024-05-14T09:40:35.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.351+0000 7f3297400640 1 -- 172.21.15.135:0/3059154515 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f32a0152920 con 0x7f32a0158e70 2024-05-14T09:40:35.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.668+0000 7f329fe00640 1 -- 172.21.15.135:0/3059154515 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32a00c6fd0 con 0x7f32a0158e70 2024-05-14T09:40:35.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.702+0000 7f3297400640 1 -- 172.21.15.135:0/3059154515 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f3298023020 con 0x7f32a0158e70 2024-05-14T09:40:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:40:35.702 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-14T09:40:35.703 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 1 2024-05-14T09:40:35.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.706+0000 7f329fe00640 1 -- 172.21.15.135:0/3059154515 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3280076320 msgr2=0x7f3280078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:35.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.706+0000 7f329fe00640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3280076320 0x7f3280078830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3290001220 tx=0x7f32900078f0 comp rx=0 tx=0).stop 2024-05-14T09:40:35.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.706+0000 7f329fe00640 1 -- 172.21.15.135:0/3059154515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a0158e70 msgr2=0x7f32a015b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:35.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.706+0000 7f329fe00640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a0158e70 0x7f32a015b660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f329800ba10 tx=0x7f329800bed0 comp rx=0 tx=0).stop 2024-05-14T09:40:35.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.706+0000 7f329fe00640 1 -- 172.21.15.135:0/3059154515 shutdown_connections 2024-05-14T09:40:35.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.706+0000 7f329fe00640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3280076320 0x7f3280078830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:35.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.706+0000 7f329fe00640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32a0158e70 0x7f32a015b660 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:35.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.706+0000 7f329fe00640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32a01530b0 0x7f32a015ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:35.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.706+0000 7f329fe00640 1 --2- 172.21.15.135:0/3059154515 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32a00c9900 0x7f32a0157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:35.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.706+0000 7f329fe00640 1 -- 172.21.15.135:0/3059154515 >> 172.21.15.135:0/3059154515 conn(0x7f32a0074620 msgr2=0x7f32a00c5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:35.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.707+0000 7f329fe00640 1 -- 172.21.15.135:0/3059154515 shutdown_connections 2024-05-14T09:40:35.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:35.707+0000 7f329fe00640 1 -- 172.21.15.135:0/3059154515 wait complete. 2024-05-14T09:40:35.916 INFO:tasks.ceph.mds.e.smithi135.stdout:starting mds.e at 2024-05-14T09:40:35.927 INFO:tasks.ceph.mds.c.smithi135.stdout:starting mds.c at 2024-05-14T09:40:35.955 INFO:tasks.ceph.mds.d.smithi196.stdout:starting mds.d at 2024-05-14T09:40:35.990 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2024-05-14T09:40:36.057 INFO:tasks.ceph.mds.a.smithi135.stdout:starting mds.a at 2024-05-14T09:40:36.324 INFO:tasks.ceph.mds.f.smithi196.stdout:starting mds.f at 2024-05-14T09:40:37.729 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T09:40:38.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.009+0000 7fa276600640 1 Processor -- start 2024-05-14T09:40:38.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.010+0000 7fa276600640 1 -- start start 2024-05-14T09:40:38.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.011+0000 7fa276600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa27015acb0 0x7fa2700c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:38.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.011+0000 7fa276600640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa2701648a0 0x7fa2700c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:38.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.011+0000 7fa276600640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa270161830 con 0x7fa270074810 2024-05-14T09:40:38.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.011+0000 7fa276600640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa2701609d0 con 0x7fa2701648a0 2024-05-14T09:40:38.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.011+0000 7fa276600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa270160cb0 con 0x7fa27015acb0 2024-05-14T09:40:38.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.013+0000 7fa26fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa2701648a0 0x7fa2700c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:38.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.013+0000 7fa26fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa2701648a0 0x7fa2700c98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57158/0 (socket says 172.21.15.135:57158) 2024-05-14T09:40:38.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.013+0000 7fa26fe00640 1 -- 172.21.15.135:0/3688093235 learned_addr learned my addr 172.21.15.135:0/3688093235 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:38.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.020+0000 7fa26fe00640 1 -- 172.21.15.135:0/3688093235 >> v2:172.21.15.196:3300/0 conn(0x7fa27015acb0 msgr2=0x7fa2700c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:38.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.020+0000 7fa26fe00640 1 --2- 172.21.15.135:0/3688093235 >> v2:172.21.15.196:3300/0 conn(0x7fa27015acb0 0x7fa2700c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.020+0000 7fa26fe00640 1 -- 172.21.15.135:0/3688093235 >> v1:172.21.15.135:6789/0 conn(0x7fa270074810 legacy=0x7fa270164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:38.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.020+0000 7fa26fe00640 1 -- 172.21.15.135:0/3688093235 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa270160f90 con 0x7fa2701648a0 2024-05-14T09:40:38.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.026+0000 7fa26fe00640 1 --2- 172.21.15.135:0/3688093235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2701648a0 0x7fa2700c98b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa270074ed0 tx=0x7fa26802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc2962a631a592 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:38.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.033+0000 7fa26e000640 1 -- 172.21.15.135:0/3688093235 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268036070 con 0x7fa2701648a0 2024-05-14T09:40:38.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.033+0000 7fa26e000640 1 -- 172.21.15.135:0/3688093235 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa268031600 con 0x7fa2701648a0 2024-05-14T09:40:38.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.033+0000 7fa26e000640 1 -- 172.21.15.135:0/3688093235 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2680319d0 con 0x7fa2701648a0 2024-05-14T09:40:38.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.034+0000 7fa276600640 1 -- 172.21.15.135:0/3688093235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2701648a0 msgr2=0x7fa2700c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:38.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.034+0000 7fa276600640 1 --2- 172.21.15.135:0/3688093235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2701648a0 0x7fa2700c98b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa270074ed0 tx=0x7fa26802a6a0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.034+0000 7fa276600640 1 -- 172.21.15.135:0/3688093235 shutdown_connections 2024-05-14T09:40:38.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.034+0000 7fa276600640 1 --2- 172.21.15.135:0/3688093235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2701648a0 0x7fa2700c98b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.034+0000 7fa276600640 1 --2- 172.21.15.135:0/3688093235 >> v2:172.21.15.196:3300/0 conn(0x7fa27015acb0 0x7fa2700c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.034+0000 7fa276600640 1 -- 172.21.15.135:0/3688093235 >> 172.21.15.135:0/3688093235 conn(0x7fa270073cf0 msgr2=0x7fa270074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:38.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.034+0000 7fa276600640 1 -- 172.21.15.135:0/3688093235 shutdown_connections 2024-05-14T09:40:38.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.034+0000 7fa276600640 1 -- 172.21.15.135:0/3688093235 wait complete. 2024-05-14T09:40:38.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.037+0000 7fa276600640 1 Processor -- start 2024-05-14T09:40:38.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.037+0000 7fa276600640 1 -- start start 2024-05-14T09:40:38.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.038+0000 7fa276600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa270074810 0x7fa270153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:38.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.038+0000 7fa276600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27015acb0 0x7fa2701ebf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:38.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.038+0000 7fa276600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2701648a0 0x7fa27014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:38.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.039+0000 7fa276600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2700c69b0 con 0x7fa27015acb0 2024-05-14T09:40:38.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.039+0000 7fa276600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa270161550 con 0x7fa270074810 2024-05-14T09:40:38.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.039+0000 7fa276600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa2700c85b0 con 0x7fa2701648a0 2024-05-14T09:40:38.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.039+0000 7fa26ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27015acb0 0x7fa2701ebf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:38.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.040+0000 7fa26ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27015acb0 0x7fa2701ebf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57162/0 (socket says 172.21.15.135:57162) 2024-05-14T09:40:38.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.040+0000 7fa26ea00640 1 -- 172.21.15.135:0/2351658035 learned_addr learned my addr 172.21.15.135:0/2351658035 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:38.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.044+0000 7fa26ea00640 1 -- 172.21.15.135:0/2351658035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2701648a0 msgr2=0x7fa27014a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:38.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.044+0000 7fa26ea00640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2701648a0 0x7fa27014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.044+0000 7fa26ea00640 1 -- 172.21.15.135:0/2351658035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa270074810 msgr2=0x7fa270153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:38.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.044+0000 7fa26ea00640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa270074810 0x7fa270153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.044+0000 7fa26ea00640 1 -- 172.21.15.135:0/2351658035 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2701ec480 con 0x7fa27015acb0 2024-05-14T09:40:38.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.047+0000 7fa26ea00640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27015acb0 0x7fa2701ebf40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00b420 tx=0x7fa25c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:38.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.052+0000 7fa267400640 1 -- 172.21.15.135:0/2351658035 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c011830 con 0x7fa27015acb0 2024-05-14T09:40:38.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.052+0000 7fa267400640 1 -- 172.21.15.135:0/2351658035 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25c016070 con 0x7fa27015acb0 2024-05-14T09:40:38.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.052+0000 7fa267400640 1 -- 172.21.15.135:0/2351658035 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c011c30 con 0x7fa27015acb0 2024-05-14T09:40:38.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.052+0000 7fa276600640 1 -- 172.21.15.135:0/2351658035 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2701f7740 con 0x7fa27015acb0 2024-05-14T09:40:38.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.052+0000 7fa276600640 1 -- 172.21.15.135:0/2351658035 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2701eb460 con 0x7fa27015acb0 2024-05-14T09:40:38.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.053+0000 7fa276600640 1 -- 172.21.15.135:0/2351658035 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa270069a90 con 0x7fa27015acb0 2024-05-14T09:40:38.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.390+0000 7fa267400640 1 -- 172.21.15.135:0/2351658035 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa25c01b460 con 0x7fa27015acb0 2024-05-14T09:40:38.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.392+0000 7fa267400640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa250076350 0x7fa250078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:38.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.393+0000 7fa26f400640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa250076350 0x7fa250078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:38.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.394+0000 7fa26f400640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa250076350 0x7fa250078860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa260009670 tx=0x7fa260006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.471+0000 7fa267400640 1 -- 172.21.15.135:0/2351658035 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fa25c05d240 con 0x7fa27015acb0 2024-05-14T09:40:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.472+0000 7fa267400640 1 -- 172.21.15.135:0/2351658035 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa25c0616b0 con 0x7fa27015acb0 2024-05-14T09:40:38.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.732+0000 7fa276600640 1 -- 172.21.15.135:0/2351658035 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2700744d0 con 0x7fa27015acb0 2024-05-14T09:40:38.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.754+0000 7fa267400640 1 -- 172.21.15.135:0/2351658035 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5530 (secure 0 0 0) 0x7fa25c060fb0 con 0x7fa27015acb0 2024-05-14T09:40:38.754 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:40:38.754 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4032169993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4032169993},{"type":"v1","addr":"172.21.15.135:6837","nonce":4032169993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/1397919075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":1397919075},{"type":"v1","addr":"172.21.15.196:6833","nonce":1397919075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/4240420134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":4240420134},{"type":"v1","addr":"172.21.15.196:6835","nonce":4240420134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4240,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3270089159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3270089159},{"type":"v1","addr":"172.21.15.135:6835","nonce":3270089159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4252,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2302038485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2302038485},{"type":"v1","addr":"172.21.15.135:6839","nonce":2302038485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3644723215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3644723215},{"type":"v1","addr":"172.21.15.196:6837","nonce":3644723215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-14T09:40:38.754 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 3 2024-05-14T09:40:38.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 -- 172.21.15.135:0/2351658035 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa250076350 msgr2=0x7fa250078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:38.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa250076350 0x7fa250078860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa260009670 tx=0x7fa260006bf0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 -- 172.21.15.135:0/2351658035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27015acb0 msgr2=0x7fa2701ebf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:38.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27015acb0 0x7fa2701ebf40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00b420 tx=0x7fa25c00b8e0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 -- 172.21.15.135:0/2351658035 shutdown_connections 2024-05-14T09:40:38.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa250076350 0x7fa250078860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2701648a0 0x7fa27014a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27015acb0 0x7fa2701ebf40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 --2- 172.21.15.135:0/2351658035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa270074810 0x7fa270153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:38.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 -- 172.21.15.135:0/2351658035 >> 172.21.15.135:0/2351658035 conn(0x7fa270073cf0 msgr2=0x7fa270071840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:38.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 -- 172.21.15.135:0/2351658035 shutdown_connections 2024-05-14T09:40:38.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:38.758+0000 7fa276600640 1 -- 172.21.15.135:0/2351658035 wait complete. 2024-05-14T09:40:38.784 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-14T09:40:39.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.038+0000 7f7569800640 1 Processor -- start 2024-05-14T09:40:39.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.039+0000 7f7569800640 1 -- start start 2024-05-14T09:40:39.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.041+0000 7f7569800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f75640b2840 0x7f7564156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:39.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.041+0000 7f7569800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f756415fa40 0x7f756415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:39.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.041+0000 7f7569800640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75640ca0d0 con 0x7f75640c58e0 2024-05-14T09:40:39.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.041+0000 7f7569800640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f7564156ba0 con 0x7f75640b2840 2024-05-14T09:40:39.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.041+0000 7f7569800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f75640ca3b0 con 0x7f756415fa40 2024-05-14T09:40:39.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.042+0000 7f7562a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f75640b2840 0x7f7564156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:39.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.043+0000 7f7562a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f75640b2840 0x7f7564156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57164/0 (socket says 172.21.15.135:57164) 2024-05-14T09:40:39.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.043+0000 7f7562a00640 1 -- 172.21.15.135:0/2367120394 learned_addr learned my addr 172.21.15.135:0/2367120394 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:39.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.043+0000 7f7563400640 1 --2- 172.21.15.135:0/2367120394 >> v2:172.21.15.196:3300/0 conn(0x7f756415fa40 0x7f756415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:39.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.046+0000 7f7562a00640 1 -- 172.21.15.135:0/2367120394 >> v2:172.21.15.196:3300/0 conn(0x7f756415fa40 msgr2=0x7f756415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:39.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.046+0000 7f7562a00640 1 --2- 172.21.15.135:0/2367120394 >> v2:172.21.15.196:3300/0 conn(0x7f756415fa40 0x7f756415fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.046+0000 7f7562a00640 1 -- 172.21.15.135:0/2367120394 >> v1:172.21.15.135:6789/0 conn(0x7f75640c58e0 legacy=0x7f75640c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.046+0000 7f7562a00640 1 -- 172.21.15.135:0/2367120394 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75640ca690 con 0x7f75640b2840 2024-05-14T09:40:39.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.052+0000 7f7562a00640 1 --2- 172.21.15.135:0/2367120394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75640b2840 0x7f7564156660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75640735b0 tx=0x7f755402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678bc44b73db12c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.058+0000 7f7562000640 1 -- 172.21.15.135:0/2367120394 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554037070 con 0x7f75640b2840 2024-05-14T09:40:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.058+0000 7f7562000640 1 -- 172.21.15.135:0/2367120394 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755402ae50 con 0x7f75640b2840 2024-05-14T09:40:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.058+0000 7f7562000640 1 -- 172.21.15.135:0/2367120394 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554032860 con 0x7f75640b2840 2024-05-14T09:40:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.059+0000 7f7569800640 1 -- 172.21.15.135:0/2367120394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75640b2840 msgr2=0x7f7564156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.059+0000 7f7569800640 1 --2- 172.21.15.135:0/2367120394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75640b2840 0x7f7564156660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75640735b0 tx=0x7f755402a300 comp rx=0 tx=0).stop 2024-05-14T09:40:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.059+0000 7f7569800640 1 -- 172.21.15.135:0/2367120394 shutdown_connections 2024-05-14T09:40:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.059+0000 7f7569800640 1 --2- 172.21.15.135:0/2367120394 >> v2:172.21.15.196:3300/0 conn(0x7f756415fa40 0x7f756415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.059+0000 7f7569800640 1 --2- 172.21.15.135:0/2367120394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75640b2840 0x7f7564156660 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.059+0000 7f7569800640 1 -- 172.21.15.135:0/2367120394 >> 172.21.15.135:0/2367120394 conn(0x7f7564071fd0 msgr2=0x7f7564073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.059+0000 7f7569800640 1 -- 172.21.15.135:0/2367120394 shutdown_connections 2024-05-14T09:40:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.059+0000 7f7569800640 1 -- 172.21.15.135:0/2367120394 wait complete. 2024-05-14T09:40:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.062+0000 7f7569800640 1 Processor -- start 2024-05-14T09:40:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.062+0000 7f7569800640 1 -- start start 2024-05-14T09:40:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.064+0000 7f7569800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75640b2840 0x7f7564150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.064+0000 7f7569800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75640c58e0 0x7f756414e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.064+0000 7f7569800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f756415fa40 0x7f75641e5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.064+0000 7f7569800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f75640caf30 con 0x7f75640c58e0 2024-05-14T09:40:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.064+0000 7f7569800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f75640cac50 con 0x7f75640b2840 2024-05-14T09:40:39.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.064+0000 7f7569800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f75640b2c50 con 0x7f756415fa40 2024-05-14T09:40:39.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.065+0000 7f755be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75640c58e0 0x7f756414e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:39.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.066+0000 7f755be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75640c58e0 0x7f756414e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57172/0 (socket says 172.21.15.135:57172) 2024-05-14T09:40:39.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.066+0000 7f755be00640 1 -- 172.21.15.135:0/3015774615 learned_addr learned my addr 172.21.15.135:0/3015774615 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:39.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.069+0000 7f7562a00640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75640b2840 0x7f7564150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:39.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.071+0000 7f7563400640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f756415fa40 0x7f75641e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.072+0000 7f755be00640 1 -- 172.21.15.135:0/3015774615 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f756415fa40 msgr2=0x7f75641e5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.072+0000 7f755be00640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f756415fa40 0x7f75641e5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.072+0000 7f755be00640 1 -- 172.21.15.135:0/3015774615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75640b2840 msgr2=0x7f7564150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.072+0000 7f755be00640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75640b2840 0x7f7564150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.072+0000 7f755be00640 1 -- 172.21.15.135:0/3015774615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75641e6660 con 0x7f75640c58e0 2024-05-14T09:40:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.075+0000 7f755be00640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75640c58e0 0x7f756414e020 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f754c00c370 tx=0x7f754c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.079+0000 7f755aa00640 1 -- 172.21.15.135:0/3015774615 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c0052d0 con 0x7f75640c58e0 2024-05-14T09:40:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.079+0000 7f755aa00640 1 -- 172.21.15.135:0/3015774615 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754c007020 con 0x7f75640c58e0 2024-05-14T09:40:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.079+0000 7f755aa00640 1 -- 172.21.15.135:0/3015774615 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c0054b0 con 0x7f75640c58e0 2024-05-14T09:40:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.079+0000 7f7569800640 1 -- 172.21.15.135:0/3015774615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75641f3360 con 0x7f75640c58e0 2024-05-14T09:40:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.080+0000 7f7569800640 1 -- 172.21.15.135:0/3015774615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756414ce60 con 0x7f75640c58e0 2024-05-14T09:40:39.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.081+0000 7f7569800640 1 -- 172.21.15.135:0/3015774615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75640c6220 con 0x7f75640c58e0 2024-05-14T09:40:39.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.441+0000 7f755aa00640 1 -- 172.21.15.135:0/3015774615 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f754c007410 con 0x7f75640c58e0 2024-05-14T09:40:39.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.442+0000 7f755aa00640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7540076350 0x7f7540078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:39.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.443+0000 7f7562a00640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7540076350 0x7f7540078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:39.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.444+0000 7f7562a00640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7540076350 0x7f7540078860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7554034000 tx=0x7f755402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:39.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.534+0000 7f755aa00640 1 -- 172.21.15.135:0/3015774615 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f754c0669c0 con 0x7f75640c58e0 2024-05-14T09:40:39.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.535+0000 7f755aa00640 1 -- 172.21.15.135:0/3015774615 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f75640c6220 con 0x7f75640c58e0 2024-05-14T09:40:39.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.758+0000 7f7569800640 1 -- 172.21.15.135:0/3015774615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f75640634e0 con 0x7f75640c58e0 2024-05-14T09:40:39.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.781+0000 7f755aa00640 1 -- 172.21.15.135:0/3015774615 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f754c0601d0 con 0x7f75640c58e0 2024-05-14T09:40:39.780 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:40:39.780 INFO:teuthology.orchestra.run.smithi135.stdout:[ 2024-05-14T09:40:39.780 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-14T09:40:39.781 INFO:teuthology.orchestra.run.smithi135.stdout: "poolnum": 1, 2024-05-14T09:40:39.781 INFO:teuthology.orchestra.run.smithi135.stdout: "poolname": ".mgr" 2024-05-14T09:40:39.781 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-14T09:40:39.781 INFO:teuthology.orchestra.run.smithi135.stdout:] 2024-05-14T09:40:39.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 -- 172.21.15.135:0/3015774615 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7540076350 msgr2=0x7f7540078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:39.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7540076350 0x7f7540078860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7554034000 tx=0x7f755402e000 comp rx=0 tx=0).stop 2024-05-14T09:40:39.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 -- 172.21.15.135:0/3015774615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75640c58e0 msgr2=0x7f756414e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:39.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75640c58e0 0x7f756414e020 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f754c00c370 tx=0x7f754c00c830 comp rx=0 tx=0).stop 2024-05-14T09:40:39.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 -- 172.21.15.135:0/3015774615 shutdown_connections 2024-05-14T09:40:39.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7540076350 0x7f7540078860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:39.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f756415fa40 0x7f75641e5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:39.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75640c58e0 0x7f756414e020 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:39.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 --2- 172.21.15.135:0/3015774615 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f75640b2840 0x7f7564150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:39.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 -- 172.21.15.135:0/3015774615 >> 172.21.15.135:0/3015774615 conn(0x7f7564071fd0 msgr2=0x7f7564153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:39.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 -- 172.21.15.135:0/3015774615 shutdown_connections 2024-05-14T09:40:39.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:39.784+0000 7f7569800640 1 -- 172.21.15.135:0/3015774615 wait complete. 2024-05-14T09:40:39.808 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-14T09:40:39.808 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-14T09:40:40.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.077+0000 7f3bff200640 1 Processor -- start 2024-05-14T09:40:40.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.077+0000 7f3bff200640 1 -- start start 2024-05-14T09:40:40.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.079+0000 7f3bff200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3c00150b20 0x7f3c0006c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:40.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.079+0000 7f3bff200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3c0015aa90 0x7f3c000c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:40.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.079+0000 7f3bff200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c000c8640 0x7f3c000c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:40.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.079+0000 7f3bff200640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3c00071ab0 con 0x7f3c0015aa90 2024-05-14T09:40:40.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.079+0000 7f3bff200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0006cdc0 con 0x7f3c00150b20 2024-05-14T09:40:40.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.079+0000 7f3bff200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3c00150f30 con 0x7f3c000c8640 2024-05-14T09:40:40.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.080+0000 7f3bfd400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3c0015aa90 0x7f3c000c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:40.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.081+0000 7f3bfd400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3c0015aa90 0x7f3c000c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57176/0 (socket says 172.21.15.135:57176) 2024-05-14T09:40:40.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.081+0000 7f3bfd400640 1 -- 172.21.15.135:0/2303459014 learned_addr learned my addr 172.21.15.135:0/2303459014 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:40.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.081+0000 7f3bfde00640 1 --2- 172.21.15.135:0/2303459014 >> v2:172.21.15.196:3300/0 conn(0x7f3c00150b20 0x7f3c0006c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:40.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.082+0000 7f3bfe800640 1 --2- 172.21.15.135:0/2303459014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c000c8640 0x7f3c000c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:40.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.084+0000 7f3bfd400640 1 -- 172.21.15.135:0/2303459014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c000c8640 msgr2=0x7f3c000c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:40.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.084+0000 7f3bfd400640 1 --2- 172.21.15.135:0/2303459014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c000c8640 0x7f3c000c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:40.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.084+0000 7f3bfd400640 1 -- 172.21.15.135:0/2303459014 >> v2:172.21.15.196:3300/0 conn(0x7f3c00150b20 msgr2=0x7f3c0006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:40.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.084+0000 7f3bfd400640 1 --2- 172.21.15.135:0/2303459014 >> v2:172.21.15.196:3300/0 conn(0x7f3c00150b20 0x7f3c0006c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:40.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.084+0000 7f3bfd400640 1 -- 172.21.15.135:0/2303459014 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0006cfe0 con 0x7f3c0015aa90 2024-05-14T09:40:40.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.086+0000 7f3bfd400640 1 --2- 172.21.15.135:0/2303459014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0015aa90 0x7f3c000c8100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3c000c7640 tx=0x7f3be802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6de045d586b923c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:40.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.090+0000 7f3bfca00640 1 -- 172.21.15.135:0/2303459014 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8037070 con 0x7f3c0015aa90 2024-05-14T09:40:40.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.091+0000 7f3bfca00640 1 -- 172.21.15.135:0/2303459014 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be8032440 con 0x7f3c0015aa90 2024-05-14T09:40:40.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.091+0000 7f3bfca00640 1 -- 172.21.15.135:0/2303459014 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8032810 con 0x7f3c0015aa90 2024-05-14T09:40:40.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.091+0000 7f3bff200640 1 -- 172.21.15.135:0/2303459014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0015aa90 msgr2=0x7f3c000c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:40.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.091+0000 7f3bff200640 1 --2- 172.21.15.135:0/2303459014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0015aa90 0x7f3c000c8100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3c000c7640 tx=0x7f3be802a2a0 comp rx=0 tx=0).stop 2024-05-14T09:40:40.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.092+0000 7f3bff200640 1 -- 172.21.15.135:0/2303459014 shutdown_connections 2024-05-14T09:40:40.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.092+0000 7f3bff200640 1 --2- 172.21.15.135:0/2303459014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c000c8640 0x7f3c000c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:40.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.092+0000 7f3bff200640 1 --2- 172.21.15.135:0/2303459014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0015aa90 0x7f3c000c8100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:40.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.092+0000 7f3bff200640 1 --2- 172.21.15.135:0/2303459014 >> v2:172.21.15.196:3300/0 conn(0x7f3c00150b20 0x7f3c0006c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:40.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.092+0000 7f3bff200640 1 -- 172.21.15.135:0/2303459014 >> 172.21.15.135:0/2303459014 conn(0x7f3c000ca160 msgr2=0x7f3c000ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:40.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.092+0000 7f3bff200640 1 -- 172.21.15.135:0/2303459014 shutdown_connections 2024-05-14T09:40:40.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.092+0000 7f3bff200640 1 -- 172.21.15.135:0/2303459014 wait complete. 2024-05-14T09:40:40.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.094+0000 7f3bff200640 1 Processor -- start 2024-05-14T09:40:40.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.094+0000 7f3bff200640 1 -- start start 2024-05-14T09:40:40.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.096+0000 7f3bff200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c000c8640 0x7f3c001f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:40.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.096+0000 7f3bff200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c00150b20 0x7f3c00148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:40.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.096+0000 7f3bff200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0015aa90 0x7f3c000c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:40.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.096+0000 7f3bff200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c00070fd0 con 0x7f3c0015aa90 2024-05-14T09:40:40.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.096+0000 7f3bff200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3c00071620 con 0x7f3c000c8640 2024-05-14T09:40:40.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.096+0000 7f3bff200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3c000712b0 con 0x7f3c00150b20 2024-05-14T09:40:40.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.097+0000 7f3bfe800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0015aa90 0x7f3c000c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:40.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.097+0000 7f3bfe800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0015aa90 0x7f3c000c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57186/0 (socket says 172.21.15.135:57186) 2024-05-14T09:40:40.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.097+0000 7f3bfe800640 1 -- 172.21.15.135:0/316294926 learned_addr learned my addr 172.21.15.135:0/316294926 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:40.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.097+0000 7f3bfde00640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c000c8640 0x7f3c001f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:40.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.098+0000 7f3bfd400640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c00150b20 0x7f3c00148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:40.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.102+0000 7f3bfe800640 1 -- 172.21.15.135:0/316294926 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c00150b20 msgr2=0x7f3c00148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:40.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.102+0000 7f3bfe800640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c00150b20 0x7f3c00148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:40.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.102+0000 7f3bfe800640 1 -- 172.21.15.135:0/316294926 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c000c8640 msgr2=0x7f3c001f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:40.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.102+0000 7f3bfe800640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c000c8640 0x7f3c001f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:40.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.102+0000 7f3bfe800640 1 -- 172.21.15.135:0/316294926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c000c5830 con 0x7f3c0015aa90 2024-05-14T09:40:40.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.104+0000 7f3bfe800640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0015aa90 0x7f3c000c8ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0007d40 tx=0x7f3bf000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:40.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.109+0000 7f3bf6000640 1 -- 172.21.15.135:0/316294926 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0014420 con 0x7f3c0015aa90 2024-05-14T09:40:40.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.109+0000 7f3bf6000640 1 -- 172.21.15.135:0/316294926 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf0019070 con 0x7f3c0015aa90 2024-05-14T09:40:40.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.109+0000 7f3bf6000640 1 -- 172.21.15.135:0/316294926 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0014800 con 0x7f3c0015aa90 2024-05-14T09:40:40.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.109+0000 7f3bff200640 1 -- 172.21.15.135:0/316294926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c001495e0 con 0x7f3c0015aa90 2024-05-14T09:40:40.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.109+0000 7f3bff200640 1 -- 172.21.15.135:0/316294926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c001f2900 con 0x7f3c0015aa90 2024-05-14T09:40:40.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.110+0000 7f3bff200640 1 -- 172.21.15.135:0/316294926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c00069980 con 0x7f3c0015aa90 2024-05-14T09:40:40.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.461+0000 7f3bf6000640 1 -- 172.21.15.135:0/316294926 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3bf00149a0 con 0x7f3c0015aa90 2024-05-14T09:40:40.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.463+0000 7f3bf6000640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3bdc076320 0x7f3bdc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:40.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.464+0000 7f3bfde00640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3bdc076320 0x7f3bdc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:40.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.465+0000 7f3bfde00640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3bdc076320 0x7f3bdc078830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c00154900 tx=0x7f3bf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:40.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.499+0000 7f3bf6000640 1 -- 172.21.15.135:0/316294926 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f3bf00681b0 con 0x7f3c0015aa90 2024-05-14T09:40:40.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.500+0000 7f3bf6000640 1 -- 172.21.15.135:0/316294926 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3bf00619c0 con 0x7f3c0015aa90 2024-05-14T09:40:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:40.757+0000 7f3bff200640 1 -- 172.21.15.135:0/316294926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3c0006d3e0 con 0x7f3c0015aa90 2024-05-14T09:40:41.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.829+0000 7f3bf6000640 1 -- 172.21.15.135:0/316294926 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f3bf0065cc0 con 0x7f3c0015aa90 2024-05-14T09:40:41.829 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' created 2024-05-14T09:40:41.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.833+0000 7f3bff200640 1 -- 172.21.15.135:0/316294926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3bdc076320 msgr2=0x7f3bdc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:41.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.833+0000 7f3bff200640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3bdc076320 0x7f3bdc078830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3c00154900 tx=0x7f3bf8008040 comp rx=0 tx=0).stop 2024-05-14T09:40:41.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.833+0000 7f3bff200640 1 -- 172.21.15.135:0/316294926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0015aa90 msgr2=0x7f3c000c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:41.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.833+0000 7f3bff200640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0015aa90 0x7f3c000c8ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0007d40 tx=0x7f3bf000e4b0 comp rx=0 tx=0).stop 2024-05-14T09:40:41.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.833+0000 7f3bff200640 1 -- 172.21.15.135:0/316294926 shutdown_connections 2024-05-14T09:40:41.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.833+0000 7f3bff200640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3bdc076320 0x7f3bdc078830 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:41.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.833+0000 7f3bff200640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c0015aa90 0x7f3c000c8ed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:41.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.833+0000 7f3bff200640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3c00150b20 0x7f3c00148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:41.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.833+0000 7f3bff200640 1 --2- 172.21.15.135:0/316294926 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c000c8640 0x7f3c001f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:41.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.833+0000 7f3bff200640 1 -- 172.21.15.135:0/316294926 >> 172.21.15.135:0/316294926 conn(0x7f3c000ca160 msgr2=0x7f3c0014c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:41.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.834+0000 7f3bff200640 1 -- 172.21.15.135:0/316294926 shutdown_connections 2024-05-14T09:40:41.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:41.834+0000 7f3bff200640 1 -- 172.21.15.135:0/316294926 wait complete. 2024-05-14T09:40:41.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-14T09:40:42.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.138+0000 7f7a8a400640 1 Processor -- start 2024-05-14T09:40:42.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.139+0000 7f7a8a400640 1 -- start start 2024-05-14T09:40:42.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.141+0000 7f7a8a400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a84149ba0 0x7f7a840c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:42.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.141+0000 7f7a8a400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7a84071920 0x7f7a84070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:42.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.141+0000 7f7a8a400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a840c54b0 con 0x7f7a840710b0 2024-05-14T09:40:42.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.141+0000 7f7a8a400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f7a840c6cd0 con 0x7f7a84071920 2024-05-14T09:40:42.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.141+0000 7f7a8a400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7a840c6fb0 con 0x7f7a84149ba0 2024-05-14T09:40:42.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.216+0000 7f7a7be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7a84071920 0x7f7a84070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:42.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.218+0000 7f7a7be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7a84071920 0x7f7a84070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:60120/0 (socket says 172.21.15.135:60120) 2024-05-14T09:40:42.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.218+0000 7f7a7be00640 1 -- 172.21.15.135:0/2463394112 learned_addr learned my addr 172.21.15.135:0/2463394112 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:42.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.238+0000 7f7a89000640 1 --2- 172.21.15.135:0/2463394112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a84149ba0 0x7f7a840c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:42.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.240+0000 7f7a7be00640 1 -- 172.21.15.135:0/2463394112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a84149ba0 msgr2=0x7f7a840c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:42.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.240+0000 7f7a7be00640 1 --2- 172.21.15.135:0/2463394112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a84149ba0 0x7f7a840c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:42.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.240+0000 7f7a7be00640 1 -- 172.21.15.135:0/2463394112 >> v1:172.21.15.196:6789/0 conn(0x7f7a840710b0 legacy=0x7f7a84160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:42.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.240+0000 7f7a7be00640 1 -- 172.21.15.135:0/2463394112 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a840c7290 con 0x7f7a84071920 2024-05-14T09:40:42.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.253+0000 7f7a7be00640 1 --2- 172.21.15.135:0/2463394112 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a84071920 0x7f7a84070b70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009870 tx=0x7f7a6c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cdee270264ece5a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:42.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.268+0000 7f7a83e00640 1 -- 172.21.15.135:0/2463394112 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c037070 con 0x7f7a84071920 2024-05-14T09:40:42.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.268+0000 7f7a83e00640 1 -- 172.21.15.135:0/2463394112 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6c032440 con 0x7f7a84071920 2024-05-14T09:40:42.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.268+0000 7f7a83e00640 1 -- 172.21.15.135:0/2463394112 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c032810 con 0x7f7a84071920 2024-05-14T09:40:42.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.270+0000 7f7a8a400640 1 -- 172.21.15.135:0/2463394112 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a84071920 msgr2=0x7f7a84070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:42.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.270+0000 7f7a8a400640 1 --2- 172.21.15.135:0/2463394112 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a84071920 0x7f7a84070b70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009870 tx=0x7f7a6c02a250 comp rx=0 tx=0).stop 2024-05-14T09:40:42.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.270+0000 7f7a8a400640 1 -- 172.21.15.135:0/2463394112 shutdown_connections 2024-05-14T09:40:42.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.270+0000 7f7a8a400640 1 --2- 172.21.15.135:0/2463394112 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a84071920 0x7f7a84070b70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:42.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.270+0000 7f7a8a400640 1 --2- 172.21.15.135:0/2463394112 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a84149ba0 0x7f7a840c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:42.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.270+0000 7f7a8a400640 1 -- 172.21.15.135:0/2463394112 >> 172.21.15.135:0/2463394112 conn(0x7f7a840ca160 msgr2=0x7f7a840ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:42.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.270+0000 7f7a8a400640 1 -- 172.21.15.135:0/2463394112 shutdown_connections 2024-05-14T09:40:42.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.270+0000 7f7a8a400640 1 -- 172.21.15.135:0/2463394112 wait complete. 2024-05-14T09:40:42.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.274+0000 7f7a8a400640 1 Processor -- start 2024-05-14T09:40:42.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.275+0000 7f7a8a400640 1 -- start start 2024-05-14T09:40:42.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.278+0000 7f7a8a400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a840710b0 0x7f7a84148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:42.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.278+0000 7f7a8a400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a84071920 0x7f7a840cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:42.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.278+0000 7f7a8a400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a841629a0 0x7f7a8413f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:42.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.278+0000 7f7a8a400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7a84160570 con 0x7f7a841629a0 2024-05-14T09:40:42.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.278+0000 7f7a8a400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7a840c7850 con 0x7f7a840710b0 2024-05-14T09:40:42.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.278+0000 7f7a8a400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7a840c83c0 con 0x7f7a84071920 2024-05-14T09:40:42.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.280+0000 7f7a7be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a84071920 0x7f7a840cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:42.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.280+0000 7f7a89000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a840710b0 0x7f7a84148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:42.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.281+0000 7f7a89000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a840710b0 0x7f7a84148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:60130/0 (socket says 172.21.15.135:60130) 2024-05-14T09:40:42.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.281+0000 7f7a7be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a84071920 0x7f7a840cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:58994/0 (socket says 172.21.15.135:58994) 2024-05-14T09:40:42.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.281+0000 7f7a89000640 1 -- 172.21.15.135:0/1339694590 learned_addr learned my addr 172.21.15.135:0/1339694590 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:42.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.292+0000 7f7a89000640 1 -- 172.21.15.135:0/1339694590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a84071920 msgr2=0x7f7a840cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:42.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.292+0000 7f7a89000640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a84071920 0x7f7a840cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:42.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.292+0000 7f7a89000640 1 -- 172.21.15.135:0/1339694590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a841629a0 msgr2=0x7f7a8413f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:42.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.292+0000 7f7a89000640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a841629a0 0x7f7a8413f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:42.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.292+0000 7f7a89000640 1 -- 172.21.15.135:0/1339694590 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a841490a0 con 0x7f7a840710b0 2024-05-14T09:40:42.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.301+0000 7f7a89000640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a840710b0 0x7f7a84148b60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400c820 tx=0x7f7a7400cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:42.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.311+0000 7f7a81600640 1 -- 172.21.15.135:0/1339694590 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74004030 con 0x7f7a840710b0 2024-05-14T09:40:42.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.312+0000 7f7a81600640 1 -- 172.21.15.135:0/1339694590 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a740041d0 con 0x7f7a840710b0 2024-05-14T09:40:42.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.312+0000 7f7a81600640 1 -- 172.21.15.135:0/1339694590 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74007830 con 0x7f7a840710b0 2024-05-14T09:40:42.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.312+0000 7f7a8a400640 1 -- 172.21.15.135:0/1339694590 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a841492b0 con 0x7f7a840710b0 2024-05-14T09:40:42.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.312+0000 7f7a8a400640 1 -- 172.21.15.135:0/1339694590 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8415fe40 con 0x7f7a840710b0 2024-05-14T09:40:42.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.314+0000 7f7a8a400640 1 -- 172.21.15.135:0/1339694590 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a841f9870 con 0x7f7a840710b0 2024-05-14T09:40:42.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.684+0000 7f7a81600640 1 -- 172.21.15.135:0/1339694590 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7a740079d0 con 0x7f7a840710b0 2024-05-14T09:40:42.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.686+0000 7f7a81600640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7a60076320 0x7f7a60078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:42.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.687+0000 7f7a7be00640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7a60076320 0x7f7a60078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:42.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.689+0000 7f7a7be00640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7a60076320 0x7f7a60078830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c034000 tx=0x7f7a6c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:42.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.695+0000 7f7a81600640 1 -- 172.21.15.135:0/1339694590 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f7a7405cec0 con 0x7f7a840710b0 2024-05-14T09:40:42.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.724+0000 7f7a81600640 1 -- 172.21.15.135:0/1339694590 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a74015020 con 0x7f7a840710b0 2024-05-14T09:40:42.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:42.944+0000 7f7a8a400640 1 -- 172.21.15.135:0/1339694590 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f7a84069980 con 0x7f7a840710b0 2024-05-14T09:40:44.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.312+0000 7f7a81600640 1 -- 172.21.15.135:0/1339694590 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) ==== 171+0+0 (secure 0 0 0) 0x7f7a74069300 con 0x7f7a840710b0 2024-05-14T09:40:44.313 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' created 2024-05-14T09:40:44.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 -- 172.21.15.135:0/1339694590 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7a60076320 msgr2=0x7f7a60078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7a60076320 0x7f7a60078830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c034000 tx=0x7f7a6c02e000 comp rx=0 tx=0).stop 2024-05-14T09:40:44.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 -- 172.21.15.135:0/1339694590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a840710b0 msgr2=0x7f7a84148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a840710b0 0x7f7a84148b60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400c820 tx=0x7f7a7400cce0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 -- 172.21.15.135:0/1339694590 shutdown_connections 2024-05-14T09:40:44.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7a60076320 0x7f7a60078830 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a841629a0 0x7f7a8413f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7a84071920 0x7f7a840cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 --2- 172.21.15.135:0/1339694590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a840710b0 0x7f7a84148b60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 -- 172.21.15.135:0/1339694590 >> 172.21.15.135:0/1339694590 conn(0x7f7a840ca160 msgr2=0x7f7a841609c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:44.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 -- 172.21.15.135:0/1339694590 shutdown_connections 2024-05-14T09:40:44.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.316+0000 7f7a8a400640 1 -- 172.21.15.135:0/1339694590 wait complete. 2024-05-14T09:40:44.350 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-14T09:40:44.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.616+0000 7f5402000640 1 Processor -- start 2024-05-14T09:40:44.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.616+0000 7f5402000640 1 -- start start 2024-05-14T09:40:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.618+0000 7f5402000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f53fc152ed0 0x7f53fc1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.618+0000 7f5402000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53fc0c5900 con 0x7f53fc15cd20 2024-05-14T09:40:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.618+0000 7f5402000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53fc15d290 con 0x7f53fc0c60a0 2024-05-14T09:40:44.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.618+0000 7f5402000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f53fc15a510 con 0x7f53fc152ed0 2024-05-14T09:40:44.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.621+0000 7f53faa00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f53fc0c60a0 0x7f53fc15c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:59246/0 (socket says 172.21.15.135:59246) 2024-05-14T09:40:44.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.621+0000 7f53faa00640 1 -- 172.21.15.135:0/979161346 learned_addr learned my addr 172.21.15.135:0/979161346 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:40:44.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.621+0000 7f53fb400640 1 --2- 172.21.15.135:0/979161346 >> v2:172.21.15.196:3300/0 conn(0x7f53fc152ed0 0x7f53fc1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.627+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806834749 0 0) 0x7f53f4001490 con 0x7f53fc15cd20 2024-05-14T09:40:44.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.627+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53e0005730 con 0x7f53fc15cd20 2024-05-14T09:40:44.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1323583421 0 0) 0x7f53e0005730 con 0x7f53fc15cd20 2024-05-14T09:40:44.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 >> v2:172.21.15.196:3300/0 conn(0x7f53fc152ed0 msgr2=0x7f53fc1532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:44.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 --2- 172.21.15.135:0/979161346 >> v2:172.21.15.196:3300/0 conn(0x7f53fc152ed0 0x7f53fc1532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 >> v1:172.21.15.196:6789/0 conn(0x7f53fc0c60a0 legacy=0x7f53fc15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc06c940 con 0x7f53fc15cd20 2024-05-14T09:40:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f53f4001c40 con 0x7f53fc15cd20 2024-05-14T09:40:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 >> v1:172.21.15.135:6789/0 conn(0x7f53fc15cd20 legacy=0x7f53fc1639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 --2- 172.21.15.135:0/979161346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 0x7f53e0006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 --2- 172.21.15.135:0/979161346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53e0006a10 0x7f53e0006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 --2- 172.21.15.135:0/979161346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53e0007560 0x7f53e000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53e000e420 con 0x7f53e0005cb0 2024-05-14T09:40:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f53e000e5d0 con 0x7f53e0007560 2024-05-14T09:40:44.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.633+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f53e000e7d0 con 0x7f53e0006a10 2024-05-14T09:40:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.635+0000 7f53fb400640 1 --2- 172.21.15.135:0/979161346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 0x7f53e0006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.636+0000 7f53faa00640 1 --2- 172.21.15.135:0/979161346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53e0006a10 0x7f53e0006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.642+0000 7f53fb400640 1 -- 172.21.15.135:0/979161346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53e0006a10 msgr2=0x7f53e0006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:44.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.642+0000 7f53fb400640 1 --2- 172.21.15.135:0/979161346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53e0006a10 0x7f53e0006e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.642+0000 7f53fb400640 1 -- 172.21.15.135:0/979161346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53e0007560 msgr2=0x7f53e000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.642+0000 7f53fb400640 1 --2- 172.21.15.135:0/979161346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53e0007560 0x7f53e000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.642+0000 7f53fb400640 1 -- 172.21.15.135:0/979161346 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e0005730 con 0x7f53e0005cb0 2024-05-14T09:40:44.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.642+0000 7f53fbe00640 1 -- 172.21.15.135:0/979161346 reap_dead start 2024-05-14T09:40:44.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.647+0000 7f53fb400640 1 --2- 172.21.15.135:0/979161346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 0x7f53e0006140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009ac0 tx=0x7f53e0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f856970f985869d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:44.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.652+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec036070 con 0x7f53e0005cb0 2024-05-14T09:40:44.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.653+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec031400 con 0x7f53e0005cb0 2024-05-14T09:40:44.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.653+0000 7f53fa000640 1 -- 172.21.15.135:0/979161346 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec009690 con 0x7f53e0005cb0 2024-05-14T09:40:44.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.654+0000 7f5402000640 1 -- 172.21.15.135:0/979161346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 msgr2=0x7f53e0006140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.654+0000 7f5402000640 1 --2- 172.21.15.135:0/979161346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 0x7f53e0006140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009ac0 tx=0x7f53e0007a40 comp rx=0 tx=0).stop 2024-05-14T09:40:44.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.654+0000 7f5402000640 1 -- 172.21.15.135:0/979161346 shutdown_connections 2024-05-14T09:40:44.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.654+0000 7f5402000640 1 --2- 172.21.15.135:0/979161346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 0x7f53e0006140 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.654+0000 7f5402000640 1 -- 172.21.15.135:0/979161346 >> 172.21.15.135:0/979161346 conn(0x7f53fc073d40 msgr2=0x7f53fc074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:44.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.654+0000 7f5402000640 1 -- 172.21.15.135:0/979161346 shutdown_connections 2024-05-14T09:40:44.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.654+0000 7f5402000640 1 -- 172.21.15.135:0/979161346 wait complete. 2024-05-14T09:40:44.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.658+0000 7f5402000640 1 Processor -- start 2024-05-14T09:40:44.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.658+0000 7f5402000640 1 -- start start 2024-05-14T09:40:44.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.659+0000 7f5402000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 0x7f53fc1eef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.660+0000 7f5402000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53fc1572c0 0x7f53fc153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.660+0000 7f5402000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53fc150af0 0x7f53fc155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.660+0000 7f5402000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc0c5c10 con 0x7f53e0005cb0 2024-05-14T09:40:44.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.660+0000 7f5402000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc06c6f0 con 0x7f53fc1572c0 2024-05-14T09:40:44.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.660+0000 7f5402000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f53fc0c4a60 con 0x7f53fc150af0 2024-05-14T09:40:44.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.660+0000 7f53fb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 0x7f53fc1eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.661+0000 7f53fb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 0x7f53fc1eef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58806/0 (socket says 172.21.15.135:58806) 2024-05-14T09:40:44.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.661+0000 7f53fb400640 1 -- 172.21.15.135:0/3847475681 learned_addr learned my addr 172.21.15.135:0/3847475681 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:44.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.663+0000 7f53fbe00640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53fc150af0 0x7f53fc155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.667+0000 7f53fb400640 1 -- 172.21.15.135:0/3847475681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53fc150af0 msgr2=0x7f53fc155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.667+0000 7f53fb400640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53fc150af0 0x7f53fc155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.667+0000 7f53fb400640 1 -- 172.21.15.135:0/3847475681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53fc1572c0 msgr2=0x7f53fc153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:44.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.667+0000 7f53fb400640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53fc1572c0 0x7f53fc153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:44.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.667+0000 7f53fb400640 1 -- 172.21.15.135:0/3847475681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc1ee4c0 con 0x7f53e0005cb0 2024-05-14T09:40:44.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.670+0000 7f53fb400640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 0x7f53fc1eef80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f53ec034040 tx=0x7f53ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:44.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.676+0000 7f53f3400640 1 -- 172.21.15.135:0/3847475681 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec03f020 con 0x7f53e0005cb0 2024-05-14T09:40:44.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.676+0000 7f53f3400640 1 -- 172.21.15.135:0/3847475681 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec037040 con 0x7f53e0005cb0 2024-05-14T09:40:44.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.676+0000 7f53f3400640 1 -- 172.21.15.135:0/3847475681 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec036070 con 0x7f53e0005cb0 2024-05-14T09:40:44.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.676+0000 7f5402000640 1 -- 172.21.15.135:0/3847475681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53fc151e30 con 0x7f53e0005cb0 2024-05-14T09:40:44.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.676+0000 7f5402000640 1 -- 172.21.15.135:0/3847475681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53fc158120 con 0x7f53e0005cb0 2024-05-14T09:40:44.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.677+0000 7f5402000640 1 -- 172.21.15.135:0/3847475681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53fc069a60 con 0x7f53e0005cb0 2024-05-14T09:40:44.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.704+0000 7f53f3400640 1 -- 172.21.15.135:0/3847475681 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f53ec042020 con 0x7f53e0005cb0 2024-05-14T09:40:44.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.706+0000 7f53f3400640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f53dc076350 0x7f53dc078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:44.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.707+0000 7f53faa00640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f53dc076350 0x7f53dc078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:44.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.707+0000 7f53faa00640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f53dc076350 0x7f53dc078860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f53e8000f60 tx=0x7f53e8000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:44.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:44.709+0000 7f53f3400640 1 -- 172.21.15.135:0/3847475681 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5609+0+0 (secure 0 0 0) 0x7f53ec07d1c0 con 0x7f53e0005cb0 2024-05-14T09:40:45.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:45.029+0000 7f53f3400640 1 -- 172.21.15.135:0/3847475681 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f53ec080f30 con 0x7f53e0005cb0 2024-05-14T09:40:45.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:45.304+0000 7f5402000640 1 -- 172.21.15.135:0/3847475681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f53fc073b20 con 0x7f53e0005cb0 2024-05-14T09:40:47.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.220+0000 7f53f3400640 1 -- 172.21.15.135:0/3847475681 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f53ec085230 con 0x7f53e0005cb0 2024-05-14T09:40:47.221 INFO:teuthology.orchestra.run.smithi135.stderr:new fs with metadata pool 2 and data pool 3 2024-05-14T09:40:47.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 -- 172.21.15.135:0/3847475681 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f53dc076350 msgr2=0x7f53dc078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:47.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f53dc076350 0x7f53dc078860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f53e8000f60 tx=0x7f53e8000ed0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 -- 172.21.15.135:0/3847475681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 msgr2=0x7f53fc1eef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:47.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 0x7f53fc1eef80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f53ec034040 tx=0x7f53ec004730 comp rx=0 tx=0).stop 2024-05-14T09:40:47.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 -- 172.21.15.135:0/3847475681 shutdown_connections 2024-05-14T09:40:47.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f53dc076350 0x7f53dc078860 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53fc1572c0 0x7f53fc153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f53fc150af0 0x7f53fc155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 --2- 172.21.15.135:0/3847475681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e0005cb0 0x7f53fc1eef80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 -- 172.21.15.135:0/3847475681 >> 172.21.15.135:0/3847475681 conn(0x7f53fc073d40 msgr2=0x7f53fc15a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:47.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 -- 172.21.15.135:0/3847475681 shutdown_connections 2024-05-14T09:40:47.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.224+0000 7f5402000640 1 -- 172.21.15.135:0/3847475681 wait complete. 2024-05-14T09:40:47.255 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-14T09:40:47.255 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-14T09:40:47.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.527+0000 7f63c1600640 1 Processor -- start 2024-05-14T09:40:47.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.527+0000 7f63c1600640 1 -- start start 2024-05-14T09:40:47.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.530+0000 7f63c1600640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f63bc070dc0 0x7f63bc0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:47.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.530+0000 7f63c1600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f63bc15adf0 0x7f63bc15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:47.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.530+0000 7f63c1600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63bc154040 0x7f63bc154450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:47.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.530+0000 7f63c1600640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f63bc0728d0 con 0x7f63bc070dc0 2024-05-14T09:40:47.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.530+0000 7f63c1600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f63bc0c7990 con 0x7f63bc15adf0 2024-05-14T09:40:47.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.530+0000 7f63c1600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f63bc0712b0 con 0x7f63bc154040 2024-05-14T09:40:47.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.531+0000 7f63ba000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f63bc15adf0 0x7f63bc15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:47.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.532+0000 7f63bb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63bc154040 0x7f63bc154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:47.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.532+0000 7f63ba000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f63bc15adf0 0x7f63bc15a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:37596/0 (socket says 172.21.15.135:37596) 2024-05-14T09:40:47.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.532+0000 7f63ba000640 1 -- 172.21.15.135:0/3907832461 learned_addr learned my addr 172.21.15.135:0/3907832461 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:47.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.535+0000 7f63ba000640 1 -- 172.21.15.135:0/3907832461 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63bc154040 msgr2=0x7f63bc154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:47.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.535+0000 7f63ba000640 1 --2- 172.21.15.135:0/3907832461 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63bc154040 0x7f63bc154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.535+0000 7f63ba000640 1 -- 172.21.15.135:0/3907832461 >> v2:172.21.15.135:3300/0 conn(0x7f63bc070dc0 msgr2=0x7f63bc0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:47.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.535+0000 7f63ba000640 1 --2- 172.21.15.135:0/3907832461 >> v2:172.21.15.135:3300/0 conn(0x7f63bc070dc0 0x7f63bc0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.535+0000 7f63ba000640 1 -- 172.21.15.135:0/3907832461 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63bc072b20 con 0x7f63bc15adf0 2024-05-14T09:40:47.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.539+0000 7f63ba000640 1 --2- 172.21.15.135:0/3907832461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc15adf0 0x7f63bc15a4b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f63bc08d3f0 tx=0x7f63a802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65b11be7067e4bd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:47.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.547+0000 7f63b9600640 1 -- 172.21.15.135:0/3907832461 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8037070 con 0x7f63bc15adf0 2024-05-14T09:40:47.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.547+0000 7f63b9600640 1 -- 172.21.15.135:0/3907832461 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a8032440 con 0x7f63bc15adf0 2024-05-14T09:40:47.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.547+0000 7f63b9600640 1 -- 172.21.15.135:0/3907832461 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8032810 con 0x7f63bc15adf0 2024-05-14T09:40:47.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.548+0000 7f63c1600640 1 -- 172.21.15.135:0/3907832461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc15adf0 msgr2=0x7f63bc15a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:47.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.548+0000 7f63c1600640 1 --2- 172.21.15.135:0/3907832461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc15adf0 0x7f63bc15a4b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f63bc08d3f0 tx=0x7f63a802a1e0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.548+0000 7f63c1600640 1 -- 172.21.15.135:0/3907832461 shutdown_connections 2024-05-14T09:40:47.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.548+0000 7f63c1600640 1 --2- 172.21.15.135:0/3907832461 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63bc154040 0x7f63bc154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.548+0000 7f63c1600640 1 --2- 172.21.15.135:0/3907832461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc15adf0 0x7f63bc15a4b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.548+0000 7f63c1600640 1 --2- 172.21.15.135:0/3907832461 >> v2:172.21.15.135:3300/0 conn(0x7f63bc070dc0 0x7f63bc0b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.548+0000 7f63c1600640 1 -- 172.21.15.135:0/3907832461 >> 172.21.15.135:0/3907832461 conn(0x7f63bc0702a0 msgr2=0x7f63bc0706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:47.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.548+0000 7f63c1600640 1 -- 172.21.15.135:0/3907832461 shutdown_connections 2024-05-14T09:40:47.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.549+0000 7f63c1600640 1 -- 172.21.15.135:0/3907832461 wait complete. 2024-05-14T09:40:47.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.552+0000 7f63c1600640 1 Processor -- start 2024-05-14T09:40:47.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.552+0000 7f63c1600640 1 -- start start 2024-05-14T09:40:47.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.553+0000 7f63c1600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63bc070dc0 0x7f63bc1f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:47.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.553+0000 7f63c1600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63bc154040 0x7f63bc1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:47.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.553+0000 7f63c1600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc15adf0 0x7f63bc1e6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:47.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.553+0000 7f63c1600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f63bc154990 con 0x7f63bc070dc0 2024-05-14T09:40:47.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.553+0000 7f63c1600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f63bc0c7be0 con 0x7f63bc15adf0 2024-05-14T09:40:47.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.553+0000 7f63c1600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f63bc0b55b0 con 0x7f63bc154040 2024-05-14T09:40:47.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.557+0000 7f63baa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63bc070dc0 0x7f63bc1f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:47.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.558+0000 7f63baa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63bc070dc0 0x7f63bc1f5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58828/0 (socket says 172.21.15.135:58828) 2024-05-14T09:40:47.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.558+0000 7f63baa00640 1 -- 172.21.15.135:0/953557442 learned_addr learned my addr 172.21.15.135:0/953557442 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:47.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.563+0000 7f63baa00640 1 -- 172.21.15.135:0/953557442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63bc154040 msgr2=0x7f63bc1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:47.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.563+0000 7f63baa00640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63bc154040 0x7f63bc1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.563+0000 7f63baa00640 1 -- 172.21.15.135:0/953557442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc15adf0 msgr2=0x7f63bc1e6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:47.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.563+0000 7f63baa00640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc15adf0 0x7f63bc1e6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:47.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.563+0000 7f63baa00640 1 -- 172.21.15.135:0/953557442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63bc15e660 con 0x7f63bc070dc0 2024-05-14T09:40:47.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.566+0000 7f63baa00640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63bc070dc0 0x7f63bc1f5940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00b440 tx=0x7f63ac00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:47.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.755+0000 7f63b2a00640 1 -- 172.21.15.135:0/953557442 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac011830 con 0x7f63bc070dc0 2024-05-14T09:40:47.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.756+0000 7f63b2a00640 1 -- 172.21.15.135:0/953557442 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ac016070 con 0x7f63bc070dc0 2024-05-14T09:40:47.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.756+0000 7f63b2a00640 1 -- 172.21.15.135:0/953557442 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac011c10 con 0x7f63bc070dc0 2024-05-14T09:40:47.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.756+0000 7f63c1600640 1 -- 172.21.15.135:0/953557442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63bc1f5e80 con 0x7f63bc070dc0 2024-05-14T09:40:47.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.756+0000 7f63c1600640 1 -- 172.21.15.135:0/953557442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63bc1f2460 con 0x7f63bc070dc0 2024-05-14T09:40:47.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:47.758+0000 7f63c1600640 1 -- 172.21.15.135:0/953557442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63bc076290 con 0x7f63bc070dc0 2024-05-14T09:40:48.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.192+0000 7f63b2a00640 1 -- 172.21.15.135:0/953557442 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f63ac01b460 con 0x7f63bc070dc0 2024-05-14T09:40:48.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.193+0000 7f63b2a00640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f639c076320 0x7f639c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:48.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.194+0000 7f63ba000640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f639c076320 0x7f639c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:48.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.196+0000 7f63ba000640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f639c076320 0x7f639c078830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f63a8034000 tx=0x7f63a802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:48.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.230+0000 7f63b2a00640 1 -- 172.21.15.135:0/953557442 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5709+0+0 (secure 0 0 0) 0x7f63ac05d260 con 0x7f63bc070dc0 2024-05-14T09:40:48.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.233+0000 7f63b2a00640 1 -- 172.21.15.135:0/953557442 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f63ac0616d0 con 0x7f63bc070dc0 2024-05-14T09:40:48.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.478+0000 7f63c1600640 1 -- 172.21.15.135:0/953557442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f63bc0cbe80 con 0x7f63bc070dc0 2024-05-14T09:40:48.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.883+0000 7f63b2a00640 1 -- 172.21.15.135:0/953557442 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v26) ==== 157+0+0 (secure 0 0 0) 0x7f63ac060fd0 con 0x7f63bc070dc0 2024-05-14T09:40:48.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.887+0000 7f63c1600640 1 -- 172.21.15.135:0/953557442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f639c076320 msgr2=0x7f639c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:48.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.887+0000 7f63c1600640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f639c076320 0x7f639c078830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f63a8034000 tx=0x7f63a802c000 comp rx=0 tx=0).stop 2024-05-14T09:40:48.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.887+0000 7f63c1600640 1 -- 172.21.15.135:0/953557442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63bc070dc0 msgr2=0x7f63bc1f5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:48.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.887+0000 7f63c1600640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63bc070dc0 0x7f63bc1f5940 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00b440 tx=0x7f63ac00b900 comp rx=0 tx=0).stop 2024-05-14T09:40:48.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.888+0000 7f63c1600640 1 -- 172.21.15.135:0/953557442 shutdown_connections 2024-05-14T09:40:48.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.888+0000 7f63c1600640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f639c076320 0x7f639c078830 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:48.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.888+0000 7f63c1600640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f63bc15adf0 0x7f63bc1e6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:48.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.888+0000 7f63c1600640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f63bc154040 0x7f63bc1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:48.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.888+0000 7f63c1600640 1 --2- 172.21.15.135:0/953557442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63bc070dc0 0x7f63bc1f5940 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:48.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.888+0000 7f63c1600640 1 -- 172.21.15.135:0/953557442 >> 172.21.15.135:0/953557442 conn(0x7f63bc0702a0 msgr2=0x7f63bc0c9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:48.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.888+0000 7f63c1600640 1 -- 172.21.15.135:0/953557442 shutdown_connections 2024-05-14T09:40:48.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:48.888+0000 7f63c1600640 1 -- 172.21.15.135:0/953557442 wait complete. 2024-05-14T09:40:48.915 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-14T09:40:49.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.200+0000 7f28ede00640 1 Processor -- start 2024-05-14T09:40:49.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.200+0000 7f28ede00640 1 -- start start 2024-05-14T09:40:49.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.202+0000 7f28ede00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e806cf80 0x7f28e815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:49.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.202+0000 7f28ede00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f28e80ce300 0x7f28e80ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:49.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.202+0000 7f28ede00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e815b010 con 0x7f28e806e110 2024-05-14T09:40:49.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.202+0000 7f28ede00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f28e80cd7f0 con 0x7f28e80ce300 2024-05-14T09:40:49.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.202+0000 7f28ede00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f28e80cca80 con 0x7f28e806cf80 2024-05-14T09:40:49.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.204+0000 7f28eca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e806cf80 0x7f28e815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:49.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.207+0000 7f28eca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e806cf80 0x7f28e815aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:45246/0 (socket says 172.21.15.135:45246) 2024-05-14T09:40:49.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.207+0000 7f28eca00640 1 -- 172.21.15.135:0/1065743373 learned_addr learned my addr 172.21.15.135:0/1065743373 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:49.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.210+0000 7f28ed400640 1 --2- 172.21.15.135:0/1065743373 >> v2:172.21.15.135:3300/0 conn(0x7f28e80ce300 0x7f28e80ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:49.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.214+0000 7f28eca00640 1 -- 172.21.15.135:0/1065743373 >> v2:172.21.15.135:3300/0 conn(0x7f28e80ce300 msgr2=0x7f28e80ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:49.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.214+0000 7f28eca00640 1 --2- 172.21.15.135:0/1065743373 >> v2:172.21.15.135:3300/0 conn(0x7f28e80ce300 0x7f28e80ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:49.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.214+0000 7f28eca00640 1 -- 172.21.15.135:0/1065743373 >> v1:172.21.15.135:6789/0 conn(0x7f28e806e110 legacy=0x7f28e8154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:49.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.214+0000 7f28eca00640 1 -- 172.21.15.135:0/1065743373 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e80cda40 con 0x7f28e806cf80 2024-05-14T09:40:49.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.221+0000 7f28eca00640 1 --2- 172.21.15.135:0/1065743373 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e806cf80 0x7f28e815aad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009850 tx=0x7f28dc02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=371f710e05f193e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:49.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.234+0000 7f28e7400640 1 -- 172.21.15.135:0/1065743373 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc004030 con 0x7f28e806cf80 2024-05-14T09:40:49.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.234+0000 7f28e7400640 1 -- 172.21.15.135:0/1065743373 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28dc0041d0 con 0x7f28e806cf80 2024-05-14T09:40:49.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.234+0000 7f28e7400640 1 -- 172.21.15.135:0/1065743373 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc003610 con 0x7f28e806cf80 2024-05-14T09:40:49.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.236+0000 7f28ede00640 1 -- 172.21.15.135:0/1065743373 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e806cf80 msgr2=0x7f28e815aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:49.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.236+0000 7f28ede00640 1 --2- 172.21.15.135:0/1065743373 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e806cf80 0x7f28e815aad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009850 tx=0x7f28dc02a230 comp rx=0 tx=0).stop 2024-05-14T09:40:49.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.236+0000 7f28ede00640 1 -- 172.21.15.135:0/1065743373 shutdown_connections 2024-05-14T09:40:49.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.236+0000 7f28ede00640 1 --2- 172.21.15.135:0/1065743373 >> v2:172.21.15.135:3300/0 conn(0x7f28e80ce300 0x7f28e80ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:49.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.236+0000 7f28ede00640 1 --2- 172.21.15.135:0/1065743373 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e806cf80 0x7f28e815aad0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:49.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.236+0000 7f28ede00640 1 -- 172.21.15.135:0/1065743373 >> 172.21.15.135:0/1065743373 conn(0x7f28e8070ee0 msgr2=0x7f28e80722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:49.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.236+0000 7f28ede00640 1 -- 172.21.15.135:0/1065743373 shutdown_connections 2024-05-14T09:40:49.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.236+0000 7f28ede00640 1 -- 172.21.15.135:0/1065743373 wait complete. 2024-05-14T09:40:49.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.241+0000 7f28ede00640 1 Processor -- start 2024-05-14T09:40:49.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.241+0000 7f28ede00640 1 -- start start 2024-05-14T09:40:49.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.244+0000 7f28ede00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e806cf80 0x7f28e80c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:49.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.244+0000 7f28ede00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28e806e110 0x7f28e80c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:49.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.244+0000 7f28ede00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e80ce300 0x7f28e8144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:49.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.244+0000 7f28ede00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80cc430 con 0x7f28e806cf80 2024-05-14T09:40:49.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.244+0000 7f28ede00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80cc150 con 0x7f28e806e110 2024-05-14T09:40:49.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.244+0000 7f28ede00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f28e80cc710 con 0x7f28e80ce300 2024-05-14T09:40:49.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.246+0000 7f28e7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28e806e110 0x7f28e80c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:49.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.247+0000 7f28ed400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e80ce300 0x7f28e8144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:49.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.247+0000 7f28e7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28e806e110 0x7f28e80c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:37624/0 (socket says 172.21.15.135:37624) 2024-05-14T09:40:49.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.247+0000 7f28e7e00640 1 -- 172.21.15.135:0/2479080823 learned_addr learned my addr 172.21.15.135:0/2479080823 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:49.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.253+0000 7f28eca00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e806cf80 0x7f28e80c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:49.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.260+0000 7f28eca00640 1 -- 172.21.15.135:0/2479080823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e80ce300 msgr2=0x7f28e8144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:49.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.260+0000 7f28eca00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e80ce300 0x7f28e8144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:49.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.260+0000 7f28eca00640 1 -- 172.21.15.135:0/2479080823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28e806e110 msgr2=0x7f28e80c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:49.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.260+0000 7f28eca00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28e806e110 0x7f28e80c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:49.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.260+0000 7f28eca00640 1 -- 172.21.15.135:0/2479080823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e80c48e0 con 0x7f28e806cf80 2024-05-14T09:40:49.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.263+0000 7f28eca00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e806cf80 0x7f28e80c9d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f28dc004000 tx=0x7f28dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:49.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.269+0000 7f28e4c00640 1 -- 172.21.15.135:0/2479080823 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc041030 con 0x7f28e806cf80 2024-05-14T09:40:49.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.269+0000 7f28e4c00640 1 -- 172.21.15.135:0/2479080823 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28dc003bd0 con 0x7f28e806cf80 2024-05-14T09:40:49.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.269+0000 7f28e4c00640 1 -- 172.21.15.135:0/2479080823 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc004030 con 0x7f28e806cf80 2024-05-14T09:40:49.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.269+0000 7f28ede00640 1 -- 172.21.15.135:0/2479080823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e814b7e0 con 0x7f28e806cf80 2024-05-14T09:40:49.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.269+0000 7f28ede00640 1 -- 172.21.15.135:0/2479080823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e81f5760 con 0x7f28e806cf80 2024-05-14T09:40:49.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.270+0000 7f28ede00640 1 -- 172.21.15.135:0/2479080823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e8076290 con 0x7f28e806cf80 2024-05-14T09:40:49.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.618+0000 7f28e4c00640 1 -- 172.21.15.135:0/2479080823 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f28dc044070 con 0x7f28e806cf80 2024-05-14T09:40:49.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.620+0000 7f28e4c00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f28c8076300 0x7f28c8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:49.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.620+0000 7f28e7e00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f28c8076300 0x7f28c8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:49.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.622+0000 7f28e7e00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f28c8076300 0x7f28c8078810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28e81f2d60 tx=0x7f28d4009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:49.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.653+0000 7f28e4c00640 1 -- 172.21.15.135:0/2479080823 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6007+0+0 (secure 0 0 0) 0x7f28dc003d80 con 0x7f28e806cf80 2024-05-14T09:40:49.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.654+0000 7f28e4c00640 1 -- 172.21.15.135:0/2479080823 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f28e815b010 con 0x7f28e806cf80 2024-05-14T09:40:49.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:49.878+0000 7f28ede00640 1 -- 172.21.15.135:0/2479080823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f28e81f5e20 con 0x7f28e806cf80 2024-05-14T09:40:52.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.204+0000 7f28e4c00640 1 -- 172.21.15.135:0/2479080823 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v28) ==== 228+0+0 (secure 0 0 0) 0x7f28dc081680 con 0x7f28e806cf80 2024-05-14T09:40:52.204 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data_ec' created 2024-05-14T09:40:52.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.207+0000 7f28ede00640 1 -- 172.21.15.135:0/2479080823 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f28c8076300 msgr2=0x7f28c8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:52.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.207+0000 7f28ede00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f28c8076300 0x7f28c8078810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28e81f2d60 tx=0x7f28d4009110 comp rx=0 tx=0).stop 2024-05-14T09:40:52.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.207+0000 7f28ede00640 1 -- 172.21.15.135:0/2479080823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e806cf80 msgr2=0x7f28e80c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:52.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.207+0000 7f28ede00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e806cf80 0x7f28e80c9d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f28dc004000 tx=0x7f28dc0046c0 comp rx=0 tx=0).stop 2024-05-14T09:40:52.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.208+0000 7f28ede00640 1 -- 172.21.15.135:0/2479080823 shutdown_connections 2024-05-14T09:40:52.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.208+0000 7f28ede00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f28c8076300 0x7f28c8078810 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:52.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.208+0000 7f28ede00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f28e806e110 0x7f28e80c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:52.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.208+0000 7f28ede00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f28e80ce300 0x7f28e8144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:52.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.208+0000 7f28ede00640 1 --2- 172.21.15.135:0/2479080823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28e806cf80 0x7f28e80c9d40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:52.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.208+0000 7f28ede00640 1 -- 172.21.15.135:0/2479080823 >> 172.21.15.135:0/2479080823 conn(0x7f28e8070ee0 msgr2=0x7f28e8071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:52.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.208+0000 7f28ede00640 1 -- 172.21.15.135:0/2479080823 shutdown_connections 2024-05-14T09:40:52.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.208+0000 7f28ede00640 1 -- 172.21.15.135:0/2479080823 wait complete. 2024-05-14T09:40:52.240 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-14T09:40:52.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.536+0000 7f4fc0c00640 1 Processor -- start 2024-05-14T09:40:52.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.536+0000 7f4fc0c00640 1 -- start start 2024-05-14T09:40:52.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.539+0000 7f4fc0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4fbc06d270 0x7f4fbc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:52.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.539+0000 7f4fc0c00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fbc074ce0 con 0x7f4fbc071f70 2024-05-14T09:40:52.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.539+0000 7f4fc0c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fbc074a00 con 0x7f4fbc15ab20 2024-05-14T09:40:52.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.539+0000 7f4fc0c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4fbc06cde0 con 0x7f4fbc06d270 2024-05-14T09:40:52.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.540+0000 7f4fb9400640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f4fbc071f70 0x7f4fbc0c6c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:36226/0 (socket says 172.21.15.135:36226) 2024-05-14T09:40:52.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.540+0000 7f4fb9400640 1 -- 172.21.15.135:0/3676475609 learned_addr learned my addr 172.21.15.135:0/3676475609 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:40:52.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.541+0000 7f4fba800640 1 --2- 172.21.15.135:0/3676475609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4fbc06d270 0x7f4fbc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:52.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.544+0000 7f4fb8a00640 1 -- 172.21.15.135:0/3676475609 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848322948 0 0) 0x7f4fbc074ce0 con 0x7f4fbc071f70 2024-05-14T09:40:52.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.544+0000 7f4fb8a00640 1 -- 172.21.15.135:0/3676475609 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fa0003520 con 0x7f4fbc071f70 2024-05-14T09:40:52.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.549+0000 7f4fba800640 1 -- 172.21.15.135:0/3676475609 >> v1:172.21.15.196:6789/0 conn(0x7f4fbc15ab20 legacy=0x7f4fbc153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:52.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.549+0000 7f4fba800640 1 -- 172.21.15.135:0/3676475609 >> v1:172.21.15.135:6789/0 conn(0x7f4fbc071f70 legacy=0x7f4fbc0c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:52.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.549+0000 7f4fba800640 1 -- 172.21.15.135:0/3676475609 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fbc06c790 con 0x7f4fbc06d270 2024-05-14T09:40:52.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.555+0000 7f4fba800640 1 --2- 172.21.15.135:0/3676475609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4fbc06d270 0x7f4fbc06d680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40097d0 tx=0x7f4fb402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb3d181562fec3f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:52.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.568+0000 7f4fb8a00640 1 -- 172.21.15.135:0/3676475609 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4037070 con 0x7f4fbc06d270 2024-05-14T09:40:52.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.568+0000 7f4fb8a00640 1 -- 172.21.15.135:0/3676475609 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb4032440 con 0x7f4fbc06d270 2024-05-14T09:40:52.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.568+0000 7f4fb8a00640 1 -- 172.21.15.135:0/3676475609 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4032810 con 0x7f4fbc06d270 2024-05-14T09:40:52.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.569+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3676475609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4fbc06d270 msgr2=0x7f4fbc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:52.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.569+0000 7f4fc0c00640 1 --2- 172.21.15.135:0/3676475609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4fbc06d270 0x7f4fbc06d680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40097d0 tx=0x7f4fb402a210 comp rx=0 tx=0).stop 2024-05-14T09:40:52.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.569+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3676475609 shutdown_connections 2024-05-14T09:40:52.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.569+0000 7f4fc0c00640 1 --2- 172.21.15.135:0/3676475609 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4fbc06d270 0x7f4fbc06d680 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:52.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.569+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3676475609 >> 172.21.15.135:0/3676475609 conn(0x7f4fbc073d40 msgr2=0x7f4fbc074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:52.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.569+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3676475609 shutdown_connections 2024-05-14T09:40:52.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.570+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3676475609 wait complete. 2024-05-14T09:40:52.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.572+0000 7f4fc0c00640 1 Processor -- start 2024-05-14T09:40:52.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.572+0000 7f4fc0c00640 1 -- start start 2024-05-14T09:40:52.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.573+0000 7f4fc0c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fbc06d270 0x7f4fbc156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:52.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.573+0000 7f4fc0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4fbc071f70 0x7f4fbc150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:52.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.574+0000 7f4fc0c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fbc15ab20 0x7f4fbc1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:52.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.574+0000 7f4fc0c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc154680 con 0x7f4fbc06d270 2024-05-14T09:40:52.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.574+0000 7f4fc0c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc06dbc0 con 0x7f4fbc15ab20 2024-05-14T09:40:52.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.574+0000 7f4fc0c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4fbc0c4690 con 0x7f4fbc071f70 2024-05-14T09:40:52.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.574+0000 7f4fb9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fbc06d270 0x7f4fbc156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:52.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.575+0000 7f4fb9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fbc06d270 0x7f4fbc156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58856/0 (socket says 172.21.15.135:58856) 2024-05-14T09:40:52.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.575+0000 7f4fb9e00640 1 -- 172.21.15.135:0/3895127403 learned_addr learned my addr 172.21.15.135:0/3895127403 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:52.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.575+0000 7f4fba800640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fbc15ab20 0x7f4fbc1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:52.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.576+0000 7f4fb9400640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4fbc071f70 0x7f4fbc150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:52.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.580+0000 7f4fb9e00640 1 -- 172.21.15.135:0/3895127403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4fbc071f70 msgr2=0x7f4fbc150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:52.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.580+0000 7f4fb9e00640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4fbc071f70 0x7f4fbc150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:52.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.580+0000 7f4fb9e00640 1 -- 172.21.15.135:0/3895127403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fbc15ab20 msgr2=0x7f4fbc1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:52.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.580+0000 7f4fb9e00640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fbc15ab20 0x7f4fbc1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:52.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.580+0000 7f4fb9e00640 1 -- 172.21.15.135:0/3895127403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fbc1f57d0 con 0x7f4fbc06d270 2024-05-14T09:40:52.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.583+0000 7f4fb9e00640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fbc06d270 0x7f4fbc156b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c7b0 tx=0x7f4fac00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.590+0000 7f4fb2000640 1 -- 172.21.15.135:0/3895127403 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fac00ce60 con 0x7f4fbc06d270 2024-05-14T09:40:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.590+0000 7f4fb2000640 1 -- 172.21.15.135:0/3895127403 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fac003b70 con 0x7f4fbc06d270 2024-05-14T09:40:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.590+0000 7f4fb2000640 1 -- 172.21.15.135:0/3895127403 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fac00a7f0 con 0x7f4fbc06d270 2024-05-14T09:40:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.590+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3895127403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fbc15db80 con 0x7f4fbc06d270 2024-05-14T09:40:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.590+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3895127403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fbc1f5d50 con 0x7f4fbc06d270 2024-05-14T09:40:52.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.592+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3895127403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fbc0739d0 con 0x7f4fbc06d270 2024-05-14T09:40:52.939 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:40:52.947 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:40:52.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.955+0000 7f4fb2000640 1 -- 172.21.15.135:0/3895127403 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4fac00a990 con 0x7f4fbc06d270 2024-05-14T09:40:52.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.957+0000 7f4fb2000640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f98076350 0x7f4f98078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:52.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.957+0000 7f4fb9400640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f98076350 0x7f4f98078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:52.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.958+0000 7f4fb9400640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f98076350 0x7f4f98078860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc1589a0 tx=0x7f4fa4006aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:52.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.981+0000 7f4fb2000640 1 -- 172.21.15.135:0/3895127403 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6500+0+0 (secure 0 0 0) 0x7f4fac05d410 con 0x7f4fbc06d270 2024-05-14T09:40:52.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:52.981+0000 7f4fb2000640 1 -- 172.21.15.135:0/3895127403 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4fbc0739d0 con 0x7f4fbc06d270 2024-05-14T09:40:53.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:53.201+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3895127403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f4fbc069a60 con 0x7f4fbc06d270 2024-05-14T09:40:54.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.432+0000 7f4fb2000640 1 -- 172.21.15.135:0/3895127403 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v30) ==== 169+0+0 (secure 0 0 0) 0x7f4fac061180 con 0x7f4fbc06d270 2024-05-14T09:40:54.432 INFO:teuthology.orchestra.run.smithi135.stderr:set pool 4 allow_ec_overwrites to true 2024-05-14T09:40:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.436+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3895127403 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f98076350 msgr2=0x7f4f98078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.436+0000 7f4fc0c00640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f98076350 0x7f4f98078860 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc1589a0 tx=0x7f4fa4006aa0 comp rx=0 tx=0).stop 2024-05-14T09:40:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.436+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3895127403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fbc06d270 msgr2=0x7f4fbc156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.436+0000 7f4fc0c00640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fbc06d270 0x7f4fbc156b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c7b0 tx=0x7f4fac00cc70 comp rx=0 tx=0).stop 2024-05-14T09:40:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.436+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3895127403 shutdown_connections 2024-05-14T09:40:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.436+0000 7f4fc0c00640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f98076350 0x7f4f98078860 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.436+0000 7f4fc0c00640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fbc15ab20 0x7f4fbc1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.436+0000 7f4fc0c00640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4fbc071f70 0x7f4fbc150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.436+0000 7f4fc0c00640 1 --2- 172.21.15.135:0/3895127403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fbc06d270 0x7f4fbc156b40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.436+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3895127403 >> 172.21.15.135:0/3895127403 conn(0x7f4fbc073d40 msgr2=0x7f4fbc0c2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.436+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3895127403 shutdown_connections 2024-05-14T09:40:54.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.437+0000 7f4fc0c00640 1 -- 172.21.15.135:0/3895127403 wait complete. 2024-05-14T09:40:54.464 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-14T09:40:54.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.729+0000 7fb99e000640 1 Processor -- start 2024-05-14T09:40:54.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.729+0000 7fb99e000640 1 -- start start 2024-05-14T09:40:54.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.731+0000 7fb99e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 0x7fb9981530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:54.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.731+0000 7fb99e000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb9980c8680 0x7fb9980c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:54.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.731+0000 7fb99e000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9981535f0 con 0x7fb998071a70 2024-05-14T09:40:54.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.731+0000 7fb99e000640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb9980c8fd0 con 0x7fb9980c8680 2024-05-14T09:40:54.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.731+0000 7fb99e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb998159470 con 0x7fb998158ec0 2024-05-14T09:40:54.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.734+0000 7fb99cc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 0x7fb9981530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:54.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.735+0000 7fb99cc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 0x7fb9981530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:36558/0 (socket says 172.21.15.135:36558) 2024-05-14T09:40:54.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.735+0000 7fb99cc00640 1 -- 172.21.15.135:0/407062651 learned_addr learned my addr 172.21.15.135:0/407062651 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:54.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.736+0000 7fb99d600640 1 --2- 172.21.15.135:0/407062651 >> v2:172.21.15.135:3300/0 conn(0x7fb9980c8680 0x7fb9980c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.742+0000 7fb99cc00640 1 -- 172.21.15.135:0/407062651 >> v2:172.21.15.135:3300/0 conn(0x7fb9980c8680 msgr2=0x7fb9980c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.742+0000 7fb99cc00640 1 --2- 172.21.15.135:0/407062651 >> v2:172.21.15.135:3300/0 conn(0x7fb9980c8680 0x7fb9980c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.742+0000 7fb99cc00640 1 -- 172.21.15.135:0/407062651 >> v1:172.21.15.135:6789/0 conn(0x7fb998071a70 legacy=0x7fb998070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.742+0000 7fb99cc00640 1 -- 172.21.15.135:0/407062651 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb998159730 con 0x7fb998158ec0 2024-05-14T09:40:54.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.759+0000 7fb99cc00640 1 --2- 172.21.15.135:0/407062651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 0x7fb9981530b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009870 tx=0x7fb98c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=105c5ddffebd152f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:54.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.879+0000 7fb997400640 1 -- 172.21.15.135:0/407062651 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c037070 con 0x7fb998158ec0 2024-05-14T09:40:54.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.879+0000 7fb997400640 1 -- 172.21.15.135:0/407062651 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c032440 con 0x7fb998158ec0 2024-05-14T09:40:54.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.879+0000 7fb997400640 1 -- 172.21.15.135:0/407062651 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c032810 con 0x7fb998158ec0 2024-05-14T09:40:54.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.881+0000 7fb99e000640 1 -- 172.21.15.135:0/407062651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 msgr2=0x7fb9981530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:54.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.881+0000 7fb99e000640 1 --2- 172.21.15.135:0/407062651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 0x7fb9981530b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009870 tx=0x7fb98c02a250 comp rx=0 tx=0).stop 2024-05-14T09:40:54.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.881+0000 7fb99e000640 1 -- 172.21.15.135:0/407062651 shutdown_connections 2024-05-14T09:40:54.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.881+0000 7fb99e000640 1 --2- 172.21.15.135:0/407062651 >> v2:172.21.15.135:3300/0 conn(0x7fb9980c8680 0x7fb9980c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:54.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.881+0000 7fb99e000640 1 --2- 172.21.15.135:0/407062651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 0x7fb9981530b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:54.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.881+0000 7fb99e000640 1 -- 172.21.15.135:0/407062651 >> 172.21.15.135:0/407062651 conn(0x7fb9980ca160 msgr2=0x7fb9980ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:54.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.882+0000 7fb99e000640 1 -- 172.21.15.135:0/407062651 shutdown_connections 2024-05-14T09:40:54.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.882+0000 7fb99e000640 1 -- 172.21.15.135:0/407062651 wait complete. 2024-05-14T09:40:54.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.887+0000 7fb99e000640 1 Processor -- start 2024-05-14T09:40:54.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.887+0000 7fb99e000640 1 -- start start 2024-05-14T09:40:54.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.891+0000 7fb99e000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb998071a70 0x7fb9981f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:54.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.891+0000 7fb99e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980c8680 0x7fb9981513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:54.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.891+0000 7fb99e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 0x7fb998146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:54.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.891+0000 7fb99e000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb9980c7e80 con 0x7fb9980c8680 2024-05-14T09:40:54.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.891+0000 7fb99e000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb998159cf0 con 0x7fb998071a70 2024-05-14T09:40:54.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.891+0000 7fb99e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb9980c8160 con 0x7fb998158ec0 2024-05-14T09:40:54.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.892+0000 7fb99cc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb998071a70 0x7fb9981f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:54.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.892+0000 7fb997e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980c8680 0x7fb9981513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:54.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.893+0000 7fb99cc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb998071a70 0x7fb9981f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:41860/0 (socket says 172.21.15.135:41860) 2024-05-14T09:40:54.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.893+0000 7fb99cc00640 1 -- 172.21.15.135:0/4260489145 learned_addr learned my addr 172.21.15.135:0/4260489145 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:54.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.893+0000 7fb99d600640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 0x7fb998146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:54.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.899+0000 7fb997e00640 1 -- 172.21.15.135:0/4260489145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 msgr2=0x7fb998146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:54.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.899+0000 7fb997e00640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 0x7fb998146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:54.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.899+0000 7fb997e00640 1 -- 172.21.15.135:0/4260489145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb998071a70 msgr2=0x7fb9981f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.899+0000 7fb997e00640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb998071a70 0x7fb9981f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.899+0000 7fb997e00640 1 -- 172.21.15.135:0/4260489145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb998151900 con 0x7fb9980c8680 2024-05-14T09:40:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.899+0000 7fb99d600640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 0x7fb998146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:40:54.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.903+0000 7fb997e00640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980c8680 0x7fb9981513c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb98400b3e0 tx=0x7fb98400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:54.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.910+0000 7fb994c00640 1 -- 172.21.15.135:0/4260489145 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984015030 con 0x7fb9980c8680 2024-05-14T09:40:54.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.910+0000 7fb994c00640 1 -- 172.21.15.135:0/4260489145 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb984004020 con 0x7fb9980c8680 2024-05-14T09:40:54.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.910+0000 7fb994c00640 1 -- 172.21.15.135:0/4260489145 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984004450 con 0x7fb9980c8680 2024-05-14T09:40:54.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.910+0000 7fb99e000640 1 -- 172.21.15.135:0/4260489145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99814e560 con 0x7fb9980c8680 2024-05-14T09:40:54.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.910+0000 7fb99e000640 1 -- 172.21.15.135:0/4260489145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99814eb20 con 0x7fb9980c8680 2024-05-14T09:40:54.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.912+0000 7fb99e000640 1 -- 172.21.15.135:0/4260489145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99814e2c0 con 0x7fb9980c8680 2024-05-14T09:40:54.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.943+0000 7fb994c00640 1 -- 172.21.15.135:0/4260489145 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb984018070 con 0x7fb9980c8680 2024-05-14T09:40:54.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.945+0000 7fb994c00640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb978076320 0x7fb978078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:54.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.946+0000 7fb99cc00640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb978076320 0x7fb978078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:54.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.947+0000 7fb99cc00640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb978076320 0x7fb978078830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb98c02a290 tx=0x7fb98c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:54.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:54.949+0000 7fb994c00640 1 -- 172.21.15.135:0/4260489145 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6500+0+0 (secure 0 0 0) 0x7fb98401bde0 con 0x7fb9980c8680 2024-05-14T09:40:55.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:55.271+0000 7fb994c00640 1 -- 172.21.15.135:0/4260489145 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb99814e2c0 con 0x7fb9980c8680 2024-05-14T09:40:55.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:55.548+0000 7fb99e000640 1 -- 172.21.15.135:0/4260489145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fb998069980 con 0x7fb9980c8680 2024-05-14T09:40:56.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.566+0000 7fb994c00640 1 -- 172.21.15.135:0/4260489145 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fb984060a70 con 0x7fb9980c8680 2024-05-14T09:40:56.567 INFO:teuthology.orchestra.run.smithi135.stderr:added data pool 4 to fsmap 2024-05-14T09:40:56.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.569+0000 7fb99e000640 1 -- 172.21.15.135:0/4260489145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb978076320 msgr2=0x7fb978078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:56.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.569+0000 7fb99e000640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb978076320 0x7fb978078830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb98c02a290 tx=0x7fb98c02e000 comp rx=0 tx=0).stop 2024-05-14T09:40:56.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.569+0000 7fb99e000640 1 -- 172.21.15.135:0/4260489145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980c8680 msgr2=0x7fb9981513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:56.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.569+0000 7fb99e000640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980c8680 0x7fb9981513c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb98400b3e0 tx=0x7fb98400b8a0 comp rx=0 tx=0).stop 2024-05-14T09:40:56.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.569+0000 7fb99e000640 1 -- 172.21.15.135:0/4260489145 shutdown_connections 2024-05-14T09:40:56.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.569+0000 7fb99e000640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb978076320 0x7fb978078830 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:56.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.569+0000 7fb99e000640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb998158ec0 0x7fb998146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:56.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.569+0000 7fb99e000640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9980c8680 0x7fb9981513c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:56.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.569+0000 7fb99e000640 1 --2- 172.21.15.135:0/4260489145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb998071a70 0x7fb9981f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:56.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.569+0000 7fb99e000640 1 -- 172.21.15.135:0/4260489145 >> 172.21.15.135:0/4260489145 conn(0x7fb9980ca160 msgr2=0x7fb9980ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:56.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.570+0000 7fb99e000640 1 -- 172.21.15.135:0/4260489145 shutdown_connections 2024-05-14T09:40:56.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.570+0000 7fb99e000640 1 -- 172.21.15.135:0/4260489145 wait complete. 2024-05-14T09:40:56.598 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T09:40:56.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.864+0000 7f6d2be00640 1 Processor -- start 2024-05-14T09:40:56.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.864+0000 7f6d2be00640 1 -- start start 2024-05-14T09:40:56.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.866+0000 7f6d2be00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6d2c15f800 0x7f6d2c15fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:56.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.866+0000 7f6d2be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6d2c160150 0x7f6d2c166b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:56.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.866+0000 7f6d2be00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d2c0cd490 con 0x7f6d2c1563f0 2024-05-14T09:40:56.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.866+0000 7f6d2be00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f6d2c06dad0 con 0x7f6d2c15f800 2024-05-14T09:40:56.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.866+0000 7f6d2be00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f6d2c0cc710 con 0x7f6d2c160150 2024-05-14T09:40:56.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.868+0000 7f6d2b400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6d2c160150 0x7f6d2c166b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:56.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.869+0000 7f6d2aa00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f6d2c1563f0 0x7f6d2c0c66c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:35780/0 (socket says 172.21.15.135:35780) 2024-05-14T09:40:56.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.869+0000 7f6d2aa00640 1 -- 172.21.15.135:0/1911254887 learned_addr learned my addr 172.21.15.135:0/1911254887 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:40:56.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.879+0000 7f6d2b400640 1 -- 172.21.15.135:0/1911254887 >> v2:172.21.15.135:3300/0 conn(0x7f6d2c15f800 msgr2=0x7f6d2c15fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:56.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.879+0000 7f6d2b400640 1 --2- 172.21.15.135:0/1911254887 >> v2:172.21.15.135:3300/0 conn(0x7f6d2c15f800 0x7f6d2c15fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:56.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.879+0000 7f6d2b400640 1 -- 172.21.15.135:0/1911254887 >> v1:172.21.15.196:6789/0 conn(0x7f6d2c1563f0 legacy=0x7f6d2c0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:56.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.879+0000 7f6d2b400640 1 -- 172.21.15.135:0/1911254887 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c06df60 con 0x7f6d2c160150 2024-05-14T09:40:56.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.893+0000 7f6d2b400640 1 --2- 172.21.15.135:0/1911254887 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d2c160150 0x7f6d2c166b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c06e5a0 tx=0x7f6d2402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b84bec952005adf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:56.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.905+0000 7f6d2a000640 1 -- 172.21.15.135:0/1911254887 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24007740 con 0x7f6d2c160150 2024-05-14T09:40:56.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.905+0000 7f6d2a000640 1 -- 172.21.15.135:0/1911254887 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d240078e0 con 0x7f6d2c160150 2024-05-14T09:40:56.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.905+0000 7f6d2a000640 1 -- 172.21.15.135:0/1911254887 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24007cb0 con 0x7f6d2c160150 2024-05-14T09:40:56.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.906+0000 7f6d2be00640 1 -- 172.21.15.135:0/1911254887 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d2c160150 msgr2=0x7f6d2c166b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:56.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.906+0000 7f6d2be00640 1 --2- 172.21.15.135:0/1911254887 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d2c160150 0x7f6d2c166b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c06e5a0 tx=0x7f6d2402a680 comp rx=0 tx=0).stop 2024-05-14T09:40:56.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.906+0000 7f6d2be00640 1 -- 172.21.15.135:0/1911254887 shutdown_connections 2024-05-14T09:40:56.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.906+0000 7f6d2be00640 1 --2- 172.21.15.135:0/1911254887 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d2c160150 0x7f6d2c166b90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:56.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.906+0000 7f6d2be00640 1 --2- 172.21.15.135:0/1911254887 >> v2:172.21.15.135:3300/0 conn(0x7f6d2c15f800 0x7f6d2c15fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:56.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.906+0000 7f6d2be00640 1 -- 172.21.15.135:0/1911254887 >> 172.21.15.135:0/1911254887 conn(0x7f6d2c08de20 msgr2=0x7f6d2c0ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:56.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.907+0000 7f6d2be00640 1 -- 172.21.15.135:0/1911254887 shutdown_connections 2024-05-14T09:40:56.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.907+0000 7f6d2be00640 1 -- 172.21.15.135:0/1911254887 wait complete. 2024-05-14T09:40:56.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.911+0000 7f6d2be00640 1 Processor -- start 2024-05-14T09:40:56.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.912+0000 7f6d2be00640 1 -- start start 2024-05-14T09:40:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.914+0000 7f6d2be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d2c1563f0 0x7f6d2c151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.914+0000 7f6d2be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d2c15f800 0x7f6d2c154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.915+0000 7f6d2be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d2c160150 0x7f6d2c14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.915+0000 7f6d2be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c06d1a0 con 0x7f6d2c1563f0 2024-05-14T09:40:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.915+0000 7f6d2be00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2c0cc9d0 con 0x7f6d2c160150 2024-05-14T09:40:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.915+0000 7f6d2be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2c06d480 con 0x7f6d2c15f800 2024-05-14T09:40:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.916+0000 7f6d2b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d2c160150 0x7f6d2c14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.917+0000 7f6d23e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d2c15f800 0x7f6d2c154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.917+0000 7f6d2b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d2c160150 0x7f6d2c14fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:41882/0 (socket says 172.21.15.135:41882) 2024-05-14T09:40:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.917+0000 7f6d2b400640 1 -- 172.21.15.135:0/2383690341 learned_addr learned my addr 172.21.15.135:0/2383690341 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.929+0000 7f6d2b400640 1 -- 172.21.15.135:0/2383690341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d2c15f800 msgr2=0x7f6d2c154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.929+0000 7f6d2b400640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d2c15f800 0x7f6d2c154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.929+0000 7f6d2b400640 1 -- 172.21.15.135:0/2383690341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d2c1563f0 msgr2=0x7f6d2c151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.929+0000 7f6d2b400640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d2c1563f0 0x7f6d2c151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:56.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.929+0000 7f6d2b400640 1 -- 172.21.15.135:0/2383690341 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2c1f6a90 con 0x7f6d2c160150 2024-05-14T09:40:56.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.936+0000 7f6d2b400640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d2c160150 0x7f6d2c14fc40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d2402ac70 tx=0x7f6d24004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.948+0000 7f6d22a00640 1 -- 172.21.15.135:0/2383690341 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24040070 con 0x7f6d2c160150 2024-05-14T09:40:56.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.948+0000 7f6d22a00640 1 -- 172.21.15.135:0/2383690341 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d24031cd0 con 0x7f6d2c160150 2024-05-14T09:40:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.948+0000 7f6d22a00640 1 -- 172.21.15.135:0/2383690341 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24045680 con 0x7f6d2c160150 2024-05-14T09:40:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.948+0000 7f6d2be00640 1 -- 172.21.15.135:0/2383690341 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2c1f2a70 con 0x7f6d2c160150 2024-05-14T09:40:56.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.949+0000 7f6d2be00640 1 -- 172.21.15.135:0/2383690341 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d2c1f6d50 con 0x7f6d2c160150 2024-05-14T09:40:56.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:56.950+0000 7f6d2be00640 1 -- 172.21.15.135:0/2383690341 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d2c069980 con 0x7f6d2c160150 2024-05-14T09:40:57.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.315+0000 7f6d22a00640 1 -- 172.21.15.135:0/2383690341 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6d24039040 con 0x7f6d2c160150 2024-05-14T09:40:57.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.317+0000 7f6d22a00640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6d08076320 0x7f6d08078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.317+0000 7f6d22a00640 1 -- 172.21.15.135:0/2383690341 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6532+0+0 (secure 0 0 0) 0x7f6d240b9530 con 0x7f6d2c160150 2024-05-14T09:40:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.318+0000 7f6d2aa00640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6d08076320 0x7f6d08078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.319+0000 7f6d2aa00640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6d08076320 0x7f6d08078830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c000f60 tx=0x7f6d1c007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:57.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.324+0000 7f6d22a00640 1 -- 172.21.15.135:0/2383690341 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6d24082c40 con 0x7f6d2c160150 2024-05-14T09:40:57.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.591+0000 7f6d2be00640 1 -- 172.21.15.135:0/2383690341 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d2c15ff30 con 0x7f6d2c160150 2024-05-14T09:40:57.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.644+0000 7f6d22a00640 1 -- 172.21.15.135:0/2383690341 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6843 (secure 0 0 0) 0x7f6d24082540 con 0x7f6d2c160150 2024-05-14T09:40:57.645 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:40:57.645 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4032169993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4032169993},{"type":"v1","addr":"172.21.15.135:6837","nonce":4032169993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/1397919075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":1397919075},{"type":"v1","addr":"172.21.15.196:6833","nonce":1397919075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/4240420134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":4240420134},{"type":"v1","addr":"172.21.15.196:6835","nonce":4240420134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4240,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3270089159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3270089159},{"type":"v1","addr":"172.21.15.135:6835","nonce":3270089159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4252,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2302038485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2302038485},{"type":"v1","addr":"172.21.15.135:6839","nonce":2302038485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T09:40:45.555908+0000","modified":"2024-05-14T09:40:55.597336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6837/3644723215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3644723215},{"type":"v1","addr":"172.21.15.196:6837","nonce":3644723215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4255,"qdb_cluster":[4255]},"id":1}]} 2024-05-14T09:40:57.645 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 7 2024-05-14T09:40:57.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 -- 172.21.15.135:0/2383690341 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6d08076320 msgr2=0x7f6d08078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6d08076320 0x7f6d08078830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c000f60 tx=0x7f6d1c007a80 comp rx=0 tx=0).stop 2024-05-14T09:40:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 -- 172.21.15.135:0/2383690341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d2c160150 msgr2=0x7f6d2c14fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d2c160150 0x7f6d2c14fc40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d2402ac70 tx=0x7f6d24004a40 comp rx=0 tx=0).stop 2024-05-14T09:40:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 -- 172.21.15.135:0/2383690341 shutdown_connections 2024-05-14T09:40:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6d08076320 0x7f6d08078830 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d2c160150 0x7f6d2c14fc40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d2c15f800 0x7f6d2c154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 --2- 172.21.15.135:0/2383690341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6d2c1563f0 0x7f6d2c151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 -- 172.21.15.135:0/2383690341 >> 172.21.15.135:0/2383690341 conn(0x7f6d2c08de20 msgr2=0x7f6d2c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 -- 172.21.15.135:0/2383690341 shutdown_connections 2024-05-14T09:40:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.648+0000 7f6d2be00640 1 -- 172.21.15.135:0/2383690341 wait complete. 2024-05-14T09:40:57.675 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:40:57.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.940+0000 7ffa24a00640 1 Processor -- start 2024-05-14T09:40:57.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.940+0000 7ffa24a00640 1 -- start start 2024-05-14T09:40:57.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.943+0000 7ffa24a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffa200c93d0 0x7ffa20156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.943+0000 7ffa24a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa2006d970 0x7ffa200c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.943+0000 7ffa24a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffa2006dd80 0x7ffa200c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.943+0000 7ffa24a00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ffa200c97e0 con 0x7ffa200c93d0 2024-05-14T09:40:57.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.943+0000 7ffa24a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ffa200c6630 con 0x7ffa2006dd80 2024-05-14T09:40:57.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.943+0000 7ffa24a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffa200c9a60 con 0x7ffa2006d970 2024-05-14T09:40:57.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.944+0000 7ffa1f400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffa200c93d0 0x7ffa20156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.944+0000 7ffa1f400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffa200c93d0 0x7ffa20156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50410/0 (socket says 172.21.15.135:50410) 2024-05-14T09:40:57.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.944+0000 7ffa1f400640 1 -- 172.21.15.135:0/4239720468 learned_addr learned my addr 172.21.15.135:0/4239720468 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:57.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.945+0000 7ffa1fe00640 1 --2- 172.21.15.135:0/4239720468 >> v2:172.21.15.196:3300/0 conn(0x7ffa2006dd80 0x7ffa200c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.945+0000 7ffa1ea00640 1 --2- 172.21.15.135:0/4239720468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa2006d970 0x7ffa200c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.947+0000 7ffa1f400640 1 -- 172.21.15.135:0/4239720468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa2006d970 msgr2=0x7ffa200c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:57.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.948+0000 7ffa1f400640 1 --2- 172.21.15.135:0/4239720468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa2006d970 0x7ffa200c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.948+0000 7ffa1f400640 1 -- 172.21.15.135:0/4239720468 >> v2:172.21.15.196:3300/0 conn(0x7ffa2006dd80 msgr2=0x7ffa200c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:57.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.948+0000 7ffa1f400640 1 --2- 172.21.15.135:0/4239720468 >> v2:172.21.15.196:3300/0 conn(0x7ffa2006dd80 0x7ffa200c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.948+0000 7ffa1f400640 1 -- 172.21.15.135:0/4239720468 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa200c4880 con 0x7ffa200c93d0 2024-05-14T09:40:57.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.950+0000 7ffa1f400640 1 --2- 172.21.15.135:0/4239720468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa200c93d0 0x7ffa20156130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa2006ee50 tx=0x7ffa1002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8847bea19b4c1684 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:57.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.955+0000 7ffa1e000640 1 -- 172.21.15.135:0/4239720468 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10037070 con 0x7ffa200c93d0 2024-05-14T09:40:57.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.955+0000 7ffa1e000640 1 -- 172.21.15.135:0/4239720468 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa10032440 con 0x7ffa200c93d0 2024-05-14T09:40:57.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.955+0000 7ffa1e000640 1 -- 172.21.15.135:0/4239720468 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10032810 con 0x7ffa200c93d0 2024-05-14T09:40:57.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.956+0000 7ffa24a00640 1 -- 172.21.15.135:0/4239720468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa200c93d0 msgr2=0x7ffa20156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.956+0000 7ffa24a00640 1 --2- 172.21.15.135:0/4239720468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa200c93d0 0x7ffa20156130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa2006ee50 tx=0x7ffa1002a140 comp rx=0 tx=0).stop 2024-05-14T09:40:57.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.956+0000 7ffa24a00640 1 -- 172.21.15.135:0/4239720468 shutdown_connections 2024-05-14T09:40:57.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.956+0000 7ffa24a00640 1 --2- 172.21.15.135:0/4239720468 >> v2:172.21.15.196:3300/0 conn(0x7ffa2006dd80 0x7ffa200c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.956+0000 7ffa24a00640 1 --2- 172.21.15.135:0/4239720468 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa2006d970 0x7ffa200c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.956+0000 7ffa24a00640 1 --2- 172.21.15.135:0/4239720468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa200c93d0 0x7ffa20156130 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.956+0000 7ffa24a00640 1 -- 172.21.15.135:0/4239720468 >> 172.21.15.135:0/4239720468 conn(0x7ffa20074620 msgr2=0x7ffa200c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:57.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.956+0000 7ffa24a00640 1 -- 172.21.15.135:0/4239720468 shutdown_connections 2024-05-14T09:40:57.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.956+0000 7ffa24a00640 1 -- 172.21.15.135:0/4239720468 wait complete. 2024-05-14T09:40:57.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.959+0000 7ffa24a00640 1 Processor -- start 2024-05-14T09:40:57.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.959+0000 7ffa24a00640 1 -- start start 2024-05-14T09:40:57.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.960+0000 7ffa24a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa2006d970 0x7ffa2015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.960+0000 7ffa24a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa2006dd80 0x7ffa201571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.960+0000 7ffa24a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa200c93d0 0x7ffa201e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.960+0000 7ffa24a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa200c5120 con 0x7ffa200c93d0 2024-05-14T09:40:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.960+0000 7ffa24a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffa200c4e40 con 0x7ffa2006dd80 2024-05-14T09:40:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.960+0000 7ffa24a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffa200c5490 con 0x7ffa2006d970 2024-05-14T09:40:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.961+0000 7ffa1fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa200c93d0 0x7ffa201e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.962+0000 7ffa1fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa200c93d0 0x7ffa201e87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50414/0 (socket says 172.21.15.135:50414) 2024-05-14T09:40:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.962+0000 7ffa1fe00640 1 -- 172.21.15.135:0/1945485385 learned_addr learned my addr 172.21.15.135:0/1945485385 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.962+0000 7ffa1ea00640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa2006dd80 0x7ffa201571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.963+0000 7ffa1f400640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa2006d970 0x7ffa2015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:57.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.969+0000 7ffa1fe00640 1 -- 172.21.15.135:0/1945485385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa2006d970 msgr2=0x7ffa2015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.969+0000 7ffa1fe00640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa2006d970 0x7ffa2015cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.969+0000 7ffa1fe00640 1 -- 172.21.15.135:0/1945485385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa2006dd80 msgr2=0x7ffa201571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:57.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.969+0000 7ffa1fe00640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa2006dd80 0x7ffa201571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:57.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.969+0000 7ffa1fe00640 1 -- 172.21.15.135:0/1945485385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa201576f0 con 0x7ffa200c93d0 2024-05-14T09:40:57.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.972+0000 7ffa1fe00640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa200c93d0 0x7ffa201e87a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800efc0 tx=0x7ffa1800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:57.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.977+0000 7ffa17400640 1 -- 172.21.15.135:0/1945485385 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18018020 con 0x7ffa200c93d0 2024-05-14T09:40:57.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.977+0000 7ffa17400640 1 -- 172.21.15.135:0/1945485385 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa18014480 con 0x7ffa200c93d0 2024-05-14T09:40:57.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.977+0000 7ffa17400640 1 -- 172.21.15.135:0/1945485385 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18009e60 con 0x7ffa200c93d0 2024-05-14T09:40:57.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.977+0000 7ffa24a00640 1 -- 172.21.15.135:0/1945485385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2015bfe0 con 0x7ffa200c93d0 2024-05-14T09:40:57.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.977+0000 7ffa24a00640 1 -- 172.21.15.135:0/1945485385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa20158b70 con 0x7ffa200c93d0 2024-05-14T09:40:57.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:57.978+0000 7ffa24a00640 1 -- 172.21.15.135:0/1945485385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa20155490 con 0x7ffa200c93d0 2024-05-14T09:40:58.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.288+0000 7ffa17400640 1 -- 172.21.15.135:0/1945485385 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffa18005d10 con 0x7ffa200c93d0 2024-05-14T09:40:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.289+0000 7ffa17400640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa00076350 0x7ffa00078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.290+0000 7ffa1f400640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa00076350 0x7ffa00078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.291+0000 7ffa1f400640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa00076350 0x7ffa00078860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa10034000 tx=0x7ffa1002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:58.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.308+0000 7ffa17400640 1 -- 172.21.15.135:0/1945485385 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6532+0+0 (secure 0 0 0) 0x7ffa18027de0 con 0x7ffa200c93d0 2024-05-14T09:40:58.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.310+0000 7ffa17400640 1 -- 172.21.15.135:0/1945485385 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffa20155490 con 0x7ffa200c93d0 2024-05-14T09:40:58.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.520+0000 7ffa24a00640 1 -- 172.21.15.135:0/1945485385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa20069980 con 0x7ffa200c93d0 2024-05-14T09:40:58.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.753+0000 7ffa17400640 1 -- 172.21.15.135:0/1945485385 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+18562 (secure 0 0 0) 0x7ffa18022030 con 0x7ffa200c93d0 2024-05-14T09:40:58.755 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:40:58.755 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":31,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:40:55.584892+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:40:40.770106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:40:43.375791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:40:51.210089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:40:58.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.757+0000 7ffa24a00640 1 -- 172.21.15.135:0/1945485385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa00076350 msgr2=0x7ffa00078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:58.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.757+0000 7ffa24a00640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa00076350 0x7ffa00078860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa10034000 tx=0x7ffa1002e000 comp rx=0 tx=0).stop 2024-05-14T09:40:58.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.757+0000 7ffa24a00640 1 -- 172.21.15.135:0/1945485385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa200c93d0 msgr2=0x7ffa201e87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:58.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.757+0000 7ffa24a00640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa200c93d0 0x7ffa201e87a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800efc0 tx=0x7ffa1800c490 comp rx=0 tx=0).stop 2024-05-14T09:40:58.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.757+0000 7ffa24a00640 1 -- 172.21.15.135:0/1945485385 shutdown_connections 2024-05-14T09:40:58.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.757+0000 7ffa24a00640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffa00076350 0x7ffa00078860 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:58.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.757+0000 7ffa24a00640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffa2006dd80 0x7ffa201571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:58.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.757+0000 7ffa24a00640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa200c93d0 0x7ffa201e87a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:58.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.757+0000 7ffa24a00640 1 --2- 172.21.15.135:0/1945485385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffa2006d970 0x7ffa2015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.757+0000 7ffa24a00640 1 -- 172.21.15.135:0/1945485385 >> 172.21.15.135:0/1945485385 conn(0x7ffa20074620 msgr2=0x7ffa20150b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.758+0000 7ffa24a00640 1 -- 172.21.15.135:0/1945485385 shutdown_connections 2024-05-14T09:40:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:58.758+0000 7ffa24a00640 1 -- 172.21.15.135:0/1945485385 wait complete. 2024-05-14T09:40:58.789 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:40:59.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.054+0000 7fa53ee00640 1 Processor -- start 2024-05-14T09:40:59.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.054+0000 7fa53ee00640 1 -- start start 2024-05-14T09:40:59.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.056+0000 7fa53ee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5380c93d0 0x7fa538156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:59.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.056+0000 7fa53ee00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa53806d970 0x7fa5380c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:59.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.056+0000 7fa53ee00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa53806dd80 0x7fa5380c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:59.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.056+0000 7fa53ee00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa5380c97e0 con 0x7fa53806dd80 2024-05-14T09:40:59.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.056+0000 7fa53ee00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fa5380c6630 con 0x7fa53806d970 2024-05-14T09:40:59.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.056+0000 7fa53ee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa5380c9a60 con 0x7fa5380c93d0 2024-05-14T09:40:59.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.057+0000 7fa53e400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa53806dd80 0x7fa5380c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:59.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.058+0000 7fa53e400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa53806dd80 0x7fa5380c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50430/0 (socket says 172.21.15.135:50430) 2024-05-14T09:40:59.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.058+0000 7fa53e400640 1 -- 172.21.15.135:0/1499516607 learned_addr learned my addr 172.21.15.135:0/1499516607 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:59.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.058+0000 7fa53da00640 1 --2- 172.21.15.135:0/1499516607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5380c93d0 0x7fa538156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:59.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.058+0000 7fa53d000640 1 --2- 172.21.15.135:0/1499516607 >> v2:172.21.15.196:3300/0 conn(0x7fa53806d970 0x7fa5380c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:59.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.061+0000 7fa53e400640 1 -- 172.21.15.135:0/1499516607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5380c93d0 msgr2=0x7fa538156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.062+0000 7fa53e400640 1 --2- 172.21.15.135:0/1499516607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5380c93d0 0x7fa538156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.062+0000 7fa53e400640 1 -- 172.21.15.135:0/1499516607 >> v2:172.21.15.196:3300/0 conn(0x7fa53806d970 msgr2=0x7fa5380c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.062+0000 7fa53e400640 1 --2- 172.21.15.135:0/1499516607 >> v2:172.21.15.196:3300/0 conn(0x7fa53806d970 0x7fa5380c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.062+0000 7fa53e400640 1 -- 172.21.15.135:0/1499516607 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5380c4880 con 0x7fa53806dd80 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.062+0000 7fa53da00640 1 --2- 172.21.15.135:0/1499516607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5380c93d0 0x7fa538156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.064+0000 7fa53e400640 1 --2- 172.21.15.135:0/1499516607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53806dd80 0x7fa5380c82c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5380caf40 tx=0x7fa53002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ef0d1d54d1f755 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.071+0000 7fa537e00640 1 -- 172.21.15.135:0/1499516607 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530036070 con 0x7fa53806dd80 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.071+0000 7fa537e00640 1 -- 172.21.15.135:0/1499516607 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa530031600 con 0x7fa53806dd80 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.071+0000 7fa537e00640 1 -- 172.21.15.135:0/1499516607 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5300319d0 con 0x7fa53806dd80 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.072+0000 7fa53ee00640 1 -- 172.21.15.135:0/1499516607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53806dd80 msgr2=0x7fa5380c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.072+0000 7fa53ee00640 1 --2- 172.21.15.135:0/1499516607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53806dd80 0x7fa5380c82c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5380caf40 tx=0x7fa53002a610 comp rx=0 tx=0).stop 2024-05-14T09:40:59.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.072+0000 7fa53ee00640 1 -- 172.21.15.135:0/1499516607 shutdown_connections 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.072+0000 7fa53ee00640 1 --2- 172.21.15.135:0/1499516607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53806dd80 0x7fa5380c82c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.072+0000 7fa53ee00640 1 --2- 172.21.15.135:0/1499516607 >> v2:172.21.15.196:3300/0 conn(0x7fa53806d970 0x7fa5380c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.072+0000 7fa53ee00640 1 --2- 172.21.15.135:0/1499516607 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5380c93d0 0x7fa538156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.073+0000 7fa53ee00640 1 -- 172.21.15.135:0/1499516607 >> 172.21.15.135:0/1499516607 conn(0x7fa538074620 msgr2=0x7fa5380c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.073+0000 7fa53ee00640 1 -- 172.21.15.135:0/1499516607 shutdown_connections 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.073+0000 7fa53ee00640 1 -- 172.21.15.135:0/1499516607 wait complete. 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.075+0000 7fa53ee00640 1 Processor -- start 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.076+0000 7fa53ee00640 1 -- start start 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.077+0000 7fa53ee00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53806d970 0x7fa53814f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.077+0000 7fa53ee00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa53806dd80 0x7fa5380cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.077+0000 7fa53ee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5380c93d0 0x7fa5381e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:59.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.077+0000 7fa53ee00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa5380c5120 con 0x7fa53806d970 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.077+0000 7fa53ee00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa5380c4e40 con 0x7fa53806dd80 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.077+0000 7fa53ee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa5380c5490 con 0x7fa5380c93d0 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.078+0000 7fa53da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53806d970 0x7fa53814f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.079+0000 7fa53da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53806d970 0x7fa53814f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50444/0 (socket says 172.21.15.135:50444) 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.079+0000 7fa53da00640 1 -- 172.21.15.135:0/3034361747 learned_addr learned my addr 172.21.15.135:0/3034361747 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.079+0000 7fa53e400640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5380c93d0 0x7fa5381e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.079+0000 7fa53d000640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa53806dd80 0x7fa5380cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.083+0000 7fa53da00640 1 -- 172.21.15.135:0/3034361747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5380c93d0 msgr2=0x7fa5381e5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.083+0000 7fa53da00640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5380c93d0 0x7fa5381e5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.083+0000 7fa53da00640 1 -- 172.21.15.135:0/3034361747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa53806dd80 msgr2=0x7fa5380cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.083+0000 7fa53da00640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa53806dd80 0x7fa5380cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.083+0000 7fa53da00640 1 -- 172.21.15.135:0/3034361747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5380cc440 con 0x7fa53806d970 2024-05-14T09:40:59.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.085+0000 7fa53da00640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53806d970 0x7fa53814f280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00d800 tx=0x7fa52c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:59.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.090+0000 7fa535600640 1 -- 172.21.15.135:0/3034361747 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c004030 con 0x7fa53806d970 2024-05-14T09:40:59.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.090+0000 7fa535600640 1 -- 172.21.15.135:0/3034361747 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52c0041d0 con 0x7fa53806d970 2024-05-14T09:40:59.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.090+0000 7fa53ee00640 1 -- 172.21.15.135:0/3034361747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5381f2280 con 0x7fa53806d970 2024-05-14T09:40:59.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.090+0000 7fa535600640 1 -- 172.21.15.135:0/3034361747 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00b660 con 0x7fa53806d970 2024-05-14T09:40:59.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.090+0000 7fa53ee00640 1 -- 172.21.15.135:0/3034361747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5381f2840 con 0x7fa53806d970 2024-05-14T09:40:59.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.091+0000 7fa53ee00640 1 -- 172.21.15.135:0/3034361747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa538069980 con 0x7fa53806d970 2024-05-14T09:40:59.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.429+0000 7fa535600640 1 -- 172.21.15.135:0/3034361747 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa52c00b800 con 0x7fa53806d970 2024-05-14T09:40:59.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.431+0000 7fa535600640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa518076320 0x7fa518078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:40:59.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.432+0000 7fa53d000640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa518076320 0x7fa518078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:40:59.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.433+0000 7fa53d000640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa518076320 0x7fa518078830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5380cc660 tx=0x7fa524009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:40:59.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.464+0000 7fa535600640 1 -- 172.21.15.135:0/3034361747 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6532+0+0 (secure 0 0 0) 0x7fa52c05d710 con 0x7fa53806d970 2024-05-14T09:40:59.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.465+0000 7fa535600640 1 -- 172.21.15.135:0/3034361747 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa52c061480 con 0x7fa53806d970 2024-05-14T09:40:59.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.681+0000 7fa53ee00640 1 -- 172.21.15.135:0/3034361747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa538153940 con 0x7fa53806d970 2024-05-14T09:40:59.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.780+0000 7fa535600640 1 -- 172.21.15.135:0/3034361747 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+18562 (secure 0 0 0) 0x7fa52c065780 con 0x7fa53806d970 2024-05-14T09:40:59.781 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:40:59.781 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":31,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:40:55.584892+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:40:40.770106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:40:43.375791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:40:51.210089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:40:59.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 -- 172.21.15.135:0/3034361747 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa518076320 msgr2=0x7fa518078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:59.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa518076320 0x7fa518078830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5380cc660 tx=0x7fa524009190 comp rx=0 tx=0).stop 2024-05-14T09:40:59.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 -- 172.21.15.135:0/3034361747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53806d970 msgr2=0x7fa53814f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:40:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53806d970 0x7fa53814f280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00d800 tx=0x7fa52c00dcc0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 -- 172.21.15.135:0/3034361747 shutdown_connections 2024-05-14T09:40:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa518076320 0x7fa518078830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa53806dd80 0x7fa5380cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa5380c93d0 0x7fa5381e5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 --2- 172.21.15.135:0/3034361747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa53806d970 0x7fa53814f280 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:40:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 -- 172.21.15.135:0/3034361747 >> 172.21.15.135:0/3034361747 conn(0x7fa538074620 msgr2=0x7fa5380c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:40:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 -- 172.21.15.135:0/3034361747 shutdown_connections 2024-05-14T09:40:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:40:59.784+0000 7fa53ee00640 1 -- 172.21.15.135:0/3034361747 wait complete. 2024-05-14T09:40:59.825 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T09:41:00.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.089+0000 7f91b1e00640 1 Processor -- start 2024-05-14T09:41:00.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.089+0000 7f91b1e00640 1 -- start start 2024-05-14T09:41:00.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.091+0000 7f91b1e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91ac154450 0x7f91ac15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:00.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.091+0000 7f91b1e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f91ac06c960 0x7f91ac0c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:00.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.091+0000 7f91b1e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac15d610 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.091+0000 7f91b1e00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f91ac15aef0 con 0x7f91ac154450 2024-05-14T09:41:00.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.091+0000 7f91b1e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f91ac06d270 con 0x7f91ac06c960 2024-05-14T09:41:00.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.092+0000 7f91b0a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91ac154450 0x7f91ac15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:00.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.093+0000 7f91b0a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91ac154450 0x7f91ac15a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50450/0 (socket says 172.21.15.135:50450) 2024-05-14T09:41:00.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.093+0000 7f91b0a00640 1 -- 172.21.15.135:0/2219474597 learned_addr learned my addr 172.21.15.135:0/2219474597 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:00.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.094+0000 7f91abe00640 1 --2- 172.21.15.135:0/2219474597 >> v2:172.21.15.196:3300/0 conn(0x7f91ac06c960 0x7f91ac0c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:00.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.096+0000 7f91b0a00640 1 -- 172.21.15.135:0/2219474597 >> v2:172.21.15.196:3300/0 conn(0x7f91ac06c960 msgr2=0x7f91ac0c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:00.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.096+0000 7f91b0a00640 1 --2- 172.21.15.135:0/2219474597 >> v2:172.21.15.196:3300/0 conn(0x7f91ac06c960 0x7f91ac0c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:00.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.096+0000 7f91b0a00640 1 -- 172.21.15.135:0/2219474597 >> v1:172.21.15.196:6789/0 conn(0x7f91ac0c6fd0 legacy=0x7f91ac0c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:00.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.097+0000 7f91b0a00640 1 -- 172.21.15.135:0/2219474597 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac15d880 con 0x7f91ac154450 2024-05-14T09:41:00.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.099+0000 7f91b0a00640 1 --2- 172.21.15.135:0/2219474597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91ac154450 0x7f91ac15a9b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0ba010 tx=0x7f91a002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1342e46ccd9a3c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:00.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.105+0000 7f91ab400640 1 -- 172.21.15.135:0/2219474597 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0037070 con 0x7f91ac154450 2024-05-14T09:41:00.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.105+0000 7f91ab400640 1 -- 172.21.15.135:0/2219474597 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a0032440 con 0x7f91ac154450 2024-05-14T09:41:00.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.105+0000 7f91ab400640 1 -- 172.21.15.135:0/2219474597 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0032810 con 0x7f91ac154450 2024-05-14T09:41:00.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.106+0000 7f91b1e00640 1 -- 172.21.15.135:0/2219474597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91ac154450 msgr2=0x7f91ac15a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:00.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.106+0000 7f91b1e00640 1 --2- 172.21.15.135:0/2219474597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91ac154450 0x7f91ac15a9b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0ba010 tx=0x7f91a002a1e0 comp rx=0 tx=0).stop 2024-05-14T09:41:00.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.106+0000 7f91b1e00640 1 -- 172.21.15.135:0/2219474597 shutdown_connections 2024-05-14T09:41:00.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.106+0000 7f91b1e00640 1 --2- 172.21.15.135:0/2219474597 >> v2:172.21.15.196:3300/0 conn(0x7f91ac06c960 0x7f91ac0c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:00.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.106+0000 7f91b1e00640 1 --2- 172.21.15.135:0/2219474597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91ac154450 0x7f91ac15a9b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:00.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.106+0000 7f91b1e00640 1 -- 172.21.15.135:0/2219474597 >> 172.21.15.135:0/2219474597 conn(0x7f91ac074620 msgr2=0x7f91ac0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:00.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.106+0000 7f91b1e00640 1 -- 172.21.15.135:0/2219474597 shutdown_connections 2024-05-14T09:41:00.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.106+0000 7f91b1e00640 1 -- 172.21.15.135:0/2219474597 wait complete. 2024-05-14T09:41:00.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.108+0000 7f91b1e00640 1 Processor -- start 2024-05-14T09:41:00.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.109+0000 7f91b1e00640 1 -- start start 2024-05-14T09:41:00.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.110+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91ac06c960 0x7f91ac0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:00.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.110+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91ac0c6fd0 0x7f91ac1ee040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:00.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.110+0000 7f91b1e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91ac154ca0 0x7f91ac156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:00.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.110+0000 7f91b1e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac06cea0 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.110+0000 7f91b1e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac15de40 con 0x7f91ac06c960 2024-05-14T09:41:00.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.110+0000 7f91b1e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f91ac06d6c0 con 0x7f91ac154ca0 2024-05-14T09:41:00.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.111+0000 7f91abe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91ac0c6fd0 0x7f91ac1ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:00.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.111+0000 7f91abe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91ac0c6fd0 0x7f91ac1ee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50456/0 (socket says 172.21.15.135:50456) 2024-05-14T09:41:00.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.111+0000 7f91abe00640 1 -- 172.21.15.135:0/3132461145 learned_addr learned my addr 172.21.15.135:0/3132461145 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:00.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.113+0000 7f91b1400640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91ac154ca0 0x7f91ac156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:00.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.114+0000 7f91b0a00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91ac06c960 0x7f91ac0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:00.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.116+0000 7f91abe00640 1 -- 172.21.15.135:0/3132461145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91ac154ca0 msgr2=0x7f91ac156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:00.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.116+0000 7f91abe00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91ac154ca0 0x7f91ac156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:00.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.116+0000 7f91abe00640 1 -- 172.21.15.135:0/3132461145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91ac06c960 msgr2=0x7f91ac0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:00.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.116+0000 7f91abe00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91ac06c960 0x7f91ac0c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:00.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.116+0000 7f91abe00640 1 -- 172.21.15.135:0/3132461145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac1ee580 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.119+0000 7f91abe00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91ac0c6fd0 0x7f91ac1ee040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f919c00d620 tx=0x7f919c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:00.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.123+0000 7f91a8c00640 1 -- 172.21.15.135:0/3132461145 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c0125f0 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.123+0000 7f91a8c00640 1 -- 172.21.15.135:0/3132461145 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f919c019070 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.123+0000 7f91a8c00640 1 -- 172.21.15.135:0/3132461145 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c0129d0 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.123+0000 7f91b1e00640 1 -- 172.21.15.135:0/3132461145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ac157530 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.123+0000 7f91b1e00640 1 -- 172.21.15.135:0/3132461145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ac1f1940 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.124+0000 7f91b1e00640 1 -- 172.21.15.135:0/3132461145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91ac069980 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.465+0000 7f91a8c00640 1 -- 172.21.15.135:0/3132461145 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f919c012b70 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.467+0000 7f91a8c00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9190076320 0x7f9190078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:00.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.468+0000 7f91b0a00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9190076320 0x7f9190078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:00.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.470+0000 7f91b0a00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9190076320 0x7f9190078830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91a0034000 tx=0x7f91a002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:00.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.498+0000 7f91a8c00640 1 -- 172.21.15.135:0/3132461145 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6532+0+0 (secure 0 0 0) 0x7f919c012e60 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.500+0000 7f91a8c00640 1 -- 172.21.15.135:0/3132461145 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f919c061d10 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.765+0000 7f91b1e00640 1 -- 172.21.15.135:0/3132461145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91ac0cb240 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.804+0000 7f91a8c00640 1 -- 172.21.15.135:0/3132461145 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6843 (secure 0 0 0) 0x7f919c015e20 con 0x7f91ac0c6fd0 2024-05-14T09:41:00.805 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:00.805 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4032169993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4032169993},{"type":"v1","addr":"172.21.15.135:6837","nonce":4032169993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/1397919075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":1397919075},{"type":"v1","addr":"172.21.15.196:6833","nonce":1397919075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/4240420134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":4240420134},{"type":"v1","addr":"172.21.15.196:6835","nonce":4240420134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4240,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3270089159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3270089159},{"type":"v1","addr":"172.21.15.135:6835","nonce":3270089159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4252,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2302038485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2302038485},{"type":"v1","addr":"172.21.15.135:6839","nonce":2302038485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T09:40:45.555908+0000","modified":"2024-05-14T09:40:55.597336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6837/3644723215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3644723215},{"type":"v1","addr":"172.21.15.196:6837","nonce":3644723215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4255,"qdb_cluster":[4255]},"id":1}]} 2024-05-14T09:41:00.805 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 7 2024-05-14T09:41:00.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 -- 172.21.15.135:0/3132461145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9190076320 msgr2=0x7f9190078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:00.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9190076320 0x7f9190078830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91a0034000 tx=0x7f91a002e000 comp rx=0 tx=0).stop 2024-05-14T09:41:00.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 -- 172.21.15.135:0/3132461145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91ac0c6fd0 msgr2=0x7f91ac1ee040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:00.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91ac0c6fd0 0x7f91ac1ee040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f919c00d620 tx=0x7f919c00dae0 comp rx=0 tx=0).stop 2024-05-14T09:41:00.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 -- 172.21.15.135:0/3132461145 shutdown_connections 2024-05-14T09:41:00.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9190076320 0x7f9190078830 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:00.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91ac154ca0 0x7f91ac156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:00.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91ac0c6fd0 0x7f91ac1ee040 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:00.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 --2- 172.21.15.135:0/3132461145 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91ac06c960 0x7f91ac0c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:00.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 -- 172.21.15.135:0/3132461145 >> 172.21.15.135:0/3132461145 conn(0x7f91ac074620 msgr2=0x7f91ac0c7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:00.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 -- 172.21.15.135:0/3132461145 shutdown_connections 2024-05-14T09:41:00.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:00.808+0000 7f91b1e00640 1 -- 172.21.15.135:0/3132461145 wait complete. 2024-05-14T09:41:00.835 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:41:01.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.104+0000 7f4f85e00640 1 Processor -- start 2024-05-14T09:41:01.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.104+0000 7f4f85e00640 1 -- start start 2024-05-14T09:41:01.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.106+0000 7f4f85e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4f80156930 0x7f4f80074810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:01.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.106+0000 7f4f85e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f800c7e80 0x7f4f800c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:01.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.106+0000 7f4f85e00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f800c8650 con 0x7f4f800c7360 2024-05-14T09:41:01.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.106+0000 7f4f85e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4f80160a10 con 0x7f4f80156930 2024-05-14T09:41:01.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.106+0000 7f4f85e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4f80074d50 con 0x7f4f800c7e80 2024-05-14T09:41:01.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.107+0000 7f4f7f400640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f4f800c7360 0x7f4f8015c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:55868/0 (socket says 172.21.15.135:55868) 2024-05-14T09:41:01.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.107+0000 7f4f7f400640 1 -- 172.21.15.135:0/1065885325 learned_addr learned my addr 172.21.15.135:0/1065885325 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:01.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.108+0000 7f4f7ea00640 1 --2- 172.21.15.135:0/1065885325 >> v2:172.21.15.196:3300/0 conn(0x7f4f80156930 0x7f4f80074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:01.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.108+0000 7f4f77e00640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f800c7e80 0x7f4f800c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:01.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.110+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429885745 0 0) 0x7f4f800c8650 con 0x7f4f800c7360 2024-05-14T09:41:01.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.111+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f64003520 con 0x7f4f800c7360 2024-05-14T09:41:01.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3999785348 0 0) 0x7f4f64003520 con 0x7f4f800c7360 2024-05-14T09:41:01.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f800c7e80 msgr2=0x7f4f800c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:01.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f800c7e80 0x7f4f800c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:01.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 >> v2:172.21.15.196:3300/0 conn(0x7f4f80156930 msgr2=0x7f4f80074810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:01.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 --2- 172.21.15.135:0/1065885325 >> v2:172.21.15.196:3300/0 conn(0x7f4f80156930 0x7f4f80074810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:01.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f800c8930 con 0x7f4f800c7360 2024-05-14T09:41:01.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f4f78001a70 con 0x7f4f800c7360 2024-05-14T09:41:01.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 >> v1:172.21.15.135:6789/0 conn(0x7f4f800c7360 legacy=0x7f4f8015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:01.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f800c7e80 0x7f4f64003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:01.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f64004020 0x7f4f64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:01.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f64004d40 0x7f4f64005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:01.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80160a10 con 0x7f4f64004d40 2024-05-14T09:41:01.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80074d50 con 0x7f4f64004020 2024-05-14T09:41:01.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.116+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6400bba0 con 0x7f4f800c7e80 2024-05-14T09:41:01.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.121+0000 7f4f7f400640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f64004d40 0x7f4f64005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.123+0000 7f4f77e00640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f64004020 0x7f4f64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.125+0000 7f4f7ea00640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f800c7e80 0x7f4f64003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.125+0000 7f4f7f400640 1 -- 172.21.15.135:0/1065885325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f800c7e80 msgr2=0x7f4f64003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.125+0000 7f4f7f400640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f800c7e80 0x7f4f64003a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.125+0000 7f4f7f400640 1 -- 172.21.15.135:0/1065885325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f64004020 msgr2=0x7f4f64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.125+0000 7f4f7f400640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f64004020 0x7f4f64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.125+0000 7f4f7f400640 1 -- 172.21.15.135:0/1065885325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f64003520 con 0x7f4f64004d40 2024-05-14T09:41:01.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.128+0000 7f4f7f400640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f64004d40 0x7f4f64005150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f8006ee60 tx=0x7f4f64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeae8c75d057bc7b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:01.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.138+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800a410 con 0x7f4f64004d40 2024-05-14T09:41:01.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.138+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7802f070 con 0x7f4f64004d40 2024-05-14T09:41:01.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.138+0000 7f4f7e000640 1 -- 172.21.15.135:0/1065885325 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7802bb60 con 0x7f4f64004d40 2024-05-14T09:41:01.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.139+0000 7f4f85e00640 1 -- 172.21.15.135:0/1065885325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f64004d40 msgr2=0x7f4f64005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:01.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.139+0000 7f4f85e00640 1 --2- 172.21.15.135:0/1065885325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f64004d40 0x7f4f64005150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f8006ee60 tx=0x7f4f64005830 comp rx=0 tx=0).stop 2024-05-14T09:41:01.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.139+0000 7f4f7f400640 1 -- 172.21.15.135:0/1065885325 reap_dead start 2024-05-14T09:41:01.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.139+0000 7f4f85e00640 1 -- 172.21.15.135:0/1065885325 shutdown_connections 2024-05-14T09:41:01.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.139+0000 7f4f85e00640 1 -- 172.21.15.135:0/1065885325 >> 172.21.15.135:0/1065885325 conn(0x7f4f80073cf0 msgr2=0x7f4f80074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:01.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.140+0000 7f4f85e00640 1 -- 172.21.15.135:0/1065885325 shutdown_connections 2024-05-14T09:41:01.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.140+0000 7f4f85e00640 1 -- 172.21.15.135:0/1065885325 wait complete. 2024-05-14T09:41:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.144+0000 7f4f85e00640 1 Processor -- start 2024-05-14T09:41:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.144+0000 7f4f85e00640 1 -- start start 2024-05-14T09:41:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.146+0000 7f4f85e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f801e8450 0x7f4f8014c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.146+0000 7f4f85e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f801f3b40 0x7f4f80148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.146+0000 7f4f85e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f80149370 0x7f4f801f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.146+0000 7f4f85e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f800c9b50 con 0x7f4f801e8450 2024-05-14T09:41:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.146+0000 7f4f85e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80160730 con 0x7f4f801f3b40 2024-05-14T09:41:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.146+0000 7f4f85e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4f800c9730 con 0x7f4f80149370 2024-05-14T09:41:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.147+0000 7f4f7ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f801e8450 0x7f4f8014c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.148+0000 7f4f77e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f801f3b40 0x7f4f80148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.148+0000 7f4f7ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f801e8450 0x7f4f8014c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50480/0 (socket says 172.21.15.135:50480) 2024-05-14T09:41:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.148+0000 7f4f7ea00640 1 -- 172.21.15.135:0/1329581880 learned_addr learned my addr 172.21.15.135:0/1329581880 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.148+0000 7f4f7f400640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f80149370 0x7f4f801f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:01.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.154+0000 7f4f7ea00640 1 -- 172.21.15.135:0/1329581880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f80149370 msgr2=0x7f4f801f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:01.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.154+0000 7f4f7ea00640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f80149370 0x7f4f801f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:01.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.154+0000 7f4f7ea00640 1 -- 172.21.15.135:0/1329581880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f801f3b40 msgr2=0x7f4f80148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:01.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.154+0000 7f4f7ea00640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f801f3b40 0x7f4f80148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:01.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.154+0000 7f4f7ea00640 1 -- 172.21.15.135:0/1329581880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8014af80 con 0x7f4f801e8450 2024-05-14T09:41:01.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.158+0000 7f4f7ea00640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f801e8450 0x7f4f8014c300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f700107e0 tx=0x7f4f70010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:01.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.163+0000 7f4f77400640 1 -- 172.21.15.135:0/1329581880 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7000f040 con 0x7f4f801e8450 2024-05-14T09:41:01.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.163+0000 7f4f77400640 1 -- 172.21.15.135:0/1329581880 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f7000eb60 con 0x7f4f801e8450 2024-05-14T09:41:01.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.163+0000 7f4f77400640 1 -- 172.21.15.135:0/1329581880 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7001c400 con 0x7f4f801e8450 2024-05-14T09:41:01.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.163+0000 7f4f85e00640 1 -- 172.21.15.135:0/1329581880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f8014b260 con 0x7f4f801e8450 2024-05-14T09:41:01.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.163+0000 7f4f85e00640 1 -- 172.21.15.135:0/1329581880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f8014b820 con 0x7f4f801e8450 2024-05-14T09:41:01.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.165+0000 7f4f85e00640 1 -- 172.21.15.135:0/1329581880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f800c8390 con 0x7f4f801e8450 2024-05-14T09:41:01.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.501+0000 7f4f77400640 1 -- 172.21.15.135:0/1329581880 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4f7001c5a0 con 0x7f4f801e8450 2024-05-14T09:41:01.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.502+0000 7f4f77400640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f5c076320 0x7f4f5c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:01.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.503+0000 7f4f77e00640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f5c076320 0x7f4f5c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:01.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.504+0000 7f4f77e00640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f5c076320 0x7f4f5c078830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4f801f3800 tx=0x7f4f68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:01.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.539+0000 7f4f77400640 1 -- 172.21.15.135:0/1329581880 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6532+0+0 (secure 0 0 0) 0x7f4f70015de0 con 0x7f4f801e8450 2024-05-14T09:41:01.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.540+0000 7f4f77400640 1 -- 172.21.15.135:0/1329581880 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4f70018030 con 0x7f4f801e8450 2024-05-14T09:41:01.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.756+0000 7f4f85e00640 1 -- 172.21.15.135:0/1329581880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f800cd070 con 0x7f4f801e8450 2024-05-14T09:41:01.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.875+0000 7f4f77400640 1 -- 172.21.15.135:0/1329581880 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+18562 (secure 0 0 0) 0x7f4f70061170 con 0x7f4f801e8450 2024-05-14T09:41:01.876 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:01.876 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":31,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:40:55.584892+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:40:40.770106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:40:43.375791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:40:51.210089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:41:01.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 -- 172.21.15.135:0/1329581880 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f5c076320 msgr2=0x7f4f5c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:01.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f5c076320 0x7f4f5c078830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4f801f3800 tx=0x7f4f68008040 comp rx=0 tx=0).stop 2024-05-14T09:41:01.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 -- 172.21.15.135:0/1329581880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f801e8450 msgr2=0x7f4f8014c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:01.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f801e8450 0x7f4f8014c300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4f700107e0 tx=0x7f4f70010ca0 comp rx=0 tx=0).stop 2024-05-14T09:41:01.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 -- 172.21.15.135:0/1329581880 shutdown_connections 2024-05-14T09:41:01.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4f5c076320 0x7f4f5c078830 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:01.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f801f3b40 0x7f4f80148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:01.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4f80149370 0x7f4f801f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:01.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 --2- 172.21.15.135:0/1329581880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f801e8450 0x7f4f8014c300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:01.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 -- 172.21.15.135:0/1329581880 >> 172.21.15.135:0/1329581880 conn(0x7f4f80073cf0 msgr2=0x7f4f8006d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:01.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 -- 172.21.15.135:0/1329581880 shutdown_connections 2024-05-14T09:41:01.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:01.879+0000 7f4f85e00640 1 -- 172.21.15.135:0/1329581880 wait complete. 2024-05-14T09:41:02.512 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T09:40:45.555908+0000', 'modified': '2024-05-14T09:40:55.597336+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4255': {'gid': 4255, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.196:6837/3644723215', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 3644723215}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 3644723215}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4255, 'qdb_cluster': [4255]} 2024-05-14T09:41:02.512 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-14T09:41:02.512 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-14T09:41:02.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.793+0000 7f81bbc00640 1 Processor -- start 2024-05-14T09:41:02.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.793+0000 7f81bbc00640 1 -- start start 2024-05-14T09:41:02.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.795+0000 7f81bbc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81b4071f70 0x7f81b40c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.795+0000 7f81bbc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f81b40c71b0 0x7f81b406d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.795+0000 7f81bbc00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b4074ce0 con 0x7f81b415ab20 2024-05-14T09:41:02.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.795+0000 7f81bbc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f81b406cde0 con 0x7f81b40c71b0 2024-05-14T09:41:02.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.795+0000 7f81bbc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f81b4074a00 con 0x7f81b4071f70 2024-05-14T09:41:02.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.796+0000 7f81b9200640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f81b415ab20 0x7f81b4153f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:55872/0 (socket says 172.21.15.135:55872) 2024-05-14T09:41:02.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.796+0000 7f81b9200640 1 -- 172.21.15.135:0/3239025472 learned_addr learned my addr 172.21.15.135:0/3239025472 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:02.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.797+0000 7f81b9c00640 1 --2- 172.21.15.135:0/3239025472 >> v2:172.21.15.196:3300/0 conn(0x7f81b40c71b0 0x7f81b406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:02.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.797+0000 7f81b3e00640 1 --2- 172.21.15.135:0/3239025472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81b4071f70 0x7f81b40c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:02.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.799+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833346963 0 0) 0x7f81b4074ce0 con 0x7f81b415ab20 2024-05-14T09:41:02.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.799+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8198003520 con 0x7f81b415ab20 2024-05-14T09:41:02.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 496558198 0 0) 0x7f8198003520 con 0x7f81b415ab20 2024-05-14T09:41:02.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81b4071f70 msgr2=0x7f81b40c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:02.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 --2- 172.21.15.135:0/3239025472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81b4071f70 0x7f81b40c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 >> v2:172.21.15.196:3300/0 conn(0x7f81b40c71b0 msgr2=0x7f81b406d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:02.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 --2- 172.21.15.135:0/3239025472 >> v2:172.21.15.196:3300/0 conn(0x7f81b40c71b0 0x7f81b406d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b406c790 con 0x7f81b415ab20 2024-05-14T09:41:02.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f81a4001a70 con 0x7f81b415ab20 2024-05-14T09:41:02.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 >> v1:172.21.15.135:6789/0 conn(0x7f81b415ab20 legacy=0x7f81b4153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:02.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 --2- 172.21.15.135:0/3239025472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8198003a50 0x7f8198003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 --2- 172.21.15.135:0/3239025472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81b4071f70 0x7f8198004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 --2- 172.21.15.135:0/3239025472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8198004d40 0x7f8198005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81b406cde0 con 0x7f8198004d40 2024-05-14T09:41:02.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f81b4074a00 con 0x7f8198003a50 2024-05-14T09:41:02.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.804+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f819800baa0 con 0x7f81b4071f70 2024-05-14T09:41:02.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.808+0000 7f81b9c00640 1 --2- 172.21.15.135:0/3239025472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8198004d40 0x7f8198005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:02.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.812+0000 7f81b9c00640 1 -- 172.21.15.135:0/3239025472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81b4071f70 msgr2=0x7f8198004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:02.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.812+0000 7f81b9c00640 1 --2- 172.21.15.135:0/3239025472 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f81b4071f70 0x7f8198004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.812+0000 7f81b9c00640 1 -- 172.21.15.135:0/3239025472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8198003a50 msgr2=0x7f8198003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:02.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.812+0000 7f81b9c00640 1 --2- 172.21.15.135:0/3239025472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8198003a50 0x7f8198003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.812+0000 7f81b9c00640 1 -- 172.21.15.135:0/3239025472 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8198003520 con 0x7f8198004d40 2024-05-14T09:41:02.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.814+0000 7f81b9c00640 1 --2- 172.21.15.135:0/3239025472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8198004d40 0x7f8198005150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009a90 tx=0x7f8198005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc727171093c872 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:02.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.818+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac036070 con 0x7f8198004d40 2024-05-14T09:41:02.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.819+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ac031400 con 0x7f8198004d40 2024-05-14T09:41:02.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.819+0000 7f81b3400640 1 -- 172.21.15.135:0/3239025472 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac009690 con 0x7f8198004d40 2024-05-14T09:41:02.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.819+0000 7f81bbc00640 1 -- 172.21.15.135:0/3239025472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8198004d40 msgr2=0x7f8198005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:02.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.819+0000 7f81bbc00640 1 --2- 172.21.15.135:0/3239025472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8198004d40 0x7f8198005150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009a90 tx=0x7f8198005830 comp rx=0 tx=0).stop 2024-05-14T09:41:02.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.820+0000 7f81b9c00640 1 -- 172.21.15.135:0/3239025472 reap_dead start 2024-05-14T09:41:02.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.820+0000 7f81bbc00640 1 -- 172.21.15.135:0/3239025472 shutdown_connections 2024-05-14T09:41:02.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.820+0000 7f81bbc00640 1 -- 172.21.15.135:0/3239025472 >> 172.21.15.135:0/3239025472 conn(0x7f81b4073d40 msgr2=0x7f81b4074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:02.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.820+0000 7f81bbc00640 1 -- 172.21.15.135:0/3239025472 shutdown_connections 2024-05-14T09:41:02.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.820+0000 7f81bbc00640 1 -- 172.21.15.135:0/3239025472 wait complete. 2024-05-14T09:41:02.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.823+0000 7f81bbc00640 1 Processor -- start 2024-05-14T09:41:02.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.823+0000 7f81bbc00640 1 -- start start 2024-05-14T09:41:02.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.825+0000 7f81bbc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8198004d40 0x7f81b4158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.825+0000 7f81bbc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81b4151590 0x7f81b414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.825+0000 7f81bbc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81b414f0b0 0x7f81b41f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.825+0000 7f81bbc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81b40c4690 con 0x7f81b414f0b0 2024-05-14T09:41:02.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.825+0000 7f81bbc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f81b4154680 con 0x7f81b4151590 2024-05-14T09:41:02.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.825+0000 7f81bbc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f81b40c6c70 con 0x7f8198004d40 2024-05-14T09:41:02.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.826+0000 7f81b9c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81b414f0b0 0x7f81b41f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:02.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.826+0000 7f81b9c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81b414f0b0 0x7f81b41f3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50500/0 (socket says 172.21.15.135:50500) 2024-05-14T09:41:02.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.826+0000 7f81b9c00640 1 -- 172.21.15.135:0/3208380352 learned_addr learned my addr 172.21.15.135:0/3208380352 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:02.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.827+0000 7f81b3e00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81b4151590 0x7f81b414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:02.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.828+0000 7f81b9200640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8198004d40 0x7f81b4158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:02.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.831+0000 7f81b9c00640 1 -- 172.21.15.135:0/3208380352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8198004d40 msgr2=0x7f81b4158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:02.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.831+0000 7f81b9c00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8198004d40 0x7f81b4158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.831+0000 7f81b9c00640 1 -- 172.21.15.135:0/3208380352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81b4151590 msgr2=0x7f81b414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:02.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.831+0000 7f81b9c00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81b4151590 0x7f81b414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.831+0000 7f81b9c00640 1 -- 172.21.15.135:0/3208380352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b4159160 con 0x7f81b414f0b0 2024-05-14T09:41:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.834+0000 7f81b9c00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81b414f0b0 0x7f81b41f3800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009bb0 tx=0x7f81ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:02.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.839+0000 7f81b0c00640 1 -- 172.21.15.135:0/3208380352 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac036040 con 0x7f81b414f0b0 2024-05-14T09:41:02.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.839+0000 7f81b0c00640 1 -- 172.21.15.135:0/3208380352 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ac041070 con 0x7f81b414f0b0 2024-05-14T09:41:02.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.839+0000 7f81b0c00640 1 -- 172.21.15.135:0/3208380352 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac003a50 con 0x7f81b414f0b0 2024-05-14T09:41:02.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.839+0000 7f81bbc00640 1 -- 172.21.15.135:0/3208380352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b4157a70 con 0x7f81b414f0b0 2024-05-14T09:41:02.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.839+0000 7f81bbc00640 1 -- 172.21.15.135:0/3208380352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b4150930 con 0x7f81b414f0b0 2024-05-14T09:41:02.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.843+0000 7f81c2c2f740 1 Processor -- start 2024-05-14T09:41:02.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.844+0000 7f81c2c2f740 1 -- start start 2024-05-14T09:41:02.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.845+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba43270 0x55ac0be0ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.845+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba1a3b0 0x55ac0be0d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.845+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba22590 0x55ac0be0ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.845+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ac0bd49790 con 0x55ac0ba22590 2024-05-14T09:41:02.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.845+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ac0bceef20 con 0x55ac0ba1a3b0 2024-05-14T09:41:02.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.845+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55ac0bd45750 con 0x55ac0ba43270 2024-05-14T09:41:02.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.848+0000 7f81b9200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba1a3b0 0x55ac0be0d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:02.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.849+0000 7f81b9200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba1a3b0 0x55ac0be0d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:41996/0 (socket says 172.21.15.135:41996) 2024-05-14T09:41:02.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.849+0000 7f81b9200640 1 -- 172.21.15.135:0/3775460058 learned_addr learned my addr 172.21.15.135:0/3775460058 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:02.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.850+0000 7f81b3e00640 1 --2- 172.21.15.135:0/3775460058 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba43270 0x55ac0be0ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:02.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.857+0000 7f81b9200640 1 -- 172.21.15.135:0/3775460058 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba43270 msgr2=0x55ac0be0ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:02.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.857+0000 7f81b9200640 1 --2- 172.21.15.135:0/3775460058 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba43270 0x55ac0be0ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.857+0000 7f81b9200640 1 -- 172.21.15.135:0/3775460058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba22590 msgr2=0x55ac0be0ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:02.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.857+0000 7f81b9200640 1 --2- 172.21.15.135:0/3775460058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba22590 0x55ac0be0ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.857+0000 7f81b9200640 1 -- 172.21.15.135:0/3775460058 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac0ba5b2d0 con 0x55ac0ba1a3b0 2024-05-14T09:41:02.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.863+0000 7f81b9200640 1 --2- 172.21.15.135:0/3775460058 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba1a3b0 0x55ac0be0d880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81a4001f70 tx=0x7f81a4007430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2151d52281f29be server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:02.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.867+0000 7f81b0c00640 1 -- 172.21.15.135:0/3208380352 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f81ac003bf0 con 0x7f81b414f0b0 2024-05-14T09:41:02.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.868+0000 7f81b0c00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8194076320 0x7f8194078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.868+0000 7f81b3e00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8194076320 0x7f8194078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:02.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.869+0000 7f81b3e00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8194076320 0x7f8194078830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009570 tx=0x7f81a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:02.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.872+0000 7f81b0c00640 1 -- 172.21.15.135:0/3208380352 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6532+0+0 (secure 0 0 0) 0x7f81ac07be10 con 0x7f81b414f0b0 2024-05-14T09:41:02.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.875+0000 7f81a9600640 1 -- 172.21.15.135:0/3775460058 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4002060 con 0x55ac0ba1a3b0 2024-05-14T09:41:02.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.875+0000 7f81a9600640 1 -- 172.21.15.135:0/3775460058 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a4018070 con 0x55ac0ba1a3b0 2024-05-14T09:41:02.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.875+0000 7f81a9600640 1 -- 172.21.15.135:0/3775460058 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4012780 con 0x55ac0ba1a3b0 2024-05-14T09:41:02.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.876+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3775460058 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba1a3b0 msgr2=0x55ac0be0d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:02.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.876+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/3775460058 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba1a3b0 0x55ac0be0d880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81a4001f70 tx=0x7f81a4007430 comp rx=0 tx=0).stop 2024-05-14T09:41:02.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.876+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3775460058 shutdown_connections 2024-05-14T09:41:02.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.876+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/3775460058 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba1a3b0 0x55ac0be0d880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.876+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/3775460058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba22590 0x55ac0be0ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.876+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/3775460058 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba43270 0x55ac0be0ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.876+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3775460058 >> 172.21.15.135:0/3775460058 conn(0x55ac0ba373c0 msgr2=0x55ac0bde4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:02.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.876+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3775460058 shutdown_connections 2024-05-14T09:41:02.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.876+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3775460058 wait complete. 2024-05-14T09:41:02.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.878+0000 7f81c2c2f740 1 -- start start 2024-05-14T09:41:02.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.878+0000 7f81c2c2f740 1 Processor -- start 2024-05-14T09:41:02.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.881+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba1a3b0 0x55ac0be39d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.881+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba22590 0x55ac0be21a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.881+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be1ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.881+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ac0bd029c0 con 0x55ac0ba1a3b0 2024-05-14T09:41:02.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.881+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ac0bde4ce0 con 0x55ac0ba43270 2024-05-14T09:41:02.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.881+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55ac0be361c0 con 0x55ac0ba22590 2024-05-14T09:41:02.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.881+0000 7f81c2c2f740 10 client.0 _ll_register_callbacks cb 0x55ac0bccf120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:02.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.883+0000 7f81b9c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be1ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:02.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.884+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba22590 0x55ac0be21a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:02.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.884+0000 7f81b9c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be1ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:41998/0 (socket says 172.21.15.135:41998) 2024-05-14T09:41:02.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.884+0000 7f81b9c00640 1 -- 172.21.15.135:0/55699075 learned_addr learned my addr 172.21.15.135:0/55699075 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:02.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.894+0000 7f81b9c00640 1 -- 172.21.15.135:0/55699075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba22590 msgr2=0x55ac0be21a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:02.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.894+0000 7f81b9c00640 1 --2- 172.21.15.135:0/55699075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba22590 0x55ac0be21a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.894+0000 7f81b9c00640 1 -- 172.21.15.135:0/55699075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba1a3b0 msgr2=0x55ac0be39d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:02.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.894+0000 7f81b9c00640 1 --2- 172.21.15.135:0/55699075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba1a3b0 0x55ac0be39d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:02.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.894+0000 7f81b9c00640 1 -- 172.21.15.135:0/55699075 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac0bb256b0 con 0x55ac0ba43270 2024-05-14T09:41:02.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.902+0000 7f81b9c00640 1 --2- 172.21.15.135:0/55699075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be1ebb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0b4d10 tx=0x7f81ac088710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cb7fc50334ce25a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:02.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.902+0000 7f819e000640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-05-14T09:41:02.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.915+0000 7f819e000640 1 -- 172.21.15.135:0/55699075 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac07f2f0 con 0x55ac0ba43270 2024-05-14T09:41:02.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.915+0000 7f819e000640 1 -- 172.21.15.135:0/55699075 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 6532+0+0 (secure 0 0 0) 0x7f81ac07b700 con 0x55ac0ba43270 2024-05-14T09:41:02.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.915+0000 7f81c2c2f740 1 -- 172.21.15.135:0/55699075 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81a4018070 con 0x55ac0ba43270 2024-05-14T09:41:02.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.919+0000 7f819e000640 1 -- 172.21.15.135:0/55699075 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f81ac07f690 con 0x55ac0ba43270 2024-05-14T09:41:02.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.919+0000 7f81c2c2f740 10 client.4333 fetch_fsmap learned FSMap version 7 2024-05-14T09:41:02.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.919+0000 7f81c2c2f740 1 -- 172.21.15.135:0/55699075 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55ac0be39850 con 0x55ac0ba43270 2024-05-14T09:41:02.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.964+0000 7f819e000640 1 -- 172.21.15.135:0/55699075 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a4018070 con 0x55ac0ba43270 2024-05-14T09:41:02.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.964+0000 7f819e000640 1 -- 172.21.15.135:0/55699075 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f81ac086050 con 0x55ac0ba43270 2024-05-14T09:41:02.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.964+0000 7f81c2c2f740 10 client.4333 fetch_fsmap finished waiting for FSMap version 7 2024-05-14T09:41:02.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.964+0000 7f81c2c2f740 10 client.4333 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-14T09:41:02.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.964+0000 7f81c2c2f740 20 client.4333 populate_metadata read hostname 'smithi135' 2024-05-14T09:41:02.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.964+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/55699075 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x55ac0ba01e40 0x55ac0be44830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:02.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.964+0000 7f81c2c2f740 4 client.4333 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:41:02.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.964+0000 7f81c2c2f740 1 -- 172.21.15.135:0/55699075 --> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac0bd573a0 con 0x55ac0ba01e40 2024-05-14T09:41:02.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:02.990+0000 7f81b9200640 1 --2- 172.21.15.135:0/55699075 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x55ac0ba01e40 0x55ac0be44830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:03.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.199+0000 7f81b9200640 1 --2- 172.21.15.135:0/55699075 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x55ac0ba01e40 0x55ac0be44830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ae4fab7b27e677e server_cookie=a7ae8d1bcaac95a3 in_seq=0 out_seq=0 2024-05-14T09:41:03.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.199+0000 7f819e000640 10 client.4333 ms_handle_connect on v2:172.21.15.196:6836/3644723215 2024-05-14T09:41:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.436+0000 7f819e000640 1 -- 172.21.15.135:0/55699075 <== mds.0 v2:172.21.15.196:6836/3644723215 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ac0bd573a0 con 0x55ac0ba01e40 2024-05-14T09:41:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.436+0000 7f819e000640 10 client.4333 handle_command_reply: tid=0 2024-05-14T09:41:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.436+0000 7f81c2c2f740 1 client.4333 shutdown 2024-05-14T09:41:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.437+0000 7f81c2c2f740 1 -- 172.21.15.135:0/55699075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 msgr2=0x55ac0be1ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.437+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/55699075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be1ebb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0b4d10 tx=0x7f81ac088710 comp rx=0 tx=0).stop 2024-05-14T09:41:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.437+0000 7f81c2c2f740 1 -- 172.21.15.135:0/55699075 shutdown_connections 2024-05-14T09:41:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.437+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/55699075 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x55ac0ba01e40 0x55ac0be44830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.437+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/55699075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be1ebb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.437+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/55699075 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba22590 0x55ac0be21a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.437+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/55699075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba1a3b0 0x55ac0be39d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.437+0000 7f819e000640 0 client.4333 ms_handle_reset on v2:172.21.15.196:6836/3644723215 2024-05-14T09:41:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.437+0000 7f81c2c2f740 1 -- 172.21.15.135:0/55699075 >> 172.21.15.135:0/55699075 conn(0x55ac0ba373c0 msgr2=0x55ac0bde0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.438+0000 7f81c2c2f740 1 -- 172.21.15.135:0/55699075 shutdown_connections 2024-05-14T09:41:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.438+0000 7f81c2c2f740 1 -- 172.21.15.135:0/55699075 wait complete. 2024-05-14T09:41:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.438+0000 7f81c2c2f740 20 client.4333 trim_cache size 0 max 16384 2024-05-14T09:41:03.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.486+0000 7f81c2c2f740 1 Processor -- start 2024-05-14T09:41:03.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.486+0000 7f81c2c2f740 1 -- start start 2024-05-14T09:41:03.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.489+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba1a3b0 0x55ac0bde5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:03.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.489+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba22590 0x55ac0be237c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:03.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.489+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be23d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:03.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.489+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81b41ff980 con 0x55ac0ba1a3b0 2024-05-14T09:41:03.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.489+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ac0bde4ce0 con 0x55ac0ba43270 2024-05-14T09:41:03.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.489+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55ac0be2caa0 con 0x55ac0ba22590 2024-05-14T09:41:03.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.491+0000 7f81b9200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba1a3b0 0x55ac0bde5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:03.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.491+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba22590 0x55ac0be237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:03.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.491+0000 7f81b9200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba1a3b0 0x55ac0bde5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50512/0 (socket says 172.21.15.135:50512) 2024-05-14T09:41:03.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.491+0000 7f81b9200640 1 -- 172.21.15.135:0/2681409813 learned_addr learned my addr 172.21.15.135:0/2681409813 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.495+0000 7f81b9200640 1 -- 172.21.15.135:0/2681409813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba22590 msgr2=0x55ac0be237c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.495+0000 7f81b9200640 1 --2- 172.21.15.135:0/2681409813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba22590 0x55ac0be237c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.495+0000 7f81b9200640 1 -- 172.21.15.135:0/2681409813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 msgr2=0x55ac0be23d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:03.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.495+0000 7f81b9200640 1 --2- 172.21.15.135:0/2681409813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be23d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.495+0000 7f81b9200640 1 -- 172.21.15.135:0/2681409813 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac0bddae60 con 0x55ac0ba1a3b0 2024-05-14T09:41:03.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.498+0000 7f81b9200640 1 --2- 172.21.15.135:0/2681409813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba1a3b0 0x55ac0bde5050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81a4007b60 tx=0x7f81a4006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ae5e51f6adab17 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:03.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.504+0000 7f81a8c00640 1 -- 172.21.15.135:0/2681409813 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a402b070 con 0x55ac0ba1a3b0 2024-05-14T09:41:03.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.505+0000 7f81a8c00640 1 -- 172.21.15.135:0/2681409813 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a4018070 con 0x55ac0ba1a3b0 2024-05-14T09:41:03.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.505+0000 7f81a8c00640 1 -- 172.21.15.135:0/2681409813 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4012b70 con 0x55ac0ba1a3b0 2024-05-14T09:41:03.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.506+0000 7f81c2c2f740 1 -- 172.21.15.135:0/2681409813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba1a3b0 msgr2=0x55ac0bde5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:03.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.506+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/2681409813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba1a3b0 0x55ac0bde5050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81a4007b60 tx=0x7f81a4006040 comp rx=0 tx=0).stop 2024-05-14T09:41:03.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.506+0000 7f81c2c2f740 1 -- 172.21.15.135:0/2681409813 shutdown_connections 2024-05-14T09:41:03.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.506+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/2681409813 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be23d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.506+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/2681409813 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba22590 0x55ac0be237c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.506+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/2681409813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba1a3b0 0x55ac0bde5050 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.506+0000 7f81c2c2f740 1 -- 172.21.15.135:0/2681409813 >> 172.21.15.135:0/2681409813 conn(0x55ac0ba373c0 msgr2=0x55ac0be0ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:03.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.506+0000 7f81c2c2f740 1 -- 172.21.15.135:0/2681409813 shutdown_connections 2024-05-14T09:41:03.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.507+0000 7f81c2c2f740 1 -- 172.21.15.135:0/2681409813 wait complete. 2024-05-14T09:41:03.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.508+0000 7f81c2c2f740 1 -- start start 2024-05-14T09:41:03.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.508+0000 7f81c2c2f740 1 Processor -- start 2024-05-14T09:41:03.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.510+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba1a3b0 0x55ac0bea4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:03.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.510+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba22590 0x55ac0bde1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:03.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.510+0000 7f81c2c2f740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be3ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:03.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.510+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ac0be1fb20 con 0x55ac0ba22590 2024-05-14T09:41:03.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.510+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55ac0be35fa0 con 0x55ac0ba43270 2024-05-14T09:41:03.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.510+0000 7f81c2c2f740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x55ac0be22a70 con 0x55ac0ba1a3b0 2024-05-14T09:41:03.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.510+0000 7f81c2c2f740 10 client.0 _ll_register_callbacks cb 0x7f81ac003ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:03.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.511+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba22590 0x55ac0bde1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:03.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.512+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba22590 0x55ac0bde1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50514/0 (socket says 172.21.15.135:50514) 2024-05-14T09:41:03.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.512+0000 7f81b3e00640 1 -- 172.21.15.135:0/3053663399 learned_addr learned my addr 172.21.15.135:0/3053663399 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:03.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.512+0000 7f81b9200640 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba1a3b0 0x55ac0bea4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:03.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.516+0000 7f81b3e00640 1 -- 172.21.15.135:0/3053663399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba1a3b0 msgr2=0x55ac0bea4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:03.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.516+0000 7f81b3e00640 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba1a3b0 0x55ac0bea4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.516+0000 7f81b3e00640 1 -- 172.21.15.135:0/3053663399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 msgr2=0x55ac0be3ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:03.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.516+0000 7f81b3e00640 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be3ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.516+0000 7f81b3e00640 1 -- 172.21.15.135:0/3053663399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac0bddc0e0 con 0x55ac0ba22590 2024-05-14T09:41:03.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.529+0000 7f81b3e00640 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba22590 0x55ac0bde1240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81a0006a90 tx=0x7f81a0006a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beccc0f26deeae80 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:03.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.529+0000 7f819e000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-14T09:41:03.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.698+0000 7f819e000640 1 -- 172.21.15.135:0/3053663399 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0032060 con 0x55ac0ba22590 2024-05-14T09:41:03.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.698+0000 7f819e000640 1 -- 172.21.15.135:0/3053663399 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 6764+0+0 (secure 0 0 0) 0x7f81a002a070 con 0x55ac0ba22590 2024-05-14T09:41:03.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.698+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3053663399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81a4018070 con 0x55ac0ba22590 2024-05-14T09:41:03.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.712+0000 7f819e000640 1 -- 172.21.15.135:0/3053663399 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f81a0038050 con 0x55ac0ba22590 2024-05-14T09:41:03.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.712+0000 7f81c2c2f740 10 client.4308 fetch_fsmap learned FSMap version 7 2024-05-14T09:41:03.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.712+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3053663399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55ac0be21dc0 con 0x55ac0ba22590 2024-05-14T09:41:03.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.729+0000 7f819e000640 1 -- 172.21.15.135:0/3053663399 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a4018070 con 0x55ac0ba22590 2024-05-14T09:41:03.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.729+0000 7f819e000640 1 -- 172.21.15.135:0/3053663399 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f81a003b020 con 0x55ac0ba22590 2024-05-14T09:41:03.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.729+0000 7f81c2c2f740 10 client.4308 fetch_fsmap finished waiting for FSMap version 7 2024-05-14T09:41:03.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.729+0000 7f81c2c2f740 10 client.4308 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-14T09:41:03.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.729+0000 7f81c2c2f740 20 client.4308 populate_metadata read hostname 'smithi135' 2024-05-14T09:41:03.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.729+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x55ac0be3e310 0x55ac0be32f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:03.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.729+0000 7f81c2c2f740 4 client.4308 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:41:03.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.729+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3053663399 --> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] -- command(tid 0: {"prefix": "status"}) -- 0x55ac0bd51210 con 0x55ac0be3e310 2024-05-14T09:41:03.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.733+0000 7f81b9200640 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x55ac0be3e310 0x55ac0be32f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:03.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.741+0000 7f81b9200640 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x55ac0be3e310 0x55ac0be32f80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1590904a35a02ccf server_cookie=d9fed181e8e185ad in_seq=0 out_seq=0 2024-05-14T09:41:03.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.741+0000 7f819e000640 10 client.4308 ms_handle_connect on v2:172.21.15.196:6836/3644723215 2024-05-14T09:41:03.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.776+0000 7f819e000640 1 -- 172.21.15.135:0/3053663399 <== mds.0 v2:172.21.15.196:6836/3644723215 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55ac0bd51210 con 0x55ac0be3e310 2024-05-14T09:41:03.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.776+0000 7f819e000640 10 client.4308 handle_command_reply: tid=0 2024-05-14T09:41:03.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.776+0000 7f81c2c2f740 1 client.4308 shutdown 2024-05-14T09:41:03.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.776+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3053663399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba22590 msgr2=0x55ac0bde1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:03.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.776+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba22590 0x55ac0bde1240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81a0006a90 tx=0x7f81a0006a20 comp rx=0 tx=0).stop 2024-05-14T09:41:03.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.776+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3053663399 shutdown_connections 2024-05-14T09:41:03.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.776+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x55ac0be3e310 0x55ac0be32f80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.776+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55ac0ba43270 0x55ac0be3ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.776+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac0ba22590 0x55ac0bde1240 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.776+0000 7f819e000640 0 client.4308 ms_handle_reset on v2:172.21.15.196:6836/3644723215 2024-05-14T09:41:03.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.776+0000 7f81c2c2f740 1 --2- 172.21.15.135:0/3053663399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x55ac0ba1a3b0 0x55ac0bea4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.777+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3053663399 >> 172.21.15.135:0/3053663399 conn(0x55ac0ba373c0 msgr2=0x55ac0be2b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:03.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.777+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3053663399 shutdown_connections 2024-05-14T09:41:03.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.777+0000 7f81c2c2f740 1 -- 172.21.15.135:0/3053663399 wait complete. 2024-05-14T09:41:03.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.777+0000 7f81c2c2f740 20 client.4308 trim_cache size 0 max 16384 2024-05-14T09:41:03.779 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T09:41:03.779 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "3d7e4a56-2293-41af-9139-c92eede1b811", 2024-05-14T09:41:03.779 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-05-14T09:41:03.779 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4255, 2024-05-14T09:41:03.779 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-14T09:41:03.779 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-14T09:41:03.779 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-14T09:41:03.779 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 16.314305503, 2024-05-14T09:41:03.779 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 7, 2024-05-14T09:41:03.779 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 32, 2024-05-14T09:41:03.780 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 31, 2024-05-14T09:41:03.780 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 27.320696962 2024-05-14T09:41:03.780 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T09:41:03.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 -- 172.21.15.135:0/3208380352 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8194076320 msgr2=0x7f8194078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8194076320 0x7f8194078830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009570 tx=0x7f81a0008040 comp rx=0 tx=0).stop 2024-05-14T09:41:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 -- 172.21.15.135:0/3208380352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81b414f0b0 msgr2=0x7f81b41f3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81b414f0b0 0x7f81b41f3800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009bb0 tx=0x7f81ac004730 comp rx=0 tx=0).stop 2024-05-14T09:41:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 -- 172.21.15.135:0/3208380352 shutdown_connections 2024-05-14T09:41:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8194076320 0x7f8194078830 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f81b4151590 0x7f81b414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81b414f0b0 0x7f81b41f3800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 --2- 172.21.15.135:0/3208380352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8198004d40 0x7f81b4158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 -- 172.21.15.135:0/3208380352 >> 172.21.15.135:0/3208380352 conn(0x7f81b4073d40 msgr2=0x7f81b41e34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 -- 172.21.15.135:0/3208380352 shutdown_connections 2024-05-14T09:41:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:03.779+0000 7f81bbc00640 1 -- 172.21.15.135:0/3208380352 wait complete. 2024-05-14T09:41:03.813 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T09:41:03.813 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:41:03.813 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T09:41:04.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.087+0000 7efde3400640 1 Processor -- start 2024-05-14T09:41:04.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.087+0000 7efde3400640 1 -- start start 2024-05-14T09:41:04.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.089+0000 7efde3400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efddc156930 0x7efddc074810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:04.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.089+0000 7efde3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7e80 0x7efddc0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:04.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.089+0000 7efde3400640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efddc0c8650 con 0x7efddc0c7360 2024-05-14T09:41:04.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.089+0000 7efde3400640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7efddc160a10 con 0x7efddc156930 2024-05-14T09:41:04.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.089+0000 7efde3400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efddc074d50 con 0x7efddc0c7e80 2024-05-14T09:41:04.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.091+0000 7efddbe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7e80 0x7efddc0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:04.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.092+0000 7efddbe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7e80 0x7efddc0c6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:47688/0 (socket says 172.21.15.135:47688) 2024-05-14T09:41:04.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.092+0000 7efddbe00640 1 -- 172.21.15.135:0/2872428989 learned_addr learned my addr 172.21.15.135:0/2872428989 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:04.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.096+0000 7efde0a00640 1 --2- 172.21.15.135:0/2872428989 >> v2:172.21.15.135:3300/0 conn(0x7efddc156930 0x7efddc074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:04.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.100+0000 7efddbe00640 1 -- 172.21.15.135:0/2872428989 >> v2:172.21.15.135:3300/0 conn(0x7efddc156930 msgr2=0x7efddc074810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:04.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.100+0000 7efddbe00640 1 --2- 172.21.15.135:0/2872428989 >> v2:172.21.15.135:3300/0 conn(0x7efddc156930 0x7efddc074810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:04.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.100+0000 7efddbe00640 1 -- 172.21.15.135:0/2872428989 >> v1:172.21.15.135:6789/0 conn(0x7efddc0c7360 legacy=0x7efddc15c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:04.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.100+0000 7efddbe00640 1 -- 172.21.15.135:0/2872428989 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efddc0c8930 con 0x7efddc0c7e80 2024-05-14T09:41:04.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.111+0000 7efddbe00640 1 --2- 172.21.15.135:0/2872428989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7e80 0x7efddc0c6e20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009870 tx=0x7efdcc02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58cf51f042dd22b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:04.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.126+0000 7efddb400640 1 -- 172.21.15.135:0/2872428989 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc037070 con 0x7efddc0c7e80 2024-05-14T09:41:04.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.126+0000 7efddb400640 1 -- 172.21.15.135:0/2872428989 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc032440 con 0x7efddc0c7e80 2024-05-14T09:41:04.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.126+0000 7efddb400640 1 -- 172.21.15.135:0/2872428989 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc032810 con 0x7efddc0c7e80 2024-05-14T09:41:04.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.127+0000 7efde3400640 1 -- 172.21.15.135:0/2872428989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7e80 msgr2=0x7efddc0c6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:04.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.127+0000 7efde3400640 1 --2- 172.21.15.135:0/2872428989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7e80 0x7efddc0c6e20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009870 tx=0x7efdcc02a130 comp rx=0 tx=0).stop 2024-05-14T09:41:04.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.128+0000 7efde3400640 1 -- 172.21.15.135:0/2872428989 shutdown_connections 2024-05-14T09:41:04.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.128+0000 7efde3400640 1 --2- 172.21.15.135:0/2872428989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7e80 0x7efddc0c6e20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:04.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.128+0000 7efde3400640 1 --2- 172.21.15.135:0/2872428989 >> v2:172.21.15.135:3300/0 conn(0x7efddc156930 0x7efddc074810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:04.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.128+0000 7efde3400640 1 -- 172.21.15.135:0/2872428989 >> 172.21.15.135:0/2872428989 conn(0x7efddc073cf0 msgr2=0x7efddc074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:04.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.128+0000 7efde3400640 1 -- 172.21.15.135:0/2872428989 shutdown_connections 2024-05-14T09:41:04.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.128+0000 7efde3400640 1 -- 172.21.15.135:0/2872428989 wait complete. 2024-05-14T09:41:04.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.132+0000 7efde3400640 1 Processor -- start 2024-05-14T09:41:04.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.132+0000 7efde3400640 1 -- start start 2024-05-14T09:41:04.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.135+0000 7efde3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7360 0x7efddc1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:04.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.135+0000 7efde3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc0c7e80 0x7efddc1f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:04.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.135+0000 7efde3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efddc156930 0x7efddc1f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:04.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.135+0000 7efde3400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efddc0c9b50 con 0x7efddc0c7e80 2024-05-14T09:41:04.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.135+0000 7efde3400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efddc160730 con 0x7efddc156930 2024-05-14T09:41:04.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.136+0000 7efde3400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7efddc0c9730 con 0x7efddc0c7360 2024-05-14T09:41:04.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.137+0000 7efde0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7360 0x7efddc1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:04.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.137+0000 7efde1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efddc156930 0x7efddc1f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:04.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.138+0000 7efde1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efddc156930 0x7efddc1f65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:60276/0 (socket says 172.21.15.135:60276) 2024-05-14T09:41:04.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.138+0000 7efde1400640 1 -- 172.21.15.135:0/1446156052 learned_addr learned my addr 172.21.15.135:0/1446156052 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:04.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.150+0000 7efde0a00640 1 -- 172.21.15.135:0/1446156052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efddc156930 msgr2=0x7efddc1f65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:04.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.150+0000 7efde0a00640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efddc156930 0x7efddc1f65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:04.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.150+0000 7efde0a00640 1 -- 172.21.15.135:0/1446156052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc0c7e80 msgr2=0x7efddc1f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:04.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.150+0000 7efde0a00640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc0c7e80 0x7efddc1f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:04.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.150+0000 7efde0a00640 1 -- 172.21.15.135:0/1446156052 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efddc1585e0 con 0x7efddc0c7360 2024-05-14T09:41:04.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.150+0000 7efde1400640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efddc156930 0x7efddc1f65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T09:41:04.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.160+0000 7efde0a00640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7360 0x7efddc1580a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c5c0 tx=0x7efdd000ca80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:04.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.327+0000 7efdd8c00640 1 -- 172.21.15.135:0/1446156052 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0015070 con 0x7efddc0c7360 2024-05-14T09:41:04.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.327+0000 7efdd8c00640 1 -- 172.21.15.135:0/1446156052 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd0004220 con 0x7efddc0c7360 2024-05-14T09:41:04.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.327+0000 7efdd8c00640 1 -- 172.21.15.135:0/1446156052 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0003610 con 0x7efddc0c7360 2024-05-14T09:41:04.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.327+0000 7efde3400640 1 -- 172.21.15.135:0/1446156052 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efddc0c4fe0 con 0x7efddc0c7360 2024-05-14T09:41:04.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.328+0000 7efde3400640 1 -- 172.21.15.135:0/1446156052 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efddc1f6c70 con 0x7efddc0c7360 2024-05-14T09:41:04.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.329+0000 7efde3400640 1 -- 172.21.15.135:0/1446156052 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efddc072270 con 0x7efddc0c7360 2024-05-14T09:41:04.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.696+0000 7efdd8c00640 1 -- 172.21.15.135:0/1446156052 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efdd00037b0 con 0x7efddc0c7360 2024-05-14T09:41:04.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.699+0000 7efdd8c00640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7efdc0076320 0x7efdc0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:04.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.700+0000 7efddbe00640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7efdc0076320 0x7efdc0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:04.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.702+0000 7efddbe00640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7efdc0076320 0x7efdc0078830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efdcc034000 tx=0x7efdcc02c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:04.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.714+0000 7efdd8c00640 1 -- 172.21.15.135:0/1446156052 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7efdd005cd70 con 0x7efddc0c7360 2024-05-14T09:41:04.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:04.756+0000 7efdd8c00640 1 -- 172.21.15.135:0/1446156052 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efddc072270 con 0x7efddc0c7360 2024-05-14T09:41:05.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.028+0000 7efde3400640 1 -- 172.21.15.135:0/1446156052 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efddc069a90 con 0x7efddc0c7360 2024-05-14T09:41:05.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.096+0000 7efdd8c00640 1 -- 172.21.15.135:0/1446156052 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7efdd0069120 con 0x7efddc0c7360 2024-05-14T09:41:05.097 INFO:teuthology.orchestra.run.smithi135.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T09:41:05.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 -- 172.21.15.135:0/1446156052 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7efdc0076320 msgr2=0x7efdc0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:05.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7efdc0076320 0x7efdc0078830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efdcc034000 tx=0x7efdcc02c000 comp rx=0 tx=0).stop 2024-05-14T09:41:05.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 -- 172.21.15.135:0/1446156052 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7360 msgr2=0x7efddc1580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:05.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7360 0x7efddc1580a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c5c0 tx=0x7efdd000ca80 comp rx=0 tx=0).stop 2024-05-14T09:41:05.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 -- 172.21.15.135:0/1446156052 shutdown_connections 2024-05-14T09:41:05.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7efdc0076320 0x7efdc0078830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:05.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efddc156930 0x7efddc1f65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:05.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc0c7e80 0x7efddc1f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:05.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 --2- 172.21.15.135:0/1446156052 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efddc0c7360 0x7efddc1580a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:05.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 -- 172.21.15.135:0/1446156052 >> 172.21.15.135:0/1446156052 conn(0x7efddc073cf0 msgr2=0x7efddc15c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:05.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 -- 172.21.15.135:0/1446156052 shutdown_connections 2024-05-14T09:41:05.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05.100+0000 7efde3400640 1 -- 172.21.15.135:0/1446156052 wait complete. 2024-05-14T09:41:05.127 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-14T09:41:05.127 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T09:41:05.127 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-05-14T09:41:05.127 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-14T09:41:05.127 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:41:05.127 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-14T09:41:05.127 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T09:41:05.128 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T09:41:05.128 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-14T09:41:05.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:05.128 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:41:05.182 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-05-14T09:41:05.183 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:41:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:41:05.183 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T09:41:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:41:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T09:41:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42110sec preferred_lft 42110sec 2024-05-14T09:41:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2024-05-14T09:41:05.183 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:41:05.184 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T09:41:05.184 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:41:05.184 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-14T09:41:05.184 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-05-14T09:41:05.185 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-05-14T09:41:05.185 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-05-14T09:41:05.185 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T09:41:05.185 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-14T09:41:05.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:41:05.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:41:05.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:05.724 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T09:41:05.787 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-05-14T09:41:05.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:05.791 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-05-14T09:41:05.840 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-05-14T09:41:05.840 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T09:41:05.841 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T09:41:05.841 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T09:41:05.841 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T09:41:05.842 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:41:05.842 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-14T09:41:05.842 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T09:41:05.842 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T09:41:05.842 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T09:41:05.842 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-14T09:41:05.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:41:06.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:41:06.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:06.602 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-14T09:41:06.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:06.656 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-05-14T09:41:06.708 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:41:06.708 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-14T09:41:06.708 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:41:06.708 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-14T09:41:06.708 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-14T09:41:06.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:41:06.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:41:06.895 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-14T09:41:06.895 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:41:06.895 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-14T09:41:06.895 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-14T09:41:06.896 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T09:41:06.896 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-14T09:41:06.896 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-14T09:41:06.896 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-14T09:41:06.896 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-14T09:41:06.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:41:07.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:41:07.197 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:41:07.197 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-14T09:41:07.197 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-05-14T09:41:07.197 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T09:41:07.197 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-14T09:41:07.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:41:07.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:41:07.391 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-14T09:41:07.391 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T09:41:07.391 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:41:07.439 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-14T09:41:07.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T09:41:07.439 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:41:07.487 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:41:07.561 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:41:07.610 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:41:07.610 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:41:07.610 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:41:07.610 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:41:07.610 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:41:07.611 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:41:07.612 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:41:07.612 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:41:07.612 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:41:07.612 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:41:07.612 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:41:07.612 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:41:07.612 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:41:07.612 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:41:07.612 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:41:07.612 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:41:07.612 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:41:07.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:07.613 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:41:07.659 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T09:41:07.659 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-14T09:41:07.707 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:41:07.780 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:41:07.823 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:41:07.823 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:41:07.823 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:41:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:41:07.825 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:41:07.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:07.826 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:41:08.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:2024-05-14T09:41:08.014+0000 7f9564c19480 -1 init, newargv = 0x56524c082610 newargc=15 2024-05-14T09:41:08.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:ceph-fuse[42803]: starting ceph client 2024-05-14T09:41:08.616 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:ceph-fuse[42803]: starting fuse 2024-05-14T09:41:09.012 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:41:09.104 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:41:09.160 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:41:09.160 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:41:09.160 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:41:09.160 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:41:09.160 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:41:09.160 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:41:09.160 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:41:09.160 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:41:09.160 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:41:09.160 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:41:09.160 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:41:09.161 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:41:09.162 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:41:09.162 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:41:09.162 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:41:09.162 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:41:09.162 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:41:09.162 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:41:09.162 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:41:09.162 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:41:09.162 INFO:teuthology.orchestra.run.smithi135.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-14T09:41:09.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:09.163 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:41:09.214 INFO:teuthology.orchestra.run.smithi135.stdout:41 2024-05-14T09:41:09.214 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-14T09:41:09.214 DEBUG:teuthology.orchestra.run.smithi135:> sudo stdin-killer -- python3 -c ' 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> import glob 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> import re 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> import os 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> import subprocess 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> def _find_admin_socket(client_name): 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> files = glob.glob(asok_path) 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> # Given a non-glob path, it better be there 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> if "*" not in asok_path: 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> assert(len(files) == 1) 2024-05-14T09:41:09.215 DEBUG:teuthology.orchestra.run.smithi135:> return files[0] 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> for f in files: 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> contents = proc_f.read() 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> if mountpoint in contents: 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> return f 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> print(_find_admin_socket("client.admin")) 2024-05-14T09:41:09.216 DEBUG:teuthology.orchestra.run.smithi135:> ' 2024-05-14T09:41:09.373 INFO:teuthology.orchestra.run.smithi135.stdout:/var/run/ceph/ceph-client.admin.42803.asok 2024-05-14T09:41:09.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:41:09.390 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42803.asok 2024-05-14T09:41:09.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:09.390 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42803.asok status 2024-05-14T09:41:09.680 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T09:41:09.680 INFO:teuthology.orchestra.run.smithi135.stdout: "metadata": { 2024-05-14T09:41:09.680 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T09:41:09.680 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T09:41:09.680 INFO:teuthology.orchestra.run.smithi135.stdout: "entity_id": "admin", 2024-05-14T09:41:09.680 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": "smithi135", 2024-05-14T09:41:09.680 INFO:teuthology.orchestra.run.smithi135.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-14T09:41:09.680 INFO:teuthology.orchestra.run.smithi135.stdout: "pid": "42803", 2024-05-14T09:41:09.680 INFO:teuthology.orchestra.run.smithi135.stdout: "root": "/" 2024-05-14T09:41:09.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_count": 0, 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_pinned_count": 0, 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4314, 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "inst": { 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "name": { 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "client", 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "num": 4314 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1968917264 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-14T09:41:09.681 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1968917264 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: "inst_str": "client.4314 192.168.0.1:0/1968917264", 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: "addr_str": "192.168.0.1:0/1968917264", 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: "inode_count": 1, 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_epoch": 7, 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch": 33, 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch_barrier": 0, 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: "blocklisted": false, 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs" 2024-05-14T09:41:09.682 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T09:41:09.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:09.700 DEBUG:teuthology.orchestra.run.smithi135:> stat --file-system '--printf=%T 2024-05-14T09:41:09.700 DEBUG:teuthology.orchestra.run.smithi135:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:41:09.818 INFO:teuthology.orchestra.run.smithi135.stdout:fuseblk 2024-05-14T09:41:09.819 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:41:09.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:09.820 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:41:10.049 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-14T09:41:10.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T09:41:10.759 INFO:teuthology.orchestra.run.smithi135.stdout:# file: . 2024-05-14T09:41:10.760 INFO:teuthology.orchestra.run.smithi135.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-14T09:41:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:10.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:41:10.773 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:41:10.773 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T09:41:10.830 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T09:41:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.096+0000 7f1cbf200640 1 Processor -- start 2024-05-14T09:41:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.097+0000 7f1cbf200640 1 -- start start 2024-05-14T09:41:11.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.099+0000 7f1cbf200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1cc006c880 0x7f1cc015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.099+0000 7f1cbf200640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc006cfe0 con 0x7f1cc00c6b90 2024-05-14T09:41:11.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.099+0000 7f1cbf200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc0070cf0 con 0x7f1cc0150b20 2024-05-14T09:41:11.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.099+0000 7f1cbf200640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f1cc0071ab0 con 0x7f1cc006c880 2024-05-14T09:41:11.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.100+0000 7f1cb5400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1cc006c880 0x7f1cc015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.101+0000 7f1cbde00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f1cc0150b20 0x7f1cc00c8100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:58384/0 (socket says 172.21.15.135:58384) 2024-05-14T09:41:11.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.101+0000 7f1cbe800640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f1cc00c6b90 0x7f1cc01649c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:36612/0 (socket says 172.21.15.135:36612) 2024-05-14T09:41:11.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.101+0000 7f1cbde00640 1 -- 172.21.15.135:0/3260208145 learned_addr learned my addr 172.21.15.135:0/3260208145 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.105+0000 7f1cb5400640 1 -- 172.21.15.135:0/3260208145 >> v1:172.21.15.196:6789/0 conn(0x7f1cc0150b20 legacy=0x7f1cc00c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.105+0000 7f1cb5400640 1 -- 172.21.15.135:0/3260208145 >> v1:172.21.15.135:6789/0 conn(0x7f1cc00c6b90 legacy=0x7f1cc01649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.105+0000 7f1cb5400640 1 -- 172.21.15.135:0/3260208145 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc0070fd0 con 0x7f1cc006c880 2024-05-14T09:41:11.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.111+0000 7f1cb5400640 1 --2- 172.21.15.135:0/3260208145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cc006c880 0x7f1cc015aa90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80097a0 tx=0x7f1ca802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ca13429447f418 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:11.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.117+0000 7f1cbd400640 1 -- 172.21.15.135:0/3260208145 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8037070 con 0x7f1cc006c880 2024-05-14T09:41:11.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.117+0000 7f1cbd400640 1 -- 172.21.15.135:0/3260208145 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca8032640 con 0x7f1cc006c880 2024-05-14T09:41:11.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.117+0000 7f1cbd400640 1 -- 172.21.15.135:0/3260208145 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8032a10 con 0x7f1cc006c880 2024-05-14T09:41:11.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.118+0000 7f1cbf200640 1 -- 172.21.15.135:0/3260208145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cc006c880 msgr2=0x7f1cc015aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.118+0000 7f1cbf200640 1 --2- 172.21.15.135:0/3260208145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cc006c880 0x7f1cc015aa90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80097a0 tx=0x7f1ca802a2c0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.118+0000 7f1cbf200640 1 -- 172.21.15.135:0/3260208145 shutdown_connections 2024-05-14T09:41:11.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.118+0000 7f1cbf200640 1 --2- 172.21.15.135:0/3260208145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cc006c880 0x7f1cc015aa90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.118+0000 7f1cbf200640 1 -- 172.21.15.135:0/3260208145 >> 172.21.15.135:0/3260208145 conn(0x7f1cc00ca160 msgr2=0x7f1cc00ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:11.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.118+0000 7f1cbf200640 1 -- 172.21.15.135:0/3260208145 shutdown_connections 2024-05-14T09:41:11.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.118+0000 7f1cbf200640 1 -- 172.21.15.135:0/3260208145 wait complete. 2024-05-14T09:41:11.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.121+0000 7f1cbf200640 1 Processor -- start 2024-05-14T09:41:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.121+0000 7f1cbf200640 1 -- start start 2024-05-14T09:41:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.122+0000 7f1cbf200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cc006c880 0x7f1cc01f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.122+0000 7f1cbf200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cc00c6b90 0x7f1cc015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.122+0000 7f1cbf200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc0150b20 0x7f1cc015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.122+0000 7f1cbf200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc015afd0 con 0x7f1cc00c6b90 2024-05-14T09:41:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.122+0000 7f1cbf200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc0150f30 con 0x7f1cc006c880 2024-05-14T09:41:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.122+0000 7f1cbf200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc0071620 con 0x7f1cc0150b20 2024-05-14T09:41:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.123+0000 7f1cb5400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cc00c6b90 0x7f1cc015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.124+0000 7f1cb5400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cc00c6b90 0x7f1cc015d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37228/0 (socket says 172.21.15.135:37228) 2024-05-14T09:41:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.124+0000 7f1cb5400640 1 -- 172.21.15.135:0/1736872445 learned_addr learned my addr 172.21.15.135:0/1736872445 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.124+0000 7f1cbde00640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cc006c880 0x7f1cc01f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.124+0000 7f1cbe800640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc0150b20 0x7f1cc015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.128+0000 7f1cb5400640 1 -- 172.21.15.135:0/1736872445 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc0150b20 msgr2=0x7f1cc015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.128+0000 7f1cb5400640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc0150b20 0x7f1cc015c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.128+0000 7f1cb5400640 1 -- 172.21.15.135:0/1736872445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cc006c880 msgr2=0x7f1cc01f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.128+0000 7f1cb5400640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cc006c880 0x7f1cc01f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.128+0000 7f1cb5400640 1 -- 172.21.15.135:0/1736872445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc015dc90 con 0x7f1cc00c6b90 2024-05-14T09:41:11.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.131+0000 7f1cb5400640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cc00c6b90 0x7f1cc015d0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ca802a8b0 tx=0x7f1ca80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:11.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.139+0000 7f1cb6a00640 1 -- 172.21.15.135:0/1736872445 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8037050 con 0x7f1cc00c6b90 2024-05-14T09:41:11.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.139+0000 7f1cb6a00640 1 -- 172.21.15.135:0/1736872445 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca8043070 con 0x7f1cc00c6b90 2024-05-14T09:41:11.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.139+0000 7f1cb6a00640 1 -- 172.21.15.135:0/1736872445 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8030d60 con 0x7f1cc00c6b90 2024-05-14T09:41:11.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.139+0000 7f1cbf200640 1 -- 172.21.15.135:0/1736872445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc0159c00 con 0x7f1cc00c6b90 2024-05-14T09:41:11.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.139+0000 7f1cbf200640 1 -- 172.21.15.135:0/1736872445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc015b580 con 0x7f1cc00c6b90 2024-05-14T09:41:11.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.141+0000 7f1cbf200640 1 -- 172.21.15.135:0/1736872445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc0069980 con 0x7f1cc00c6b90 2024-05-14T09:41:11.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.168+0000 7f1cb6a00640 1 -- 172.21.15.135:0/1736872445 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ca8048460 con 0x7f1cc00c6b90 2024-05-14T09:41:11.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.169+0000 7f1cb6a00640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f1c9c076320 0x7f1c9c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:11.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.169+0000 7f1cbde00640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f1c9c076320 0x7f1c9c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:11.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.170+0000 7f1cbde00640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f1c9c076320 0x7f1c9c078830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0000f60 tx=0x7f1cb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:11.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.503+0000 7f1cb6a00640 1 -- 172.21.15.135:0/1736872445 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f1ca80325e0 con 0x7f1cc00c6b90 2024-05-14T09:41:11.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.504+0000 7f1cb6a00640 1 -- 172.21.15.135:0/1736872445 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1ca80823a0 con 0x7f1cc00c6b90 2024-05-14T09:41:11.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.739+0000 7f1cbf200640 1 -- 172.21.15.135:0/1736872445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1cc006d3e0 con 0x7f1cc00c6b90 2024-05-14T09:41:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.754+0000 7f1cb6a00640 1 -- 172.21.15.135:0/1736872445 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f1ca80866a0 con 0x7f1cc00c6b90 2024-05-14T09:41:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:listed 0 entries 2024-05-14T09:41:11.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.757+0000 7f1cbf200640 1 -- 172.21.15.135:0/1736872445 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f1c9c076320 msgr2=0x7f1c9c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.757+0000 7f1cbf200640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f1c9c076320 0x7f1c9c078830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0000f60 tx=0x7f1cb0009040 comp rx=0 tx=0).stop 2024-05-14T09:41:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.757+0000 7f1cbf200640 1 -- 172.21.15.135:0/1736872445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cc00c6b90 msgr2=0x7f1cc015d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.757+0000 7f1cbf200640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cc00c6b90 0x7f1cc015d0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ca802a8b0 tx=0x7f1ca80046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.757+0000 7f1cbf200640 1 -- 172.21.15.135:0/1736872445 shutdown_connections 2024-05-14T09:41:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.757+0000 7f1cbf200640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f1c9c076320 0x7f1c9c078830 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.757+0000 7f1cbf200640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1cc0150b20 0x7f1cc015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.757+0000 7f1cbf200640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cc00c6b90 0x7f1cc015d0c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.757+0000 7f1cbf200640 1 --2- 172.21.15.135:0/1736872445 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1cc006c880 0x7f1cc01f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.757+0000 7f1cbf200640 1 -- 172.21.15.135:0/1736872445 >> 172.21.15.135:0/1736872445 conn(0x7f1cc00ca160 msgr2=0x7f1cc014db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.757+0000 7f1cbf200640 1 -- 172.21.15.135:0/1736872445 shutdown_connections 2024-05-14T09:41:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:11.758+0000 7f1cbf200640 1 -- 172.21.15.135:0/1736872445 wait complete. 2024-05-14T09:41:11.782 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:41:11.783 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T09:41:11.832 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T09:41:12.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.143+0000 7f525a000640 1 Processor -- start 2024-05-14T09:41:12.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.144+0000 7f525a000640 1 -- start start 2024-05-14T09:41:12.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.146+0000 7f525a000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f52540c66b0 0x7f52541564f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:12.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.146+0000 7f525a000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f525406d6c0 0x7f525406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:12.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.146+0000 7f525a000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5254160370 con 0x7f52540cdbb0 2024-05-14T09:41:12.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.146+0000 7f525a000640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f525406e010 con 0x7f52540c66b0 2024-05-14T09:41:12.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.146+0000 7f525a000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f52540b4510 con 0x7f525406d6c0 2024-05-14T09:41:12.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.147+0000 7f5253e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f52540c66b0 0x7f52541564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:12.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.147+0000 7f5253e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f52540c66b0 0x7f52541564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37238/0 (socket says 172.21.15.135:37238) 2024-05-14T09:41:12.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.147+0000 7f5253e00640 1 -- 172.21.15.135:0/3429525548 learned_addr learned my addr 172.21.15.135:0/3429525548 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:12.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.148+0000 7f5259600640 1 --2- 172.21.15.135:0/3429525548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f525406d6c0 0x7f525406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.150+0000 7f5253e00640 1 -- 172.21.15.135:0/3429525548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f525406d6c0 msgr2=0x7f525406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:12.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.150+0000 7f5253e00640 1 --2- 172.21.15.135:0/3429525548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f525406d6c0 0x7f525406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.150+0000 7f5253e00640 1 -- 172.21.15.135:0/3429525548 >> v1:172.21.15.196:6789/0 conn(0x7f52540cdbb0 legacy=0x7f525415f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:12.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.150+0000 7f5253e00640 1 -- 172.21.15.135:0/3429525548 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52540c6ac0 con 0x7f52540c66b0 2024-05-14T09:41:12.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.153+0000 7f5253e00640 1 --2- 172.21.15.135:0/3429525548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52540c66b0 0x7f52541564f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5240009e50 tx=0x7f524002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88079df738459bb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:12.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.158+0000 7f5253400640 1 -- 172.21.15.135:0/3429525548 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240036070 con 0x7f52540c66b0 2024-05-14T09:41:12.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.158+0000 7f5253400640 1 -- 172.21.15.135:0/3429525548 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5240031600 con 0x7f52540c66b0 2024-05-14T09:41:12.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.158+0000 7f5253400640 1 -- 172.21.15.135:0/3429525548 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52400319d0 con 0x7f52540c66b0 2024-05-14T09:41:12.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.159+0000 7f525a000640 1 -- 172.21.15.135:0/3429525548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52540c66b0 msgr2=0x7f52541564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:12.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.159+0000 7f525a000640 1 --2- 172.21.15.135:0/3429525548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52540c66b0 0x7f52541564f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5240009e50 tx=0x7f524002a710 comp rx=0 tx=0).stop 2024-05-14T09:41:12.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.159+0000 7f525a000640 1 -- 172.21.15.135:0/3429525548 shutdown_connections 2024-05-14T09:41:12.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.159+0000 7f525a000640 1 --2- 172.21.15.135:0/3429525548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f525406d6c0 0x7f525406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:12.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.159+0000 7f525a000640 1 --2- 172.21.15.135:0/3429525548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52540c66b0 0x7f52541564f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:12.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.159+0000 7f525a000640 1 -- 172.21.15.135:0/3429525548 >> 172.21.15.135:0/3429525548 conn(0x7f52540ce630 msgr2=0x7f52540cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:12.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.159+0000 7f525a000640 1 -- 172.21.15.135:0/3429525548 shutdown_connections 2024-05-14T09:41:12.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.159+0000 7f525a000640 1 -- 172.21.15.135:0/3429525548 wait complete. 2024-05-14T09:41:12.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.162+0000 7f525a000640 1 Processor -- start 2024-05-14T09:41:12.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.162+0000 7f525a000640 1 -- start start 2024-05-14T09:41:12.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.163+0000 7f525a000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f525406d6c0 0x7f52541f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:12.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.163+0000 7f525a000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52540c66b0 0x7f52540cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:12.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.163+0000 7f525a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52540cdbb0 0x7f52540caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:12.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.163+0000 7f525a000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f52540cce30 con 0x7f52540cdbb0 2024-05-14T09:41:12.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.163+0000 7f525a000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f52540cd3f0 con 0x7f525406d6c0 2024-05-14T09:41:12.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.163+0000 7f525a000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f52540cd110 con 0x7f52540c66b0 2024-05-14T09:41:12.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.164+0000 7f5259600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52540cdbb0 0x7f52540caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:12.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.165+0000 7f5259600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52540cdbb0 0x7f52540caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37248/0 (socket says 172.21.15.135:37248) 2024-05-14T09:41:12.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.165+0000 7f5259600640 1 -- 172.21.15.135:0/298513024 learned_addr learned my addr 172.21.15.135:0/298513024 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:12.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.165+0000 7f5258c00640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f525406d6c0 0x7f52541f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:12.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.166+0000 7f5253e00640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52540c66b0 0x7f52540cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.169+0000 7f5259600640 1 -- 172.21.15.135:0/298513024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52540c66b0 msgr2=0x7f52540cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.169+0000 7f5259600640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52540c66b0 0x7f52540cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.169+0000 7f5259600640 1 -- 172.21.15.135:0/298513024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f525406d6c0 msgr2=0x7f52541f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.169+0000 7f5259600640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f525406d6c0 0x7f52541f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.169+0000 7f5259600640 1 -- 172.21.15.135:0/298513024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52540d0070 con 0x7f52540cdbb0 2024-05-14T09:41:12.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.172+0000 7f5259600640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52540cdbb0 0x7f52540caac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f524c00d600 tx=0x7f524c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.177+0000 7f5250c00640 1 -- 172.21.15.135:0/298513024 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0125f0 con 0x7f52540cdbb0 2024-05-14T09:41:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.177+0000 7f5250c00640 1 -- 172.21.15.135:0/298513024 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524c019070 con 0x7f52540cdbb0 2024-05-14T09:41:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.177+0000 7f5250c00640 1 -- 172.21.15.135:0/298513024 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0129f0 con 0x7f52540cdbb0 2024-05-14T09:41:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.177+0000 7f525a000640 1 -- 172.21.15.135:0/298513024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525415dbf0 con 0x7f52540cdbb0 2024-05-14T09:41:12.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.177+0000 7f525a000640 1 -- 172.21.15.135:0/298513024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525415e1b0 con 0x7f52540cdbb0 2024-05-14T09:41:12.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.179+0000 7f525a000640 1 -- 172.21.15.135:0/298513024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5254151bd0 con 0x7f52540cdbb0 2024-05-14T09:41:12.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.204+0000 7f5250c00640 1 -- 172.21.15.135:0/298513024 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f524c012b90 con 0x7f52540cdbb0 2024-05-14T09:41:12.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.205+0000 7f5250c00640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f5234076350 0x7f5234078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:12.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.206+0000 7f5258c00640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f5234076350 0x7f5234078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.207+0000 7f5258c00640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f5234076350 0x7f5234078860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5244001720 tx=0x7f5244009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:12.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.554+0000 7f5250c00640 1 -- 172.21.15.135:0/298513024 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f524c05d8c0 con 0x7f52540cdbb0 2024-05-14T09:41:12.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.555+0000 7f5250c00640 1 -- 172.21.15.135:0/298513024 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5254151bd0 con 0x7f52540cdbb0 2024-05-14T09:41:12.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.790+0000 7f525a000640 1 -- 172.21.15.135:0/298513024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5254076550 con 0x7f52540cdbb0 2024-05-14T09:41:12.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.822+0000 7f5250c00640 1 -- 172.21.15.135:0/298513024 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f524c061630 con 0x7f52540cdbb0 2024-05-14T09:41:12.822 INFO:teuthology.orchestra.run.smithi135.stderr:listed 0 entries 2024-05-14T09:41:12.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.825+0000 7f525a000640 1 -- 172.21.15.135:0/298513024 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f5234076350 msgr2=0x7f5234078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:12.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.825+0000 7f525a000640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f5234076350 0x7f5234078860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5244001720 tx=0x7f5244009040 comp rx=0 tx=0).stop 2024-05-14T09:41:12.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.825+0000 7f525a000640 1 -- 172.21.15.135:0/298513024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52540cdbb0 msgr2=0x7f52540caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:12.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.825+0000 7f525a000640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52540cdbb0 0x7f52540caac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f524c00d600 tx=0x7f524c00dac0 comp rx=0 tx=0).stop 2024-05-14T09:41:12.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.825+0000 7f525a000640 1 -- 172.21.15.135:0/298513024 shutdown_connections 2024-05-14T09:41:12.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.825+0000 7f525a000640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f5234076350 0x7f5234078860 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:12.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.825+0000 7f525a000640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52540cdbb0 0x7f52540caac0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:12.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.826+0000 7f525a000640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52540c66b0 0x7f52540cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:12.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.826+0000 7f525a000640 1 --2- 172.21.15.135:0/298513024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f525406d6c0 0x7f52541f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:12.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.826+0000 7f525a000640 1 -- 172.21.15.135:0/298513024 >> 172.21.15.135:0/298513024 conn(0x7f52540ce630 msgr2=0x7f52541523d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:12.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.826+0000 7f525a000640 1 -- 172.21.15.135:0/298513024 shutdown_connections 2024-05-14T09:41:12.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:12.826+0000 7f525a000640 1 -- 172.21.15.135:0/298513024 wait complete. 2024-05-14T09:41:12.856 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi135.front.sepia.ceph.com... 2024-05-14T09:41:12.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:12.856 DEBUG:teuthology.orchestra.run.smithi135:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-14T09:41:12.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:ceph-fuse[42803]: fuse finished with error 0 and tester_r 0 2024-05-14T09:41:12.932 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T09:41:19.034 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T09:41:19.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:19.034 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-14T09:41:19.095 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:41:19.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.370+0000 7fbd9ee00640 1 Processor -- start 2024-05-14T09:41:19.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.370+0000 7fbd9ee00640 1 -- start start 2024-05-14T09:41:19.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.372+0000 7fbd9ee00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbd980b6e80 0x7fbd980cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:19.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.372+0000 7fbd9ee00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbd980ccef0 0x7fbd980b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:19.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.372+0000 7fbd9ee00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd980b7290 con 0x7fbd9815c4d0 2024-05-14T09:41:19.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.372+0000 7fbd9ee00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbd9806de00 con 0x7fbd980b6e80 2024-05-14T09:41:19.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.372+0000 7fbd9ee00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fbd9806cf10 con 0x7fbd980ccef0 2024-05-14T09:41:19.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.415+0000 7fbd8f400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbd980b6e80 0x7fbd980cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:19.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.416+0000 7fbd8f400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbd980b6e80 0x7fbd980cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43236/0 (socket says 172.21.15.135:43236) 2024-05-14T09:41:19.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.416+0000 7fbd8f400640 1 -- 172.21.15.135:0/4173970162 learned_addr learned my addr 172.21.15.135:0/4173970162 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:19.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.422+0000 7fbd8f400640 1 -- 172.21.15.135:0/4173970162 >> v2:172.21.15.196:3300/0 conn(0x7fbd980ccef0 msgr2=0x7fbd980b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:19.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.422+0000 7fbd8f400640 1 --2- 172.21.15.135:0/4173970162 >> v2:172.21.15.196:3300/0 conn(0x7fbd980ccef0 0x7fbd980b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:19.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.423+0000 7fbd8f400640 1 -- 172.21.15.135:0/4173970162 >> v1:172.21.15.196:6789/0 conn(0x7fbd9815c4d0 legacy=0x7fbd9806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:19.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.423+0000 7fbd8f400640 1 -- 172.21.15.135:0/4173970162 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9806d1f0 con 0x7fbd980b6e80 2024-05-14T09:41:19.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.431+0000 7fbd8f400640 1 --2- 172.21.15.135:0/4173970162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd980b6e80 0x7fbd980cc9b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbd980cf730 tx=0x7fbd8002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9f5a15cf2d144a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:19.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.440+0000 7fbd97400640 1 -- 172.21.15.135:0/4173970162 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80037070 con 0x7fbd980b6e80 2024-05-14T09:41:19.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.441+0000 7fbd97400640 1 -- 172.21.15.135:0/4173970162 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd80032440 con 0x7fbd980b6e80 2024-05-14T09:41:19.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.441+0000 7fbd97400640 1 -- 172.21.15.135:0/4173970162 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd800327f0 con 0x7fbd980b6e80 2024-05-14T09:41:19.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.442+0000 7fbd9ee00640 1 -- 172.21.15.135:0/4173970162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd980b6e80 msgr2=0x7fbd980cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:19.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.442+0000 7fbd9ee00640 1 --2- 172.21.15.135:0/4173970162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd980b6e80 0x7fbd980cc9b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbd980cf730 tx=0x7fbd8002a290 comp rx=0 tx=0).stop 2024-05-14T09:41:19.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.443+0000 7fbd9ee00640 1 -- 172.21.15.135:0/4173970162 shutdown_connections 2024-05-14T09:41:19.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.443+0000 7fbd9ee00640 1 --2- 172.21.15.135:0/4173970162 >> v2:172.21.15.196:3300/0 conn(0x7fbd980ccef0 0x7fbd980b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:19.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.443+0000 7fbd9ee00640 1 --2- 172.21.15.135:0/4173970162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd980b6e80 0x7fbd980cc9b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:19.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.443+0000 7fbd9ee00640 1 -- 172.21.15.135:0/4173970162 >> 172.21.15.135:0/4173970162 conn(0x7fbd980d1880 msgr2=0x7fbd980d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:19.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.443+0000 7fbd9ee00640 1 -- 172.21.15.135:0/4173970162 shutdown_connections 2024-05-14T09:41:19.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.443+0000 7fbd9ee00640 1 -- 172.21.15.135:0/4173970162 wait complete. 2024-05-14T09:41:19.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.449+0000 7fbd9ee00640 1 Processor -- start 2024-05-14T09:41:19.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.449+0000 7fbd9ee00640 1 -- start start 2024-05-14T09:41:19.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.452+0000 7fbd9ee00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd980b6e80 0x7fbd981557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:19.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.452+0000 7fbd9ee00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd980ccef0 0x7fbd981f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:19.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.452+0000 7fbd9ee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd9815c4d0 0x7fbd981f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:19.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.452+0000 7fbd9ee00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9806da90 con 0x7fbd980ccef0 2024-05-14T09:41:19.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.452+0000 7fbd9ee00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9806d7b0 con 0x7fbd980b6e80 2024-05-14T09:41:19.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.452+0000 7fbd9ee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbd980cd710 con 0x7fbd9815c4d0 2024-05-14T09:41:19.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.454+0000 7fbd8f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd980ccef0 0x7fbd981f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:19.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.454+0000 7fbd97e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd980b6e80 0x7fbd981557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:19.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.454+0000 7fbd9ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd9815c4d0 0x7fbd981f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:19.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.454+0000 7fbd8f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd980ccef0 0x7fbd981f59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43248/0 (socket says 172.21.15.135:43248) 2024-05-14T09:41:19.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.454+0000 7fbd8f400640 1 -- 172.21.15.135:0/2401950743 learned_addr learned my addr 172.21.15.135:0/2401950743 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:19.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.459+0000 7fbd8f400640 1 -- 172.21.15.135:0/2401950743 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd9815c4d0 msgr2=0x7fbd981f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:19.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.459+0000 7fbd8f400640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd9815c4d0 0x7fbd981f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:19.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.459+0000 7fbd8f400640 1 -- 172.21.15.135:0/2401950743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd980b6e80 msgr2=0x7fbd981557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:19.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.459+0000 7fbd8f400640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd980b6e80 0x7fbd981557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:19.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.459+0000 7fbd8f400640 1 -- 172.21.15.135:0/2401950743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd981f33a0 con 0x7fbd980ccef0 2024-05-14T09:41:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.463+0000 7fbd8f400640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd980ccef0 0x7fbd981f59f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbd8002a880 tx=0x7fbd800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:19.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.469+0000 7fbd94c00640 1 -- 172.21.15.135:0/2401950743 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80041070 con 0x7fbd980ccef0 2024-05-14T09:41:19.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.469+0000 7fbd94c00640 1 -- 172.21.15.135:0/2401950743 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8003c930 con 0x7fbd980ccef0 2024-05-14T09:41:19.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.469+0000 7fbd94c00640 1 -- 172.21.15.135:0/2401950743 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80037040 con 0x7fbd980ccef0 2024-05-14T09:41:19.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.470+0000 7fbd9ee00640 1 -- 172.21.15.135:0/2401950743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd981f2620 con 0x7fbd980ccef0 2024-05-14T09:41:19.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.470+0000 7fbd9ee00640 1 -- 172.21.15.135:0/2401950743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd981f2ba0 con 0x7fbd980ccef0 2024-05-14T09:41:19.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.471+0000 7fbd9ee00640 1 -- 172.21.15.135:0/2401950743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd981595a0 con 0x7fbd980ccef0 2024-05-14T09:41:19.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.502+0000 7fbd94c00640 1 -- 172.21.15.135:0/2401950743 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd80044070 con 0x7fbd980ccef0 2024-05-14T09:41:19.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.505+0000 7fbd94c00640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbd74076320 0x7fbd74078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:19.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.506+0000 7fbd97e00640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbd74076320 0x7fbd74078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:19.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.507+0000 7fbd97e00640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbd74076320 0x7fbd74078830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009fd0 tx=0x7fbd8800d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:19.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.831+0000 7fbd94c00640 1 -- 172.21.15.135:0/2401950743 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fbd8007da50 con 0x7fbd980ccef0 2024-05-14T09:41:19.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:19.831+0000 7fbd94c00640 1 -- 172.21.15.135:0/2401950743 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbd800817c0 con 0x7fbd980ccef0 2024-05-14T09:41:20.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.049+0000 7fbd9ee00640 1 -- 172.21.15.135:0/2401950743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd980cd4f0 con 0x7fbd980ccef0 2024-05-14T09:41:20.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.146+0000 7fbd94c00640 1 -- 172.21.15.135:0/2401950743 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+18997 (secure 0 0 0) 0x7fbd80085ac0 con 0x7fbd980ccef0 2024-05-14T09:41:20.147 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:20.147 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":33,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:41:04.087625+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:40:40.770106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:40:43.375791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:40:51.210089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:41:20.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 -- 172.21.15.135:0/2401950743 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbd74076320 msgr2=0x7fbd74078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:20.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbd74076320 0x7fbd74078830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009fd0 tx=0x7fbd8800d040 comp rx=0 tx=0).stop 2024-05-14T09:41:20.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 -- 172.21.15.135:0/2401950743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd980ccef0 msgr2=0x7fbd981f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:20.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd980ccef0 0x7fbd981f59f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbd8002a880 tx=0x7fbd800046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:20.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 -- 172.21.15.135:0/2401950743 shutdown_connections 2024-05-14T09:41:20.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbd74076320 0x7fbd74078830 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:20.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd9815c4d0 0x7fbd981f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:20.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd980ccef0 0x7fbd981f59f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:20.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 --2- 172.21.15.135:0/2401950743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd980b6e80 0x7fbd981557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:20.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 -- 172.21.15.135:0/2401950743 >> 172.21.15.135:0/2401950743 conn(0x7fbd980d1880 msgr2=0x7fbd980d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:20.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 -- 172.21.15.135:0/2401950743 shutdown_connections 2024-05-14T09:41:20.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.150+0000 7fbd9ee00640 1 -- 172.21.15.135:0/2401950743 wait complete. 2024-05-14T09:41:20.181 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:41:20.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.448+0000 7f8dc1000640 1 Processor -- start 2024-05-14T09:41:20.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.448+0000 7f8dc1000640 1 -- start start 2024-05-14T09:41:20.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.451+0000 7f8dc1000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8dbc0b3d20 0x7f8dbc154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:20.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.451+0000 7f8dc1000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8dbc06d100 0x7f8dbc0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:20.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.451+0000 7f8dc1000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dbc15a3b0 con 0x7f8dbc0c58e0 2024-05-14T09:41:20.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.451+0000 7f8dc1000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8dbc15a650 con 0x7f8dbc06d100 2024-05-14T09:41:20.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.451+0000 7f8dc1000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8dbc15a930 con 0x7f8dbc0b3d20 2024-05-14T09:41:20.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.472+0000 7f8db9400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8dbc06d100 0x7f8dbc0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.473+0000 7f8db9400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8dbc06d100 0x7f8dbc0c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:58266/0 (socket says 172.21.15.135:58266) 2024-05-14T09:41:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.473+0000 7f8db9400640 1 -- 172.21.15.135:0/3065916378 learned_addr learned my addr 172.21.15.135:0/3065916378 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:20.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.475+0000 7f8db9e00640 1 --2- 172.21.15.135:0/3065916378 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8dbc0b3d20 0x7f8dbc154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.485+0000 7f8db9400640 1 -- 172.21.15.135:0/3065916378 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8dbc0b3d20 msgr2=0x7f8dbc154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.485+0000 7f8db9400640 1 --2- 172.21.15.135:0/3065916378 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8dbc0b3d20 0x7f8dbc154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.485+0000 7f8db9400640 1 -- 172.21.15.135:0/3065916378 >> v1:172.21.15.196:6789/0 conn(0x7f8dbc0c58e0 legacy=0x7f8dbc15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:20.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.485+0000 7f8db9400640 1 -- 172.21.15.135:0/3065916378 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc15ac10 con 0x7f8dbc06d100 2024-05-14T09:41:20.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.497+0000 7f8db9400640 1 --2- 172.21.15.135:0/3065916378 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dbc06d100 0x7f8dbc0c53a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc15a580 tx=0x7f8da802a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=906419a0760ee98c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:20.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.521+0000 7f8db8a00640 1 -- 172.21.15.135:0/3065916378 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8037070 con 0x7f8dbc06d100 2024-05-14T09:41:20.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.521+0000 7f8db8a00640 1 -- 172.21.15.135:0/3065916378 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da8032640 con 0x7f8dbc06d100 2024-05-14T09:41:20.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.521+0000 7f8db8a00640 1 -- 172.21.15.135:0/3065916378 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8032a10 con 0x7f8dbc06d100 2024-05-14T09:41:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.523+0000 7f8dc1000640 1 -- 172.21.15.135:0/3065916378 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dbc06d100 msgr2=0x7f8dbc0c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.523+0000 7f8dc1000640 1 --2- 172.21.15.135:0/3065916378 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dbc06d100 0x7f8dbc0c53a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc15a580 tx=0x7f8da802a2e0 comp rx=0 tx=0).stop 2024-05-14T09:41:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.523+0000 7f8dc1000640 1 -- 172.21.15.135:0/3065916378 shutdown_connections 2024-05-14T09:41:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.523+0000 7f8dc1000640 1 --2- 172.21.15.135:0/3065916378 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dbc06d100 0x7f8dbc0c53a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.523+0000 7f8dc1000640 1 --2- 172.21.15.135:0/3065916378 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8dbc0b3d20 0x7f8dbc154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:20.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.523+0000 7f8dc1000640 1 -- 172.21.15.135:0/3065916378 >> 172.21.15.135:0/3065916378 conn(0x7f8dbc071ab0 msgr2=0x7f8dbc071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:20.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.523+0000 7f8dc1000640 1 -- 172.21.15.135:0/3065916378 shutdown_connections 2024-05-14T09:41:20.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.523+0000 7f8dc1000640 1 -- 172.21.15.135:0/3065916378 wait complete. 2024-05-14T09:41:20.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.527+0000 7f8dc1000640 1 Processor -- start 2024-05-14T09:41:20.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.527+0000 7f8dc1000640 1 -- start start 2024-05-14T09:41:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.529+0000 7f8dc1000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8dbc06d100 0x7f8dbc15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.529+0000 7f8dc1000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc0b3d20 0x7f8dbc1f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.529+0000 7f8dc1000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dbc0c58e0 0x7f8dbc148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.529+0000 7f8dc1000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc0725d0 con 0x7f8dbc0b3d20 2024-05-14T09:41:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.529+0000 7f8dc1000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc154760 con 0x7f8dbc0c58e0 2024-05-14T09:41:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.529+0000 7f8dc1000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8dbc1f7350 con 0x7f8dbc06d100 2024-05-14T09:41:20.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.530+0000 7f8db9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc0b3d20 0x7f8dbc1f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:20.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.531+0000 7f8db9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc0b3d20 0x7f8dbc1f6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43258/0 (socket says 172.21.15.135:43258) 2024-05-14T09:41:20.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.531+0000 7f8db9400640 1 -- 172.21.15.135:0/1238833297 learned_addr learned my addr 172.21.15.135:0/1238833297 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:20.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.531+0000 7f8dba800640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dbc0c58e0 0x7f8dbc148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:20.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.531+0000 7f8db9e00640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8dbc06d100 0x7f8dbc15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.536+0000 7f8db9400640 1 -- 172.21.15.135:0/1238833297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8dbc06d100 msgr2=0x7f8dbc15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.536+0000 7f8db9400640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8dbc06d100 0x7f8dbc15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.536+0000 7f8db9400640 1 -- 172.21.15.135:0/1238833297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dbc0c58e0 msgr2=0x7f8dbc148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.536+0000 7f8db9400640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dbc0c58e0 0x7f8dbc148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.536+0000 7f8db9400640 1 -- 172.21.15.135:0/1238833297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc1f6e80 con 0x7f8dbc0b3d20 2024-05-14T09:41:20.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.539+0000 7f8db9400640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc0b3d20 0x7f8dbc1f6940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009960 tx=0x7f8da80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:20.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.546+0000 7f8db2000640 1 -- 172.21.15.135:0/1238833297 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8037040 con 0x7f8dbc0b3d20 2024-05-14T09:41:20.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.546+0000 7f8db2000640 1 -- 172.21.15.135:0/1238833297 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da8042070 con 0x7f8dbc0b3d20 2024-05-14T09:41:20.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.546+0000 7f8db2000640 1 -- 172.21.15.135:0/1238833297 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da80309b0 con 0x7f8dbc0b3d20 2024-05-14T09:41:20.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.546+0000 7f8dc1000640 1 -- 172.21.15.135:0/1238833297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dbc1f30a0 con 0x7f8dbc0b3d20 2024-05-14T09:41:20.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.546+0000 7f8dc1000640 1 -- 172.21.15.135:0/1238833297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dbc1f3640 con 0x7f8dbc0b3d20 2024-05-14T09:41:20.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.547+0000 7f8dc1000640 1 -- 172.21.15.135:0/1238833297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dbc0c6b10 con 0x7f8dbc0b3d20 2024-05-14T09:41:20.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.584+0000 7f8db2000640 1 -- 172.21.15.135:0/1238833297 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8da8030b50 con 0x7f8dbc0b3d20 2024-05-14T09:41:20.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.585+0000 7f8db2000640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8d9c076350 0x7f8d9c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:20.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.586+0000 7f8db9e00640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8d9c076350 0x7f8d9c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:20.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.588+0000 7f8db9e00640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8d9c076350 0x7f8d9c078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009aa0 tx=0x7f8dac009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:20.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.594+0000 7f8db2000640 1 -- 172.21.15.135:0/1238833297 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f8da807dd90 con 0x7f8dbc0b3d20 2024-05-14T09:41:20.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:20.940+0000 7f8db2000640 1 -- 172.21.15.135:0/1238833297 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8dbc0c6b10 con 0x7f8dbc0b3d20 2024-05-14T09:41:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.160+0000 7f8dc1000640 1 -- 172.21.15.135:0/1238833297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8dbc076290 con 0x7f8dbc0b3d20 2024-05-14T09:41:21.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.321+0000 7f8db2000640 1 -- 172.21.15.135:0/1238833297 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+18997 (secure 0 0 0) 0x7f8da8081b00 con 0x7f8dbc0b3d20 2024-05-14T09:41:21.322 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:21.322 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":33,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:41:04.087625+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:40:40.770106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:40:43.375791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:40:51.210089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.325+0000 7f8dc1000640 1 -- 172.21.15.135:0/1238833297 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8d9c076350 msgr2=0x7f8d9c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.325+0000 7f8dc1000640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8d9c076350 0x7f8d9c078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009aa0 tx=0x7f8dac009190 comp rx=0 tx=0).stop 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.325+0000 7f8dc1000640 1 -- 172.21.15.135:0/1238833297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc0b3d20 msgr2=0x7f8dbc1f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.325+0000 7f8dc1000640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc0b3d20 0x7f8dbc1f6940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009960 tx=0x7f8da80046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.325+0000 7f8dc1000640 1 -- 172.21.15.135:0/1238833297 shutdown_connections 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.325+0000 7f8dc1000640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8d9c076350 0x7f8d9c078860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.325+0000 7f8dc1000640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8dbc0c58e0 0x7f8dbc148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.325+0000 7f8dc1000640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc0b3d20 0x7f8dbc1f6940 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.325+0000 7f8dc1000640 1 --2- 172.21.15.135:0/1238833297 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8dbc06d100 0x7f8dbc15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.325+0000 7f8dc1000640 1 -- 172.21.15.135:0/1238833297 >> 172.21.15.135:0/1238833297 conn(0x7f8dbc071ab0 msgr2=0x7f8dbc0c9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.325+0000 7f8dc1000640 1 -- 172.21.15.135:0/1238833297 shutdown_connections 2024-05-14T09:41:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.326+0000 7f8dc1000640 1 -- 172.21.15.135:0/1238833297 wait complete. 2024-05-14T09:41:21.357 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-14T09:41:21.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.629+0000 7fc11aa00640 1 Processor -- start 2024-05-14T09:41:21.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.630+0000 7fc11aa00640 1 -- start start 2024-05-14T09:41:21.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.631+0000 7fc11aa00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1140c7c40 0x7fc11406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:21.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.631+0000 7fc11aa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc1141567b0 0x7fc11415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:21.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.631+0000 7fc11aa00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc11415d320 con 0x7fc11415c900 2024-05-14T09:41:21.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.631+0000 7fc11aa00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc11415cde0 con 0x7fc1140c7c40 2024-05-14T09:41:21.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.631+0000 7fc11aa00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc11415d080 con 0x7fc1141567b0 2024-05-14T09:41:21.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.634+0000 7fc113e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1140c7c40 0x7fc11406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.634+0000 7fc113e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1140c7c40 0x7fc11406c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43264/0 (socket says 172.21.15.135:43264) 2024-05-14T09:41:21.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.634+0000 7fc113e00640 1 -- 172.21.15.135:0/3635259713 learned_addr learned my addr 172.21.15.135:0/3635259713 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.648+0000 7fc113400640 1 --2- 172.21.15.135:0/3635259713 >> v2:172.21.15.196:3300/0 conn(0x7fc1141567b0 0x7fc11415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:21.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.711+0000 7fc113e00640 1 -- 172.21.15.135:0/3635259713 >> v2:172.21.15.196:3300/0 conn(0x7fc1141567b0 msgr2=0x7fc11415c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:21.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.711+0000 7fc113e00640 1 --2- 172.21.15.135:0/3635259713 >> v2:172.21.15.196:3300/0 conn(0x7fc1141567b0 0x7fc11415c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:21.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.711+0000 7fc113e00640 1 -- 172.21.15.135:0/3635259713 >> v1:172.21.15.196:6789/0 conn(0x7fc11415c900 legacy=0x7fc1140cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:21.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.711+0000 7fc113e00640 1 -- 172.21.15.135:0/3635259713 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1140c7160 con 0x7fc1140c7c40 2024-05-14T09:41:21.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.724+0000 7fc113e00640 1 --2- 172.21.15.135:0/3635259713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1140c7c40 0x7fc11406c6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1140ced70 tx=0x7fc10402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c3e21885549ee2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:21.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.738+0000 7fc112a00640 1 -- 172.21.15.135:0/3635259713 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc104036070 con 0x7fc1140c7c40 2024-05-14T09:41:21.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.738+0000 7fc112a00640 1 -- 172.21.15.135:0/3635259713 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc104031600 con 0x7fc1140c7c40 2024-05-14T09:41:21.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.738+0000 7fc112a00640 1 -- 172.21.15.135:0/3635259713 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1040319d0 con 0x7fc1140c7c40 2024-05-14T09:41:21.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.740+0000 7fc11aa00640 1 -- 172.21.15.135:0/3635259713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1140c7c40 msgr2=0x7fc11406c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:21.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.740+0000 7fc11aa00640 1 --2- 172.21.15.135:0/3635259713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1140c7c40 0x7fc11406c6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1140ced70 tx=0x7fc10402a6a0 comp rx=0 tx=0).stop 2024-05-14T09:41:21.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.740+0000 7fc11aa00640 1 -- 172.21.15.135:0/3635259713 shutdown_connections 2024-05-14T09:41:21.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.740+0000 7fc11aa00640 1 --2- 172.21.15.135:0/3635259713 >> v2:172.21.15.196:3300/0 conn(0x7fc1141567b0 0x7fc11415c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:21.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.740+0000 7fc11aa00640 1 --2- 172.21.15.135:0/3635259713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1140c7c40 0x7fc11406c6f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:21.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.740+0000 7fc11aa00640 1 -- 172.21.15.135:0/3635259713 >> 172.21.15.135:0/3635259713 conn(0x7fc1140d2260 msgr2=0x7fc1140ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:21.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.740+0000 7fc11aa00640 1 -- 172.21.15.135:0/3635259713 shutdown_connections 2024-05-14T09:41:21.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.740+0000 7fc11aa00640 1 -- 172.21.15.135:0/3635259713 wait complete. 2024-05-14T09:41:21.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.745+0000 7fc11aa00640 1 Processor -- start 2024-05-14T09:41:21.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.745+0000 7fc11aa00640 1 -- start start 2024-05-14T09:41:21.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.748+0000 7fc11aa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1140c7c40 0x7fc1141f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:21.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.748+0000 7fc11aa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1141567b0 0x7fc1141f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:21.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.748+0000 7fc11aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc11415c900 0x7fc1140cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:21.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.748+0000 7fc11aa00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1140b4f30 con 0x7fc11415c900 2024-05-14T09:41:21.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.748+0000 7fc11aa00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc1140c7720 con 0x7fc1140c7c40 2024-05-14T09:41:21.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.748+0000 7fc11aa00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc1140ccba0 con 0x7fc1141567b0 2024-05-14T09:41:21.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.749+0000 7fc118a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc11415c900 0x7fc1140cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:21.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.749+0000 7fc118a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc11415c900 0x7fc1140cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43280/0 (socket says 172.21.15.135:43280) 2024-05-14T09:41:21.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.749+0000 7fc118a00640 1 -- 172.21.15.135:0/4073635040 learned_addr learned my addr 172.21.15.135:0/4073635040 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:21.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.753+0000 7fc113400640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1141567b0 0x7fc1141f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.754+0000 7fc118a00640 1 -- 172.21.15.135:0/4073635040 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1141567b0 msgr2=0x7fc1141f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.754+0000 7fc118a00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1141567b0 0x7fc1141f69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.754+0000 7fc118a00640 1 -- 172.21.15.135:0/4073635040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1140c7c40 msgr2=0x7fc1141f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:21.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.754+0000 7fc118a00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1140c7c40 0x7fc1141f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:21.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.754+0000 7fc118a00640 1 -- 172.21.15.135:0/4073635040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc114157c90 con 0x7fc11415c900 2024-05-14T09:41:21.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.758+0000 7fc118a00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc11415c900 0x7fc1140cae10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00b3e0 tx=0x7fc10c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:21.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.764+0000 7fc10be00640 1 -- 172.21.15.135:0/4073635040 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c015030 con 0x7fc11415c900 2024-05-14T09:41:21.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.765+0000 7fc10be00640 1 -- 172.21.15.135:0/4073635040 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10c004020 con 0x7fc11415c900 2024-05-14T09:41:21.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.765+0000 7fc10be00640 1 -- 172.21.15.135:0/4073635040 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c004430 con 0x7fc11415c900 2024-05-14T09:41:21.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.765+0000 7fc11aa00640 1 -- 172.21.15.135:0/4073635040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1141e6b70 con 0x7fc11415c900 2024-05-14T09:41:21.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.765+0000 7fc11aa00640 1 -- 172.21.15.135:0/4073635040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1141f61b0 con 0x7fc11415c900 2024-05-14T09:41:21.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.766+0000 7fc11aa00640 1 -- 172.21.15.135:0/4073635040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1140ceac0 con 0x7fc11415c900 2024-05-14T09:41:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.802+0000 7fc10be00640 1 -- 172.21.15.135:0/4073635040 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc10c018070 con 0x7fc11415c900 2024-05-14T09:41:21.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.803+0000 7fc10be00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc0f4076350 0x7fc0f4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.804+0000 7fc113e00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc0f4076350 0x7fc0f4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.805+0000 7fc113e00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc0f4076350 0x7fc0f4078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc104033000 tx=0x7fc10402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:21.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:21.810+0000 7fc10be00640 1 -- 172.21.15.135:0/4073635040 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fc10c05cdd0 con 0x7fc11415c900 2024-05-14T09:41:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.204+0000 7fc10be00640 1 -- 172.21.15.135:0/4073635040 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc1140ceac0 con 0x7fc11415c900 2024-05-14T09:41:22.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.477+0000 7fc11aa00640 1 -- 172.21.15.135:0/4073635040 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc11415c450 con 0x7fc11415c900 2024-05-14T09:41:22.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.989+0000 7fc10be00640 1 -- 172.21.15.135:0/4073635040 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fc10c061240 con 0x7fc11415c900 2024-05-14T09:41:22.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 -- 172.21.15.135:0/4073635040 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc0f4076350 msgr2=0x7fc0f4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:22.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc0f4076350 0x7fc0f4078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc104033000 tx=0x7fc10402e000 comp rx=0 tx=0).stop 2024-05-14T09:41:22.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 -- 172.21.15.135:0/4073635040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc11415c900 msgr2=0x7fc1140cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:22.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc11415c900 0x7fc1140cae10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00b3e0 tx=0x7fc10c00b8a0 comp rx=0 tx=0).stop 2024-05-14T09:41:22.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 -- 172.21.15.135:0/4073635040 shutdown_connections 2024-05-14T09:41:22.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc0f4076350 0x7fc0f4078860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:22.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc11415c900 0x7fc1140cae10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:22.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1141567b0 0x7fc1141f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:22.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 --2- 172.21.15.135:0/4073635040 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1140c7c40 0x7fc1141f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:22.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 -- 172.21.15.135:0/4073635040 >> 172.21.15.135:0/4073635040 conn(0x7fc1140d2260 msgr2=0x7fc114154be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:22.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 -- 172.21.15.135:0/4073635040 shutdown_connections 2024-05-14T09:41:22.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:22.992+0000 7fc11aa00640 1 -- 172.21.15.135:0/4073635040 wait complete. 2024-05-14T09:41:23.028 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-05-14T09:41:23.028 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-05-14T09:41:23.077 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:41:23.081 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:41:23.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.293+0000 7fe39b000640 1 Processor -- start 2024-05-14T09:41:23.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.293+0000 7fe39b000640 1 -- start start 2024-05-14T09:41:23.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.296+0000 7fe39b000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe3941530b0 0x7fe3940c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:23.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.296+0000 7fe39b000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe39406e030 con 0x7fe3941599b0 2024-05-14T09:41:23.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.296+0000 7fe39b000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3940c4b20 con 0x7fe3940c63e0 2024-05-14T09:41:23.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.296+0000 7fe39b000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe3940c4e00 con 0x7fe3941530b0 2024-05-14T09:41:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.298+0000 7fe399c00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe3941599b0 0x7fe39406d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:53114/0 (socket says 172.21.15.135:53114) 2024-05-14T09:41:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.298+0000 7fe399c00640 1 -- 172.21.15.135:0/1035911779 learned_addr learned my addr 172.21.15.135:0/1035911779 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:23.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.298+0000 7fe399200640 1 --2- 172.21.15.135:0/1035911779 >> v2:172.21.15.196:3300/0 conn(0x7fe3941530b0 0x7fe3940c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:23.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.301+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772723487 0 0) 0x7fe39406e030 con 0x7fe3941599b0 2024-05-14T09:41:23.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.301+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe37c005730 con 0x7fe3941599b0 2024-05-14T09:41:23.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.305+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2657132653 0 0) 0x7fe37c005730 con 0x7fe3941599b0 2024-05-14T09:41:23.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.305+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 >> v2:172.21.15.196:3300/0 conn(0x7fe3941530b0 msgr2=0x7fe3940c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:23.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.305+0000 7fe393e00640 1 --2- 172.21.15.135:0/1035911779 >> v2:172.21.15.196:3300/0 conn(0x7fe3941530b0 0x7fe3940c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:23.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.305+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 >> v1:172.21.15.196:6789/0 conn(0x7fe3940c63e0 legacy=0x7fe394071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:23.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.305+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3940c50e0 con 0x7fe3941599b0 2024-05-14T09:41:23.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.306+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7fe3880016f0 con 0x7fe3941599b0 2024-05-14T09:41:23.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.306+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 >> v1:172.21.15.135:6789/0 conn(0x7fe3941599b0 legacy=0x7fe39406d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:23.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.306+0000 7fe393e00640 1 --2- 172.21.15.135:0/1035911779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe37c005cb0 0x7fe37c006120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:23.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.306+0000 7fe393e00640 1 --2- 172.21.15.135:0/1035911779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe37c006a10 0x7fe37c006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:23.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.306+0000 7fe393e00640 1 --2- 172.21.15.135:0/1035911779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe37c0074b0 0x7fe37c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:23.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.306+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3940c4e00 con 0x7fe37c005cb0 2024-05-14T09:41:23.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.306+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c00e440 con 0x7fe37c0074b0 2024-05-14T09:41:23.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.306+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe37c00e640 con 0x7fe37c006a10 2024-05-14T09:41:23.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.308+0000 7fe399200640 1 --2- 172.21.15.135:0/1035911779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe37c006a10 0x7fe37c006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:23.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.309+0000 7fe399c00640 1 --2- 172.21.15.135:0/1035911779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe37c005cb0 0x7fe37c006120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:23.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.313+0000 7fe399c00640 1 -- 172.21.15.135:0/1035911779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe37c006a10 msgr2=0x7fe37c006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:23.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.313+0000 7fe399c00640 1 --2- 172.21.15.135:0/1035911779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe37c006a10 0x7fe37c006e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:23.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.313+0000 7fe399c00640 1 -- 172.21.15.135:0/1035911779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe37c0074b0 msgr2=0x7fe37c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:23.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.313+0000 7fe399c00640 1 --2- 172.21.15.135:0/1035911779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe37c0074b0 0x7fe37c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:23.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.313+0000 7fe399c00640 1 -- 172.21.15.135:0/1035911779 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c005730 con 0x7fe37c005cb0 2024-05-14T09:41:23.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.313+0000 7fe39a600640 1 -- 172.21.15.135:0/1035911779 reap_dead start 2024-05-14T09:41:23.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.317+0000 7fe399c00640 1 --2- 172.21.15.135:0/1035911779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe37c005cb0 0x7fe37c006120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe38800c210 tx=0x7fe37c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63435bd429afde6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:23.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.322+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388007ce0 con 0x7fe37c005cb0 2024-05-14T09:41:23.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.322+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe388005af0 con 0x7fe37c005cb0 2024-05-14T09:41:23.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.322+0000 7fe393e00640 1 -- 172.21.15.135:0/1035911779 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388007070 con 0x7fe37c005cb0 2024-05-14T09:41:23.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.323+0000 7fe39b000640 1 -- 172.21.15.135:0/1035911779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe37c005cb0 msgr2=0x7fe37c006120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:23.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.323+0000 7fe39b000640 1 --2- 172.21.15.135:0/1035911779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe37c005cb0 0x7fe37c006120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe38800c210 tx=0x7fe37c007a40 comp rx=0 tx=0).stop 2024-05-14T09:41:23.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.323+0000 7fe39b000640 1 -- 172.21.15.135:0/1035911779 shutdown_connections 2024-05-14T09:41:23.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.323+0000 7fe39b000640 1 --2- 172.21.15.135:0/1035911779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe37c005cb0 0x7fe37c006120 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:23.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.323+0000 7fe39b000640 1 -- 172.21.15.135:0/1035911779 >> 172.21.15.135:0/1035911779 conn(0x7fe3940ce090 msgr2=0x7fe3940c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:23.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.323+0000 7fe39b000640 1 -- 172.21.15.135:0/1035911779 shutdown_connections 2024-05-14T09:41:23.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.323+0000 7fe39b000640 1 -- 172.21.15.135:0/1035911779 wait complete. 2024-05-14T09:41:23.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.326+0000 7fe39b000640 1 Processor -- start 2024-05-14T09:41:23.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.326+0000 7fe39b000640 1 -- start start 2024-05-14T09:41:23.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.327+0000 7fe39b000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe37c005cb0 0x7fe39406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:23.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.327+0000 7fe39b000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3940cb920 0x7fe3941f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:23.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.327+0000 7fe39b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe39414b5b0 0x7fe39414c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:23.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.327+0000 7fe39b000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3940c5980 con 0x7fe3940cb920 2024-05-14T09:41:23.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.327+0000 7fe39b000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe3940c56a0 con 0x7fe37c005cb0 2024-05-14T09:41:23.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.327+0000 7fe39b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe394159dc0 con 0x7fe39414b5b0 2024-05-14T09:41:23.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.329+0000 7fe399200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3940cb920 0x7fe3941f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:23.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.330+0000 7fe399200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3940cb920 0x7fe3941f1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43294/0 (socket says 172.21.15.135:43294) 2024-05-14T09:41:23.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.330+0000 7fe399200640 1 -- 172.21.15.135:0/2631239807 learned_addr learned my addr 172.21.15.135:0/2631239807 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:23.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.330+0000 7fe39a600640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe39414b5b0 0x7fe39414c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:23.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.330+0000 7fe399c00640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe37c005cb0 0x7fe39406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:23.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.334+0000 7fe399200640 1 -- 172.21.15.135:0/2631239807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe39414b5b0 msgr2=0x7fe39414c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:23.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.334+0000 7fe399200640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe39414b5b0 0x7fe39414c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:23.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.334+0000 7fe399200640 1 -- 172.21.15.135:0/2631239807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe37c005cb0 msgr2=0x7fe39406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:23.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.334+0000 7fe399200640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe37c005cb0 0x7fe39406c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:23.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.334+0000 7fe399200640 1 -- 172.21.15.135:0/2631239807 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39406cc30 con 0x7fe3940cb920 2024-05-14T09:41:23.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.337+0000 7fe399200640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3940cb920 0x7fe3941f1c90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe380011990 tx=0x7fe380011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:23.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.344+0000 7fe391600640 1 -- 172.21.15.135:0/2631239807 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38000fad0 con 0x7fe3940cb920 2024-05-14T09:41:23.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.344+0000 7fe391600640 1 -- 172.21.15.135:0/2631239807 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38000fc70 con 0x7fe3940cb920 2024-05-14T09:41:23.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.344+0000 7fe391600640 1 -- 172.21.15.135:0/2631239807 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe380014440 con 0x7fe3940cb920 2024-05-14T09:41:23.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.345+0000 7fe39b000640 1 -- 172.21.15.135:0/2631239807 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3941f21d0 con 0x7fe3940cb920 2024-05-14T09:41:23.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.345+0000 7fe39b000640 1 -- 172.21.15.135:0/2631239807 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3940cb410 con 0x7fe3940cb920 2024-05-14T09:41:23.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.346+0000 7fe39b000640 1 -- 172.21.15.135:0/2631239807 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe39406cf10 con 0x7fe3940cb920 2024-05-14T09:41:23.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.380+0000 7fe391600640 1 -- 172.21.15.135:0/2631239807 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe380012040 con 0x7fe3940cb920 2024-05-14T09:41:23.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.382+0000 7fe391600640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe374076350 0x7fe374078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:23.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.382+0000 7fe399c00640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe374076350 0x7fe374078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:23.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.383+0000 7fe399c00640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe374076350 0x7fe374078860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe388032000 tx=0x7fe388009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:23.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.385+0000 7fe391600640 1 -- 172.21.15.135:0/2631239807 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fe38005d5f0 con 0x7fe3940cb920 2024-05-14T09:41:23.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.732+0000 7fe391600640 1 -- 172.21.15.135:0/2631239807 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe38002b080 con 0x7fe3940cb920 2024-05-14T09:41:23.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:23.976+0000 7fe39b000640 1 -- 172.21.15.135:0/2631239807 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fe3941534c0 con 0x7fe3940cb920 2024-05-14T09:41:25.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.454+0000 7fe391600640 1 -- 172.21.15.135:0/2631239807 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) ==== 105+0+0 (secure 0 0 0) 0x7fe3941534c0 con 0x7fe3940cb920 2024-05-14T09:41:25.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.459+0000 7fe39b000640 1 -- 172.21.15.135:0/2631239807 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe374076350 msgr2=0x7fe374078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:25.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.459+0000 7fe39b000640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe374076350 0x7fe374078860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe388032000 tx=0x7fe388009030 comp rx=0 tx=0).stop 2024-05-14T09:41:25.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.459+0000 7fe39b000640 1 -- 172.21.15.135:0/2631239807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3940cb920 msgr2=0x7fe3941f1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:25.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.459+0000 7fe39b000640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3940cb920 0x7fe3941f1c90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe380011990 tx=0x7fe380011e50 comp rx=0 tx=0).stop 2024-05-14T09:41:25.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.459+0000 7fe39b000640 1 -- 172.21.15.135:0/2631239807 shutdown_connections 2024-05-14T09:41:25.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.459+0000 7fe39b000640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe374076350 0x7fe374078860 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:25.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.459+0000 7fe39b000640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe39414b5b0 0x7fe39414c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:25.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.460+0000 7fe39b000640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3940cb920 0x7fe3941f1c90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:25.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.460+0000 7fe39b000640 1 --2- 172.21.15.135:0/2631239807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe37c005cb0 0x7fe39406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.460+0000 7fe39b000640 1 -- 172.21.15.135:0/2631239807 >> 172.21.15.135:0/2631239807 conn(0x7fe3940ce090 msgr2=0x7fe39406da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.460+0000 7fe39b000640 1 -- 172.21.15.135:0/2631239807 shutdown_connections 2024-05-14T09:41:25.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.460+0000 7fe39b000640 1 -- 172.21.15.135:0/2631239807 wait complete. 2024-05-14T09:41:25.511 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-14T09:41:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.827+0000 7f98f3000640 1 Processor -- start 2024-05-14T09:41:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.827+0000 7f98f3000640 1 -- start start 2024-05-14T09:41:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.829+0000 7f98f3000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f98ec1542d0 0x7f98ec0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.829+0000 7f98f3000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98ec0c70d0 0x7f98ec06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.829+0000 7f98f3000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f98ec06cdc0 0x7f98ec15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.829+0000 7f98f3000640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f98ec06d1d0 con 0x7f98ec1542d0 2024-05-14T09:41:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.829+0000 7f98f3000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f98ec0c9c20 con 0x7f98ec06cdc0 2024-05-14T09:41:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.829+0000 7f98f3000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec1546e0 con 0x7f98ec0c70d0 2024-05-14T09:41:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.830+0000 7f98f1c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f98ec1542d0 0x7f98ec0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.831+0000 7f98f1c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f98ec1542d0 0x7f98ec0c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55354/0 (socket says 172.21.15.135:55354) 2024-05-14T09:41:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.831+0000 7f98f1c00640 1 -- 172.21.15.135:0/1862786208 learned_addr learned my addr 172.21.15.135:0/1862786208 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:25.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.834+0000 7f98f1c00640 1 -- 172.21.15.135:0/1862786208 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98ec0c70d0 msgr2=0x7f98ec06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:25.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.834+0000 7f98f1c00640 1 --2- 172.21.15.135:0/1862786208 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98ec0c70d0 0x7f98ec06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:25.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.834+0000 7f98f1c00640 1 -- 172.21.15.135:0/1862786208 >> v2:172.21.15.196:3300/0 conn(0x7f98ec06cdc0 msgr2=0x7f98ec15d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:25.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.834+0000 7f98f1c00640 1 --2- 172.21.15.135:0/1862786208 >> v2:172.21.15.196:3300/0 conn(0x7f98ec06cdc0 0x7f98ec15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:25.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.834+0000 7f98f1c00640 1 -- 172.21.15.135:0/1862786208 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec0c8b80 con 0x7f98ec1542d0 2024-05-14T09:41:25.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.837+0000 7f98f1c00640 1 --2- 172.21.15.135:0/1862786208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec1542d0 0x7f98ec0c6b90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0b9da0 tx=0x7f98e002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725c90f2eceffccb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:25.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.841+0000 7f98ebe00640 1 -- 172.21.15.135:0/1862786208 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0037070 con 0x7f98ec1542d0 2024-05-14T09:41:25.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.841+0000 7f98ebe00640 1 -- 172.21.15.135:0/1862786208 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e0032440 con 0x7f98ec1542d0 2024-05-14T09:41:25.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.841+0000 7f98ebe00640 1 -- 172.21.15.135:0/1862786208 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e00327f0 con 0x7f98ec1542d0 2024-05-14T09:41:25.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.842+0000 7f98f3000640 1 -- 172.21.15.135:0/1862786208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec1542d0 msgr2=0x7f98ec0c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:25.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.842+0000 7f98f3000640 1 --2- 172.21.15.135:0/1862786208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec1542d0 0x7f98ec0c6b90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0b9da0 tx=0x7f98e002a290 comp rx=0 tx=0).stop 2024-05-14T09:41:25.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.842+0000 7f98f3000640 1 -- 172.21.15.135:0/1862786208 shutdown_connections 2024-05-14T09:41:25.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.842+0000 7f98f3000640 1 --2- 172.21.15.135:0/1862786208 >> v2:172.21.15.196:3300/0 conn(0x7f98ec06cdc0 0x7f98ec15d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:25.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.842+0000 7f98f3000640 1 --2- 172.21.15.135:0/1862786208 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98ec0c70d0 0x7f98ec06c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:25.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.842+0000 7f98f3000640 1 --2- 172.21.15.135:0/1862786208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec1542d0 0x7f98ec0c6b90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:25.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.842+0000 7f98f3000640 1 -- 172.21.15.135:0/1862786208 >> 172.21.15.135:0/1862786208 conn(0x7f98ec0ce090 msgr2=0x7f98ec0c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:25.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.842+0000 7f98f3000640 1 -- 172.21.15.135:0/1862786208 shutdown_connections 2024-05-14T09:41:25.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.842+0000 7f98f3000640 1 -- 172.21.15.135:0/1862786208 wait complete. 2024-05-14T09:41:25.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.844+0000 7f98f3000640 1 Processor -- start 2024-05-14T09:41:25.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.845+0000 7f98f3000640 1 -- start start 2024-05-14T09:41:25.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.846+0000 7f98f3000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec06cdc0 0x7f98ec150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:25.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.846+0000 7f98f3000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98ec0c70d0 0x7f98ec0c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:25.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.846+0000 7f98f3000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98ec1542d0 0x7f98ec15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:25.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.846+0000 7f98f3000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec0c9380 con 0x7f98ec06cdc0 2024-05-14T09:41:25.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.846+0000 7f98f3000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec0c90a0 con 0x7f98ec0c70d0 2024-05-14T09:41:25.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.846+0000 7f98f3000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec0c9660 con 0x7f98ec1542d0 2024-05-14T09:41:25.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.847+0000 7f98f1c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec06cdc0 0x7f98ec150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:25.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.847+0000 7f98f1c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec06cdc0 0x7f98ec150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55362/0 (socket says 172.21.15.135:55362) 2024-05-14T09:41:25.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.847+0000 7f98f1c00640 1 -- 172.21.15.135:0/1002679685 learned_addr learned my addr 172.21.15.135:0/1002679685 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.852+0000 7f98f1c00640 1 -- 172.21.15.135:0/1002679685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98ec1542d0 msgr2=0x7f98ec15b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.852+0000 7f98f1c00640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98ec1542d0 0x7f98ec15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.852+0000 7f98f1c00640 1 -- 172.21.15.135:0/1002679685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98ec0c70d0 msgr2=0x7f98ec0c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.852+0000 7f98f1c00640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98ec0c70d0 0x7f98ec0c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.852+0000 7f98f1c00640 1 -- 172.21.15.135:0/1002679685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec0cce20 con 0x7f98ec06cdc0 2024-05-14T09:41:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.855+0000 7f98f1c00640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec06cdc0 0x7f98ec150620 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009960 tx=0x7f98e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:25.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.860+0000 7f98e9600640 1 -- 172.21.15.135:0/1002679685 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0041070 con 0x7f98ec06cdc0 2024-05-14T09:41:25.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.860+0000 7f98e9600640 1 -- 172.21.15.135:0/1002679685 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e003c950 con 0x7f98ec06cdc0 2024-05-14T09:41:25.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.860+0000 7f98e9600640 1 -- 172.21.15.135:0/1002679685 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0037040 con 0x7f98ec06cdc0 2024-05-14T09:41:25.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.860+0000 7f98f3000640 1 -- 172.21.15.135:0/1002679685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ec150b60 con 0x7f98ec06cdc0 2024-05-14T09:41:25.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.860+0000 7f98f3000640 1 -- 172.21.15.135:0/1002679685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ec15cdc0 con 0x7f98ec06cdc0 2024-05-14T09:41:25.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:25.862+0000 7f98f3000640 1 -- 172.21.15.135:0/1002679685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98ec069980 con 0x7f98ec06cdc0 2024-05-14T09:41:26.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:26.188+0000 7f98e9600640 1 -- 172.21.15.135:0/1002679685 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f98e0044070 con 0x7f98ec06cdc0 2024-05-14T09:41:26.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:26.190+0000 7f98e9600640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f98cc076320 0x7f98cc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:26.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:26.191+0000 7f98f1200640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f98cc076320 0x7f98cc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:26.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:26.192+0000 7f98f1200640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f98cc076320 0x7f98cc078830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f98ec15aff0 tx=0x7f98d8006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:26.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:26.216+0000 7f98e9600640 1 -- 172.21.15.135:0/1002679685 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f98e003cd40 con 0x7f98ec06cdc0 2024-05-14T09:41:26.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:26.217+0000 7f98e9600640 1 -- 172.21.15.135:0/1002679685 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f98e0082000 con 0x7f98ec06cdc0 2024-05-14T09:41:26.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:26.513+0000 7f98f3000640 1 -- 172.21.15.135:0/1002679685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f98ec0c4760 con 0x7f98ec06cdc0 2024-05-14T09:41:27.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.766+0000 7f98e9600640 1 -- 172.21.15.135:0/1002679685 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f98e0081900 con 0x7f98ec06cdc0 2024-05-14T09:41:27.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.770+0000 7f98f3000640 1 -- 172.21.15.135:0/1002679685 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f98cc076320 msgr2=0x7f98cc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:27.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.770+0000 7f98f3000640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f98cc076320 0x7f98cc078830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f98ec15aff0 tx=0x7f98d8006bf0 comp rx=0 tx=0).stop 2024-05-14T09:41:27.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.770+0000 7f98f3000640 1 -- 172.21.15.135:0/1002679685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec06cdc0 msgr2=0x7f98ec150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:27.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.770+0000 7f98f3000640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec06cdc0 0x7f98ec150620 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009960 tx=0x7f98e00046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:27.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.771+0000 7f98f3000640 1 -- 172.21.15.135:0/1002679685 shutdown_connections 2024-05-14T09:41:27.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.771+0000 7f98f3000640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f98cc076320 0x7f98cc078830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:27.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.771+0000 7f98f3000640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f98ec0c70d0 0x7f98ec0c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:27.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.771+0000 7f98f3000640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f98ec1542d0 0x7f98ec15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:27.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.771+0000 7f98f3000640 1 --2- 172.21.15.135:0/1002679685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98ec06cdc0 0x7f98ec150620 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:27.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.771+0000 7f98f3000640 1 -- 172.21.15.135:0/1002679685 >> 172.21.15.135:0/1002679685 conn(0x7f98ec0ce090 msgr2=0x7f98ec06d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:27.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.771+0000 7f98f3000640 1 -- 172.21.15.135:0/1002679685 shutdown_connections 2024-05-14T09:41:27.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:27.771+0000 7f98f3000640 1 -- 172.21.15.135:0/1002679685 wait complete. 2024-05-14T09:41:27.807 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-14T09:41:28.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.067+0000 7f10a6000640 1 Processor -- start 2024-05-14T09:41:28.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.068+0000 7f10a6000640 1 -- start start 2024-05-14T09:41:28.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.070+0000 7f10a6000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f10a00c6c00 0x7f10a0156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:28.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.070+0000 7f10a6000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f10a00cd940 0x7f10a015c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:28.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.070+0000 7f10a6000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a006c940 con 0x7f10a00c65b0 2024-05-14T09:41:28.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.070+0000 7f10a6000640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f10a006c6f0 con 0x7f10a00cd940 2024-05-14T09:41:28.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.070+0000 7f10a6000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f10a006cc20 con 0x7f10a00c6c00 2024-05-14T09:41:28.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.071+0000 7f10a4c00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f10a00c65b0 0x7f10a006d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:48430/0 (socket says 172.21.15.135:48430) 2024-05-14T09:41:28.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.071+0000 7f10a4c00640 1 -- 172.21.15.135:0/1435326224 learned_addr learned my addr 172.21.15.135:0/1435326224 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:28.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.072+0000 7f109fe00640 1 --2- 172.21.15.135:0/1435326224 >> v2:172.21.15.196:3300/0 conn(0x7f10a00c6c00 0x7f10a0156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:28.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.072+0000 7f10a5600640 1 --2- 172.21.15.135:0/1435326224 >> v2:172.21.15.135:3300/0 conn(0x7f10a00cd940 0x7f10a015c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:28.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.076+0000 7f109f400640 1 -- 172.21.15.135:0/1435326224 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1916619281 0 0) 0x7f10a006c940 con 0x7f10a00c65b0 2024-05-14T09:41:28.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.076+0000 7f109f400640 1 -- 172.21.15.135:0/1435326224 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1080003520 con 0x7f10a00c65b0 2024-05-14T09:41:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.079+0000 7f10a5600640 1 -- 172.21.15.135:0/1435326224 >> v2:172.21.15.196:3300/0 conn(0x7f10a00c6c00 msgr2=0x7f10a0156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.079+0000 7f10a5600640 1 --2- 172.21.15.135:0/1435326224 >> v2:172.21.15.196:3300/0 conn(0x7f10a00c6c00 0x7f10a0156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.079+0000 7f10a5600640 1 -- 172.21.15.135:0/1435326224 >> v1:172.21.15.135:6789/0 conn(0x7f10a00c65b0 legacy=0x7f10a006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:28.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.079+0000 7f10a5600640 1 -- 172.21.15.135:0/1435326224 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a006cf00 con 0x7f10a00cd940 2024-05-14T09:41:28.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.086+0000 7f10a5600640 1 --2- 172.21.15.135:0/1435326224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00cd940 0x7f10a015c250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10a00d2760 tx=0x7f109802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7144a6c55f310205 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:28.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.091+0000 7f109f400640 1 -- 172.21.15.135:0/1435326224 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098037070 con 0x7f10a00cd940 2024-05-14T09:41:28.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.091+0000 7f109f400640 1 -- 172.21.15.135:0/1435326224 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098032440 con 0x7f10a00cd940 2024-05-14T09:41:28.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.091+0000 7f109f400640 1 -- 172.21.15.135:0/1435326224 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098032810 con 0x7f10a00cd940 2024-05-14T09:41:28.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.092+0000 7f10a6000640 1 -- 172.21.15.135:0/1435326224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00cd940 msgr2=0x7f10a015c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:28.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.092+0000 7f10a6000640 1 --2- 172.21.15.135:0/1435326224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00cd940 0x7f10a015c250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10a00d2760 tx=0x7f109802a1a0 comp rx=0 tx=0).stop 2024-05-14T09:41:28.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.092+0000 7f10a6000640 1 -- 172.21.15.135:0/1435326224 shutdown_connections 2024-05-14T09:41:28.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.092+0000 7f10a6000640 1 --2- 172.21.15.135:0/1435326224 >> v2:172.21.15.196:3300/0 conn(0x7f10a00c6c00 0x7f10a0156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:28.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.092+0000 7f10a6000640 1 --2- 172.21.15.135:0/1435326224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00cd940 0x7f10a015c250 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:28.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.092+0000 7f10a6000640 1 -- 172.21.15.135:0/1435326224 >> 172.21.15.135:0/1435326224 conn(0x7f10a008e180 msgr2=0x7f10a00d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:28.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.092+0000 7f10a6000640 1 -- 172.21.15.135:0/1435326224 shutdown_connections 2024-05-14T09:41:28.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.092+0000 7f10a6000640 1 -- 172.21.15.135:0/1435326224 wait complete. 2024-05-14T09:41:28.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.094+0000 7f10a6000640 1 Processor -- start 2024-05-14T09:41:28.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.095+0000 7f10a6000640 1 -- start start 2024-05-14T09:41:28.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.096+0000 7f10a6000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10a00c65b0 0x7f10a014eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:28.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.096+0000 7f10a6000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10a00c6c00 0x7f10a01f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:28.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.096+0000 7f10a6000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00cd940 0x7f10a01e9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:28.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.096+0000 7f10a6000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10a015c790 con 0x7f10a00cd940 2024-05-14T09:41:28.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.096+0000 7f10a6000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f10a006d4c0 con 0x7f10a00c6c00 2024-05-14T09:41:28.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.096+0000 7f10a6000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f10a015c910 con 0x7f10a00c65b0 2024-05-14T09:41:28.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.097+0000 7f10a5600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00cd940 0x7f10a01e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:28.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.098+0000 7f10a5600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00cd940 0x7f10a01e9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55384/0 (socket says 172.21.15.135:55384) 2024-05-14T09:41:28.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.098+0000 7f10a5600640 1 -- 172.21.15.135:0/300760531 learned_addr learned my addr 172.21.15.135:0/300760531 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:28.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.098+0000 7f109fe00640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10a00c6c00 0x7f10a01f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:28.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.099+0000 7f10a4c00640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10a00c65b0 0x7f10a014eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.102+0000 7f10a5600640 1 -- 172.21.15.135:0/300760531 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10a00c65b0 msgr2=0x7f10a014eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.102+0000 7f10a5600640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10a00c65b0 0x7f10a014eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.102+0000 7f10a5600640 1 -- 172.21.15.135:0/300760531 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10a00c6c00 msgr2=0x7f10a01f2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:28.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.102+0000 7f10a5600640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10a00c6c00 0x7f10a01f2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:28.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.102+0000 7f10a5600640 1 -- 172.21.15.135:0/300760531 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a01f3530 con 0x7f10a00cd940 2024-05-14T09:41:28.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.105+0000 7f10a5600640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00cd940 0x7f10a01e9120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1098009860 tx=0x7f10980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:28.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.109+0000 7f109cc00640 1 -- 172.21.15.135:0/300760531 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098042020 con 0x7f10a00cd940 2024-05-14T09:41:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.109+0000 7f109cc00640 1 -- 172.21.15.135:0/300760531 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098038040 con 0x7f10a00cd940 2024-05-14T09:41:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.109+0000 7f109cc00640 1 -- 172.21.15.135:0/300760531 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098037050 con 0x7f10a00cd940 2024-05-14T09:41:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.109+0000 7f10a6000640 1 -- 172.21.15.135:0/300760531 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a014e790 con 0x7f10a00cd940 2024-05-14T09:41:28.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.110+0000 7f10a6000640 1 -- 172.21.15.135:0/300760531 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a01f27f0 con 0x7f10a00cd940 2024-05-14T09:41:28.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.111+0000 7f10a6000640 1 -- 172.21.15.135:0/300760531 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a00c69f0 con 0x7f10a00cd940 2024-05-14T09:41:28.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.428+0000 7f109cc00640 1 -- 172.21.15.135:0/300760531 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f109803cb70 con 0x7f10a00cd940 2024-05-14T09:41:28.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.429+0000 7f109cc00640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f107c076320 0x7f107c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:28.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.429+0000 7f10a4c00640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f107c076320 0x7f107c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:28.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.431+0000 7f10a4c00640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f107c076320 0x7f107c078830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1090005880 tx=0x7f1090006aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:28.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.466+0000 7f109cc00640 1 -- 172.21.15.135:0/300760531 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f109803ce60 con 0x7f10a00cd940 2024-05-14T09:41:28.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.467+0000 7f109cc00640 1 -- 172.21.15.135:0/300760531 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f10a00c69f0 con 0x7f10a00cd940 2024-05-14T09:41:28.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:28.731+0000 7f10a6000640 1 -- 172.21.15.135:0/300760531 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f10a0154230 con 0x7f10a00cd940 2024-05-14T09:41:29.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.247+0000 7f109cc00640 1 -- 172.21.15.135:0/300760531 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v13) ==== 115+0+0 (secure 0 0 0) 0x7f10a0154230 con 0x7f10a00cd940 2024-05-14T09:41:29.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.249+0000 7f10a6000640 1 -- 172.21.15.135:0/300760531 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f107c076320 msgr2=0x7f107c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:29.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.249+0000 7f10a6000640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f107c076320 0x7f107c078830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1090005880 tx=0x7f1090006aa0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.250+0000 7f10a6000640 1 -- 172.21.15.135:0/300760531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00cd940 msgr2=0x7f10a01e9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:29.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.250+0000 7f10a6000640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00cd940 0x7f10a01e9120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1098009860 tx=0x7f10980046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.250+0000 7f10a6000640 1 -- 172.21.15.135:0/300760531 shutdown_connections 2024-05-14T09:41:29.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.250+0000 7f10a6000640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f107c076320 0x7f107c078830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.250+0000 7f10a6000640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10a00c6c00 0x7f10a01f2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.250+0000 7f10a6000640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10a00cd940 0x7f10a01e9120 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.250+0000 7f10a6000640 1 --2- 172.21.15.135:0/300760531 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10a00c65b0 0x7f10a014eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.250+0000 7f10a6000640 1 -- 172.21.15.135:0/300760531 >> 172.21.15.135:0/300760531 conn(0x7f10a008e180 msgr2=0x7f10a00b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:29.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.250+0000 7f10a6000640 1 -- 172.21.15.135:0/300760531 shutdown_connections 2024-05-14T09:41:29.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.250+0000 7f10a6000640 1 -- 172.21.15.135:0/300760531 wait complete. 2024-05-14T09:41:29.277 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-14T09:41:29.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T09:41:29.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.539+0000 7fbbc6a00640 1 Processor -- start 2024-05-14T09:41:29.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.539+0000 7fbbc6a00640 1 -- start start 2024-05-14T09:41:29.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.541+0000 7fbbc6a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbbc015f9f0 0x7fbbc00c3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:29.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.541+0000 7fbbc6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc006f5a0 0x7fbbc0166d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:29.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.541+0000 7fbbc6a00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc006d100 con 0x7fbbc01569c0 2024-05-14T09:41:29.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.541+0000 7fbbc6a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc006d3e0 con 0x7fbbc015f9f0 2024-05-14T09:41:29.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.541+0000 7fbbc6a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc006eda0 con 0x7fbbc006f5a0 2024-05-14T09:41:29.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.542+0000 7fbbbfe00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fbbc01569c0 0x7fbbc0070020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:48444/0 (socket says 172.21.15.135:48444) 2024-05-14T09:41:29.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.542+0000 7fbbbfe00640 1 -- 172.21.15.135:0/3369127558 learned_addr learned my addr 172.21.15.135:0/3369127558 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:29.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.543+0000 7fbbbf400640 1 --2- 172.21.15.135:0/3369127558 >> v2:172.21.15.196:3300/0 conn(0x7fbbc015f9f0 0x7fbbc00c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:29.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.543+0000 7fbbc4a00640 1 --2- 172.21.15.135:0/3369127558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc006f5a0 0x7fbbc0166d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:29.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.545+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981864218 0 0) 0x7fbbc006d100 con 0x7fbbc01569c0 2024-05-14T09:41:29.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.545+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbba4003520 con 0x7fbbc01569c0 2024-05-14T09:41:29.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1165472354 0 0) 0x7fbba4003520 con 0x7fbbc01569c0 2024-05-14T09:41:29.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc006f5a0 msgr2=0x7fbbc0166d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:29.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 --2- 172.21.15.135:0/3369127558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc006f5a0 0x7fbbc0166d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 >> v2:172.21.15.196:3300/0 conn(0x7fbbc015f9f0 msgr2=0x7fbbc00c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:29.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 --2- 172.21.15.135:0/3369127558 >> v2:172.21.15.196:3300/0 conn(0x7fbbc015f9f0 0x7fbbc00c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc006f9b0 con 0x7fbbc01569c0 2024-05-14T09:41:29.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7fbbb00016f0 con 0x7fbbc01569c0 2024-05-14T09:41:29.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 >> v1:172.21.15.135:6789/0 conn(0x7fbbc01569c0 legacy=0x7fbbc0070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:29.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 --2- 172.21.15.135:0/3369127558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbba4003a50 0x7fbba4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:29.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 --2- 172.21.15.135:0/3369127558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba4004800 0x7fbba4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:29.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 --2- 172.21.15.135:0/3369127558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc006f5a0 0x7fbba4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:29.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc006d3e0 con 0x7fbba4004800 2024-05-14T09:41:29.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc006eda0 con 0x7fbba4003a50 2024-05-14T09:41:29.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.550+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbba400bb20 con 0x7fbbc006f5a0 2024-05-14T09:41:29.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.553+0000 7fbbbf400640 1 --2- 172.21.15.135:0/3369127558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba4004800 0x7fbba4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.557+0000 7fbbbf400640 1 -- 172.21.15.135:0/3369127558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc006f5a0 msgr2=0x7fbba4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.557+0000 7fbbbf400640 1 --2- 172.21.15.135:0/3369127558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc006f5a0 0x7fbba4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.557+0000 7fbbbf400640 1 -- 172.21.15.135:0/3369127558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbba4003a50 msgr2=0x7fbba4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.557+0000 7fbbbf400640 1 --2- 172.21.15.135:0/3369127558 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbba4003a50 0x7fbba4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.557+0000 7fbbbf400640 1 -- 172.21.15.135:0/3369127558 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba4003520 con 0x7fbba4004800 2024-05-14T09:41:29.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.559+0000 7fbbbf400640 1 --2- 172.21.15.135:0/3369127558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba4004800 0x7fbba4004c10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009ac0 tx=0x7fbba4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5de451c8fbbe8b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.564+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac036070 con 0x7fbba4004800 2024-05-14T09:41:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.564+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbac031400 con 0x7fbba4004800 2024-05-14T09:41:29.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.564+0000 7fbbbea00640 1 -- 172.21.15.135:0/3369127558 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac009690 con 0x7fbba4004800 2024-05-14T09:41:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.565+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3369127558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba4004800 msgr2=0x7fbba4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.565+0000 7fbbc6a00640 1 --2- 172.21.15.135:0/3369127558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba4004800 0x7fbba4004c10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009ac0 tx=0x7fbba4005830 comp rx=0 tx=0).stop 2024-05-14T09:41:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.565+0000 7fbbc4a00640 1 -- 172.21.15.135:0/3369127558 reap_dead start 2024-05-14T09:41:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.565+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3369127558 shutdown_connections 2024-05-14T09:41:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.565+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3369127558 >> 172.21.15.135:0/3369127558 conn(0x7fbbc00ce590 msgr2=0x7fbbc00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.565+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3369127558 shutdown_connections 2024-05-14T09:41:29.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.565+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3369127558 wait complete. 2024-05-14T09:41:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.567+0000 7fbbc6a00640 1 Processor -- start 2024-05-14T09:41:29.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.568+0000 7fbbc6a00640 1 -- start start 2024-05-14T09:41:29.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.569+0000 7fbbc6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc015f330 0x7fbbc0157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:29.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.569+0000 7fbbc6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbc014c290 0x7fbbc015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:29.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.569+0000 7fbbc6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc015db00 0x7fbbc00c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:29.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.569+0000 7fbbc6a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc0070730 con 0x7fbbc015f330 2024-05-14T09:41:29.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.569+0000 7fbbc6a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc006d6c0 con 0x7fbbc014c290 2024-05-14T09:41:29.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.569+0000 7fbbc6a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc00708b0 con 0x7fbbc015db00 2024-05-14T09:41:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.570+0000 7fbbbfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc015f330 0x7fbbc0157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.570+0000 7fbbbfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc015f330 0x7fbbc0157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55406/0 (socket says 172.21.15.135:55406) 2024-05-14T09:41:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.570+0000 7fbbbfe00640 1 -- 172.21.15.135:0/3580063451 learned_addr learned my addr 172.21.15.135:0/3580063451 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.571+0000 7fbbbf400640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbc014c290 0x7fbbc015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.571+0000 7fbbc4a00640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc015db00 0x7fbbc00c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:29.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.575+0000 7fbbbfe00640 1 -- 172.21.15.135:0/3580063451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc015db00 msgr2=0x7fbbc00c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:29.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.575+0000 7fbbbfe00640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc015db00 0x7fbbc00c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.575+0000 7fbbbfe00640 1 -- 172.21.15.135:0/3580063451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbc014c290 msgr2=0x7fbbc015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:29.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.575+0000 7fbbbfe00640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbc014c290 0x7fbbc015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:29.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.575+0000 7fbbbfe00640 1 -- 172.21.15.135:0/3580063451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc01f6f20 con 0x7fbbc015f330 2024-05-14T09:41:29.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.578+0000 7fbbbfe00640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc015f330 0x7fbbc0157a80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000caa0 tx=0x7fbbb000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:29.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.582+0000 7fbbb7e00640 1 -- 172.21.15.135:0/3580063451 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0004cb0 con 0x7fbbc015f330 2024-05-14T09:41:29.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.582+0000 7fbbb7e00640 1 -- 172.21.15.135:0/3580063451 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb0007e30 con 0x7fbbc015f330 2024-05-14T09:41:29.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.582+0000 7fbbb7e00640 1 -- 172.21.15.135:0/3580063451 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0007330 con 0x7fbbc015f330 2024-05-14T09:41:29.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.582+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3580063451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc015a8f0 con 0x7fbbc015f330 2024-05-14T09:41:29.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.582+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3580063451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc01f6160 con 0x7fbbc015f330 2024-05-14T09:41:29.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.584+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3580063451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc00cd570 con 0x7fbbc015f330 2024-05-14T09:41:29.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.913+0000 7fbbb7e00640 1 -- 172.21.15.135:0/3580063451 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbbb0011070 con 0x7fbbc015f330 2024-05-14T09:41:29.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.914+0000 7fbbb7e00640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbba0076350 0x7fbba0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:29.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.915+0000 7fbbbf400640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbba0076350 0x7fbba0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:29.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.916+0000 7fbbbf400640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbba0076350 0x7fbba0078860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbbac033000 tx=0x7fbbac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:29.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.941+0000 7fbbb7e00640 1 -- 172.21.15.135:0/3580063451 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fbbb005cdc0 con 0x7fbbc015f330 2024-05-14T09:41:29.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:29.942+0000 7fbbb7e00640 1 -- 172.21.15.135:0/3580063451 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbbc00cd570 con 0x7fbbc015f330 2024-05-14T09:41:30.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.230+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3580063451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbc01565b0 con 0x7fbbc015f330 2024-05-14T09:41:30.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.245+0000 7fbbb7e00640 1 -- 172.21.15.135:0/3580063451 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6884 (secure 0 0 0) 0x7fbbc01565b0 con 0x7fbbc015f330 2024-05-14T09:41:30.245 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:30.245 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4032169993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4032169993},{"type":"v1","addr":"172.21.15.135:6837","nonce":4032169993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/1397919075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":1397919075},{"type":"v1","addr":"172.21.15.196:6833","nonce":1397919075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/4240420134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":4240420134},{"type":"v1","addr":"172.21.15.196:6835","nonce":4240420134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T09:40:45.555908+0000","modified":"2024-05-14T09:41:29.134436+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4255,"mds_1":4252,"mds_2":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"e","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.135:6835/3270089159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3270089159},{"type":"v1","addr":"172.21.15.135:6835","nonce":3270089159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4252":{"gid":4252,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":14,"addr":"172.21.15.135:6839/2302038485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2302038485},{"type":"v1","addr":"172.21.15.135:6839","nonce":2302038485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6837/3644723215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3644723215},{"type":"v1","addr":"172.21.15.196:6837","nonce":3644723215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4255,4252]},"id":1}]} 2024-05-14T09:41:30.245 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 13 2024-05-14T09:41:30.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3580063451 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbba0076350 msgr2=0x7fbba0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:30.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbba0076350 0x7fbba0078860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbbac033000 tx=0x7fbbac008030 comp rx=0 tx=0).stop 2024-05-14T09:41:30.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3580063451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc015f330 msgr2=0x7fbbc0157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:30.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc015f330 0x7fbbc0157a80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000caa0 tx=0x7fbbb000cea0 comp rx=0 tx=0).stop 2024-05-14T09:41:30.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3580063451 shutdown_connections 2024-05-14T09:41:30.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbba0076350 0x7fbba0078860 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:30.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbc014c290 0x7fbbc015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:30.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbbc015db00 0x7fbbc00c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:30.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 --2- 172.21.15.135:0/3580063451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbc015f330 0x7fbbc0157a80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:30.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3580063451 >> 172.21.15.135:0/3580063451 conn(0x7fbbc00ce590 msgr2=0x7fbbc01e5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:30.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3580063451 shutdown_connections 2024-05-14T09:41:30.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.249+0000 7fbbc6a00640 1 -- 172.21.15.135:0/3580063451 wait complete. 2024-05-14T09:41:30.275 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:41:30.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.522+0000 7f0b45800640 1 Processor -- start 2024-05-14T09:41:30.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.522+0000 7f0b45800640 1 -- start start 2024-05-14T09:41:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.525+0000 7f0b45800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b401530b0 0x7f0b4006da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.525+0000 7f0b45800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b400c8860 0x7f0b400c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.525+0000 7f0b45800640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4006dfb0 con 0x7f0b40158e70 2024-05-14T09:41:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.525+0000 7f0b45800640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0b400c83d0 con 0x7f0b401530b0 2024-05-14T09:41:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.525+0000 7f0b45800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0b400c91b0 con 0x7f0b400c8860 2024-05-14T09:41:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.526+0000 7f0b3fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b401530b0 0x7f0b4006da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:30.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.526+0000 7f0b3fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b401530b0 0x7f0b4006da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55410/0 (socket says 172.21.15.135:55410) 2024-05-14T09:41:30.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.526+0000 7f0b3fe00640 1 -- 172.21.15.135:0/175767639 learned_addr learned my addr 172.21.15.135:0/175767639 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:30.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.527+0000 7f0b44e00640 1 --2- 172.21.15.135:0/175767639 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b400c8860 0x7f0b400c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:30.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.530+0000 7f0b3fe00640 1 -- 172.21.15.135:0/175767639 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b400c8860 msgr2=0x7f0b400c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:30.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.530+0000 7f0b3fe00640 1 --2- 172.21.15.135:0/175767639 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b400c8860 0x7f0b400c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:30.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.530+0000 7f0b3fe00640 1 -- 172.21.15.135:0/175767639 >> v1:172.21.15.135:6789/0 conn(0x7f0b40158e70 legacy=0x7f0b400c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:30.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.530+0000 7f0b3fe00640 1 -- 172.21.15.135:0/175767639 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b40159720 con 0x7f0b401530b0 2024-05-14T09:41:30.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.536+0000 7f0b3fe00640 1 --2- 172.21.15.135:0/175767639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b401530b0 0x7f0b4006da70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000bb10 tx=0x7f0b3002c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d4a266de957512 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.542+0000 7f0b3ea00640 1 -- 172.21.15.135:0/175767639 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30036020 con 0x7f0b401530b0 2024-05-14T09:41:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.542+0000 7f0b3ea00640 1 -- 172.21.15.135:0/175767639 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b30032800 con 0x7f0b401530b0 2024-05-14T09:41:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.542+0000 7f0b3ea00640 1 -- 172.21.15.135:0/175767639 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30032bd0 con 0x7f0b401530b0 2024-05-14T09:41:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.543+0000 7f0b45800640 1 -- 172.21.15.135:0/175767639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b401530b0 msgr2=0x7f0b4006da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.543+0000 7f0b45800640 1 --2- 172.21.15.135:0/175767639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b401530b0 0x7f0b4006da70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000bb10 tx=0x7f0b3002c900 comp rx=0 tx=0).stop 2024-05-14T09:41:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.543+0000 7f0b45800640 1 -- 172.21.15.135:0/175767639 shutdown_connections 2024-05-14T09:41:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.543+0000 7f0b45800640 1 --2- 172.21.15.135:0/175767639 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b400c8860 0x7f0b400c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.544+0000 7f0b45800640 1 --2- 172.21.15.135:0/175767639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b401530b0 0x7f0b4006da70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.544+0000 7f0b45800640 1 -- 172.21.15.135:0/175767639 >> 172.21.15.135:0/175767639 conn(0x7f0b40074620 msgr2=0x7f0b400c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.544+0000 7f0b45800640 1 -- 172.21.15.135:0/175767639 shutdown_connections 2024-05-14T09:41:30.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.544+0000 7f0b45800640 1 -- 172.21.15.135:0/175767639 wait complete. 2024-05-14T09:41:30.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.546+0000 7f0b45800640 1 Processor -- start 2024-05-14T09:41:30.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.546+0000 7f0b45800640 1 -- start start 2024-05-14T09:41:30.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.548+0000 7f0b45800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b400c8860 0x7f0b400c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:30.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.548+0000 7f0b45800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b401530b0 0x7f0b400cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:30.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.548+0000 7f0b45800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b40158e70 0x7f0b400c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:30.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.548+0000 7f0b45800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b400c7d80 con 0x7f0b400c8860 2024-05-14T09:41:30.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.548+0000 7f0b45800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40159ce0 con 0x7f0b40158e70 2024-05-14T09:41:30.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.548+0000 7f0b45800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0b400c8060 con 0x7f0b401530b0 2024-05-14T09:41:30.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.549+0000 7f0b3fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b400c8860 0x7f0b400c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:30.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.549+0000 7f0b3fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b400c8860 0x7f0b400c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55424/0 (socket says 172.21.15.135:55424) 2024-05-14T09:41:30.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.549+0000 7f0b3fe00640 1 -- 172.21.15.135:0/1594399162 learned_addr learned my addr 172.21.15.135:0/1594399162 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:30.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.550+0000 7f0b3f400640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b401530b0 0x7f0b400cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.550+0000 7f0b44e00640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b40158e70 0x7f0b400c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:30.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.553+0000 7f0b3fe00640 1 -- 172.21.15.135:0/1594399162 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b401530b0 msgr2=0x7f0b400cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:30.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.553+0000 7f0b3fe00640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b401530b0 0x7f0b400cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:30.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.553+0000 7f0b3fe00640 1 -- 172.21.15.135:0/1594399162 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b40158e70 msgr2=0x7f0b400c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:30.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.553+0000 7f0b3fe00640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b40158e70 0x7f0b400c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:30.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.553+0000 7f0b3fe00640 1 -- 172.21.15.135:0/1594399162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b401edc40 con 0x7f0b400c8860 2024-05-14T09:41:30.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.556+0000 7f0b3fe00640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b400c8860 0x7f0b400c4720 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000b2c0 tx=0x7f0b300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.561+0000 7f0b37e00640 1 -- 172.21.15.135:0/1594399162 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30036040 con 0x7f0b400c8860 2024-05-14T09:41:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.561+0000 7f0b37e00640 1 -- 172.21.15.135:0/1594399162 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b30032e50 con 0x7f0b400c8860 2024-05-14T09:41:30.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.561+0000 7f0b37e00640 1 -- 172.21.15.135:0/1594399162 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b300453f0 con 0x7f0b400c8860 2024-05-14T09:41:30.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.561+0000 7f0b45800640 1 -- 172.21.15.135:0/1594399162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b40150180 con 0x7f0b400c8860 2024-05-14T09:41:30.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.561+0000 7f0b45800640 1 -- 172.21.15.135:0/1594399162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b401edee0 con 0x7f0b400c8860 2024-05-14T09:41:30.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.562+0000 7f0b45800640 1 -- 172.21.15.135:0/1594399162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b401eda30 con 0x7f0b400c8860 2024-05-14T09:41:30.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.588+0000 7f0b37e00640 1 -- 172.21.15.135:0/1594399162 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0b3004c060 con 0x7f0b400c8860 2024-05-14T09:41:30.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.590+0000 7f0b37e00640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b20076350 0x7f0b20078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:30.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.590+0000 7f0b3f400640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b20076350 0x7f0b20078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:30.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.592+0000 7f0b3f400640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b20076350 0x7f0b20078860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b4015d2f0 tx=0x7f0b2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:30.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.888+0000 7f0b37e00640 1 -- 172.21.15.135:0/1594399162 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f0b3007fb80 con 0x7f0b400c8860 2024-05-14T09:41:30.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:30.889+0000 7f0b37e00640 1 -- 172.21.15.135:0/1594399162 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0b30040070 con 0x7f0b400c8860 2024-05-14T09:41:31.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.099+0000 7f0b45800640 1 -- 172.21.15.135:0/1594399162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b40069980 con 0x7f0b400c8860 2024-05-14T09:41:31.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.360+0000 7f0b37e00640 1 -- 172.21.15.135:0/1594399162 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+18997 (secure 0 0 0) 0x7f0b300838f0 con 0x7f0b400c8860 2024-05-14T09:41:31.361 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:31.361 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":33,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:41:04.087625+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:40:40.770106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:40:43.375791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:40:51.210089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.363+0000 7f0b45800640 1 -- 172.21.15.135:0/1594399162 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b20076350 msgr2=0x7f0b20078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.363+0000 7f0b45800640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b20076350 0x7f0b20078860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b4015d2f0 tx=0x7f0b2c009040 comp rx=0 tx=0).stop 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.363+0000 7f0b45800640 1 -- 172.21.15.135:0/1594399162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b400c8860 msgr2=0x7f0b400c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.363+0000 7f0b45800640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b400c8860 0x7f0b400c4720 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000b2c0 tx=0x7f0b300046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.363+0000 7f0b45800640 1 -- 172.21.15.135:0/1594399162 shutdown_connections 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.363+0000 7f0b45800640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b20076350 0x7f0b20078860 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.363+0000 7f0b45800640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b40158e70 0x7f0b400c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.363+0000 7f0b45800640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b401530b0 0x7f0b400cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.363+0000 7f0b45800640 1 --2- 172.21.15.135:0/1594399162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b400c8860 0x7f0b400c4720 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.364+0000 7f0b45800640 1 -- 172.21.15.135:0/1594399162 >> 172.21.15.135:0/1594399162 conn(0x7f0b40074620 msgr2=0x7f0b40157710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.364+0000 7f0b45800640 1 -- 172.21.15.135:0/1594399162 shutdown_connections 2024-05-14T09:41:31.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.364+0000 7f0b45800640 1 -- 172.21.15.135:0/1594399162 wait complete. 2024-05-14T09:41:31.394 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T09:41:31.394 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T09:41:31.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.653+0000 7f918ea00640 1 Processor -- start 2024-05-14T09:41:31.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.654+0000 7f918ea00640 1 -- start start 2024-05-14T09:41:31.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.656+0000 7f918ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188071fe0 0x7f9188154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:31.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.656+0000 7f918ea00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9188074810 0x7f91880c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:31.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.656+0000 7f918ea00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f91880c97c0 0x7f91880c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:31.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.656+0000 7f918ea00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f918815ac30 con 0x7f9188074810 2024-05-14T09:41:31.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.656+0000 7f918ea00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f918815b160 con 0x7f91880c97c0 2024-05-14T09:41:31.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.656+0000 7f918ea00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f918815ae80 con 0x7f9188071fe0 2024-05-14T09:41:31.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.657+0000 7f917fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9188074810 0x7f91880c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:31.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.658+0000 7f917fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9188074810 0x7f91880c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55436/0 (socket says 172.21.15.135:55436) 2024-05-14T09:41:31.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.658+0000 7f917fe00640 1 -- 172.21.15.135:0/1974506351 learned_addr learned my addr 172.21.15.135:0/1974506351 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:31.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.658+0000 7f9187e00640 1 --2- 172.21.15.135:0/1974506351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188071fe0 0x7f9188154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:31.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.658+0000 7f918ca00640 1 --2- 172.21.15.135:0/1974506351 >> v2:172.21.15.196:3300/0 conn(0x7f91880c97c0 0x7f91880c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:31.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.661+0000 7f917fe00640 1 -- 172.21.15.135:0/1974506351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188071fe0 msgr2=0x7f9188154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:31.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.661+0000 7f917fe00640 1 --2- 172.21.15.135:0/1974506351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188071fe0 0x7f9188154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.661+0000 7f917fe00640 1 -- 172.21.15.135:0/1974506351 >> v2:172.21.15.196:3300/0 conn(0x7f91880c97c0 msgr2=0x7f91880c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:31.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.661+0000 7f917fe00640 1 --2- 172.21.15.135:0/1974506351 >> v2:172.21.15.196:3300/0 conn(0x7f91880c97c0 0x7f91880c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.662+0000 7f917fe00640 1 -- 172.21.15.135:0/1974506351 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91880c8ce0 con 0x7f9188074810 2024-05-14T09:41:31.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.664+0000 7f917fe00640 1 --2- 172.21.15.135:0/1974506351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9188074810 0x7f91880c84d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f91880c7b20 tx=0x7f917002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805794f16a8aafda server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:31.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.668+0000 7f9187400640 1 -- 172.21.15.135:0/1974506351 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170037070 con 0x7f9188074810 2024-05-14T09:41:31.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.668+0000 7f9187400640 1 -- 172.21.15.135:0/1974506351 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9170032440 con 0x7f9188074810 2024-05-14T09:41:31.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.668+0000 7f9187400640 1 -- 172.21.15.135:0/1974506351 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170032810 con 0x7f9188074810 2024-05-14T09:41:31.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.669+0000 7f918ea00640 1 -- 172.21.15.135:0/1974506351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9188074810 msgr2=0x7f91880c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:31.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.669+0000 7f918ea00640 1 --2- 172.21.15.135:0/1974506351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9188074810 0x7f91880c84d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f91880c7b20 tx=0x7f917002a1e0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.669+0000 7f918ea00640 1 -- 172.21.15.135:0/1974506351 shutdown_connections 2024-05-14T09:41:31.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.669+0000 7f918ea00640 1 --2- 172.21.15.135:0/1974506351 >> v2:172.21.15.196:3300/0 conn(0x7f91880c97c0 0x7f91880c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.669+0000 7f918ea00640 1 --2- 172.21.15.135:0/1974506351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9188074810 0x7f91880c84d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.669+0000 7f918ea00640 1 --2- 172.21.15.135:0/1974506351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9188071fe0 0x7f9188154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.669+0000 7f918ea00640 1 -- 172.21.15.135:0/1974506351 >> 172.21.15.135:0/1974506351 conn(0x7f9188073cf0 msgr2=0x7f9188074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:31.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.669+0000 7f918ea00640 1 -- 172.21.15.135:0/1974506351 shutdown_connections 2024-05-14T09:41:31.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.669+0000 7f918ea00640 1 -- 172.21.15.135:0/1974506351 wait complete. 2024-05-14T09:41:31.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.672+0000 7f918ea00640 1 Processor -- start 2024-05-14T09:41:31.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.672+0000 7f918ea00640 1 -- start start 2024-05-14T09:41:31.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.674+0000 7f918ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071fe0 0x7f9188156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:31.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.674+0000 7f918ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91880c97c0 0x7f918815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:31.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.674+0000 7f918ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91881573c0 0x7f91881f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:31.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.674+0000 7f918ea00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f918806c6f0 con 0x7f91880c97c0 2024-05-14T09:41:31.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.674+0000 7f918ea00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f91880c92a0 con 0x7f9188071fe0 2024-05-14T09:41:31.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.674+0000 7f918ea00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f918806c870 con 0x7f91881573c0 2024-05-14T09:41:31.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.674+0000 7f917fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91880c97c0 0x7f918815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:31.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.675+0000 7f917fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91880c97c0 0x7f918815bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55444/0 (socket says 172.21.15.135:55444) 2024-05-14T09:41:31.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.675+0000 7f917fe00640 1 -- 172.21.15.135:0/894022374 learned_addr learned my addr 172.21.15.135:0/894022374 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:31.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.676+0000 7f918ca00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91881573c0 0x7f91881f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:31.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.679+0000 7f917fe00640 1 -- 172.21.15.135:0/894022374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91881573c0 msgr2=0x7f91881f07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:31.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.679+0000 7f917fe00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91881573c0 0x7f91881f07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.679+0000 7f917fe00640 1 -- 172.21.15.135:0/894022374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071fe0 msgr2=0x7f9188156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:31.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.679+0000 7f917fe00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071fe0 0x7f9188156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:31.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.679+0000 7f917fe00640 1 -- 172.21.15.135:0/894022374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91881571b0 con 0x7f91880c97c0 2024-05-14T09:41:31.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.682+0000 7f917fe00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91880c97c0 0x7f918815bcd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f917002a750 tx=0x7f91700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:31.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.686+0000 7f9184c00640 1 -- 172.21.15.135:0/894022374 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170037040 con 0x7f91880c97c0 2024-05-14T09:41:31.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.686+0000 7f9184c00640 1 -- 172.21.15.135:0/894022374 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9170042070 con 0x7f91880c97c0 2024-05-14T09:41:31.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.686+0000 7f9184c00640 1 -- 172.21.15.135:0/894022374 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170030900 con 0x7f91880c97c0 2024-05-14T09:41:31.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.686+0000 7f918ea00640 1 -- 172.21.15.135:0/894022374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9188152890 con 0x7f91880c97c0 2024-05-14T09:41:31.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.687+0000 7f918ea00640 1 -- 172.21.15.135:0/894022374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9188159530 con 0x7f91880c97c0 2024-05-14T09:41:31.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:31.688+0000 7f918ea00640 1 -- 172.21.15.135:0/894022374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9188069a90 con 0x7f91880c97c0 2024-05-14T09:41:32.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.032+0000 7f9184c00640 1 -- 172.21.15.135:0/894022374 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9170030aa0 con 0x7f91880c97c0 2024-05-14T09:41:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.034+0000 7f9184c00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9164076320 0x7f9164078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.035+0000 7f9187e00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9164076320 0x7f9164078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:32.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.037+0000 7f9187e00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9164076320 0x7f9164078830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9178006a90 tx=0x7f9178006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:32.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.071+0000 7f9184c00640 1 -- 172.21.15.135:0/894022374 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f9170030d90 con 0x7f91880c97c0 2024-05-14T09:41:32.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.073+0000 7f9184c00640 1 -- 172.21.15.135:0/894022374 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9170082310 con 0x7f91880c97c0 2024-05-14T09:41:32.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.280+0000 7f918ea00640 1 -- 172.21.15.135:0/894022374 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9188074200 con 0x7f9164076320 2024-05-14T09:41:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.312+0000 7f9184c00640 1 -- 172.21.15.135:0/894022374 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332599 (secure 0 0 0) 0x7f9188074200 con 0x7f9164076320 2024-05-14T09:41:32.317 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.320+0000 7f918ea00640 1 -- 172.21.15.135:0/894022374 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9164076320 msgr2=0x7f9164078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.320+0000 7f918ea00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9164076320 0x7f9164078830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9178006a90 tx=0x7f9178006a20 comp rx=0 tx=0).stop 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.320+0000 7f918ea00640 1 -- 172.21.15.135:0/894022374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91880c97c0 msgr2=0x7f918815bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.320+0000 7f918ea00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91880c97c0 0x7f918815bcd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f917002a750 tx=0x7f91700046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.320+0000 7f918ea00640 1 -- 172.21.15.135:0/894022374 shutdown_connections 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.320+0000 7f918ea00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9164076320 0x7f9164078830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.320+0000 7f918ea00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91881573c0 0x7f91881f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.320+0000 7f918ea00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91880c97c0 0x7f918815bcd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.320+0000 7f918ea00640 1 --2- 172.21.15.135:0/894022374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9188071fe0 0x7f9188156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.320+0000 7f918ea00640 1 -- 172.21.15.135:0/894022374 >> 172.21.15.135:0/894022374 conn(0x7f9188073cf0 msgr2=0x7f91880c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.321+0000 7f918ea00640 1 -- 172.21.15.135:0/894022374 shutdown_connections 2024-05-14T09:41:32.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.321+0000 7f918ea00640 1 -- 172.21.15.135:0/894022374 wait complete. 2024-05-14T09:41:32.350 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-05-14T09:41:30.347434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":171,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220144,"kb_used_data":3992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754576,"statfs":{"total":773094113280,"available":772868685824,"internally_reserved":0,"allocated":4087808,"data_stored":2379574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006286"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204940+0000","last_change":"2024-05-14T09:40:43.106486+0000","last_active":"2024-05-14T09:41:04.204940+0000","last_peered":"2024-05-14T09:41:04.204940+0000","last_clean":"2024-05-14T09:41:04.204940+0000","last_became_active":"2024-05-14T09:40:43.105731+0000","last_became_peered":"2024-05-14T09:40:43.105731+0000","last_unstale":"2024-05-14T09:41:04.204940+0000","last_undegraded":"2024-05-14T09:41:04.204940+0000","last_fullsized":"2024-05-14T09:41:04.204940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:32:09.735265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197157+0000","last_change":"2024-05-14T09:40:45.750103+0000","last_active":"2024-05-14T09:41:04.197157+0000","last_peered":"2024-05-14T09:41:04.197157+0000","last_clean":"2024-05-14T09:41:04.197157+0000","last_became_active":"2024-05-14T09:40:45.747865+0000","last_became_peered":"2024-05-14T09:40:45.747865+0000","last_unstale":"2024-05-14T09:41:04.197157+0000","last_undegraded":"2024-05-14T09:41:04.197157+0000","last_fullsized":"2024-05-14T09:41:04.197157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:06.549076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195817+0000","last_change":"2024-05-14T09:40:53.664918+0000","last_active":"2024-05-14T09:41:04.195817+0000","last_peered":"2024-05-14T09:41:04.195817+0000","last_clean":"2024-05-14T09:41:04.195817+0000","last_became_active":"2024-05-14T09:40:53.664366+0000","last_became_peered":"2024-05-14T09:40:53.664366+0000","last_unstale":"2024-05-14T09:41:04.195817+0000","last_undegraded":"2024-05-14T09:41:04.195817+0000","last_fullsized":"2024-05-14T09:41:04.195817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:20:52.204134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197856+0000","last_change":"2024-05-14T09:40:43.101185+0000","last_active":"2024-05-14T09:41:04.197856+0000","last_peered":"2024-05-14T09:41:04.197856+0000","last_clean":"2024-05-14T09:41:04.197856+0000","last_became_active":"2024-05-14T09:40:43.098862+0000","last_became_peered":"2024-05-14T09:40:43.098862+0000","last_unstale":"2024-05-14T09:41:04.197856+0000","last_undegraded":"2024-05-14T09:41:04.197856+0000","last_fullsized":"2024-05-14T09:41:04.197856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203770+0000","last_change":"2024-05-14T09:40:45.752960+0000","last_active":"2024-05-14T09:41:04.203770+0000","last_peered":"2024-05-14T09:41:04.203770+0000","last_clean":"2024-05-14T09:41:04.203770+0000","last_became_active":"2024-05-14T09:40:45.752627+0000","last_became_peered":"2024-05-14T09:40:45.752627+0000","last_unstale":"2024-05-14T09:41:04.203770+0000","last_undegraded":"2024-05-14T09:41:04.203770+0000","last_fullsized":"2024-05-14T09:41:04.203770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.192616+0000","last_change":"2024-05-14T09:40:53.662032+0000","last_active":"2024-05-14T09:41:04.192616+0000","last_peered":"2024-05-14T09:41:04.192616+0000","last_clean":"2024-05-14T09:41:04.192616+0000","last_became_active":"2024-05-14T09:40:53.661453+0000","last_became_peered":"2024-05-14T09:40:53.661453+0000","last_unstale":"2024-05-14T09:41:04.192616+0000","last_undegraded":"2024-05-14T09:41:04.192616+0000","last_fullsized":"2024-05-14T09:41:04.192616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:11.724866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610802+0000","last_change":"2024-05-14T09:40:43.114965+0000","last_active":"2024-05-14T09:41:04.610802+0000","last_peered":"2024-05-14T09:41:04.610802+0000","last_clean":"2024-05-14T09:41:04.610802+0000","last_became_active":"2024-05-14T09:40:43.114379+0000","last_became_peered":"2024-05-14T09:40:43.114379+0000","last_unstale":"2024-05-14T09:41:04.610802+0000","last_undegraded":"2024-05-14T09:41:04.610802+0000","last_fullsized":"2024-05-14T09:41:04.610802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:43.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204333+0000","last_change":"2024-05-14T09:40:45.758305+0000","last_active":"2024-05-14T09:41:04.204333+0000","last_peered":"2024-05-14T09:41:04.204333+0000","last_clean":"2024-05-14T09:41:04.204333+0000","last_became_active":"2024-05-14T09:40:45.754110+0000","last_became_peered":"2024-05-14T09:40:45.754110+0000","last_unstale":"2024-05-14T09:41:04.204333+0000","last_undegraded":"2024-05-14T09:41:04.204333+0000","last_fullsized":"2024-05-14T09:41:04.204333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:12:42.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.601574+0000","last_change":"2024-05-14T09:41:04.601574+0000","last_active":"2024-05-14T09:41:04.601574+0000","last_peered":"2024-05-14T09:41:04.601574+0000","last_clean":"2024-05-14T09:41:04.601574+0000","last_became_active":"2024-05-14T09:41:04.599475+0000","last_became_peered":"2024-05-14T09:41:04.599475+0000","last_unstale":"2024-05-14T09:41:04.601574+0000","last_undegraded":"2024-05-14T09:41:04.601574+0000","last_fullsized":"2024-05-14T09:41:04.601574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610183+0000","last_change":"2024-05-14T09:40:43.110296+0000","last_active":"2024-05-14T09:41:04.610183+0000","last_peered":"2024-05-14T09:41:04.610183+0000","last_clean":"2024-05-14T09:41:04.610183+0000","last_became_active":"2024-05-14T09:40:43.109932+0000","last_became_peered":"2024-05-14T09:40:43.109932+0000","last_unstale":"2024-05-14T09:41:04.610183+0000","last_undegraded":"2024-05-14T09:41:04.610183+0000","last_fullsized":"2024-05-14T09:41:04.610183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:29.003048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205871+0000","last_change":"2024-05-14T09:40:45.773110+0000","last_active":"2024-05-14T09:41:04.205871+0000","last_peered":"2024-05-14T09:41:04.205871+0000","last_clean":"2024-05-14T09:41:04.205871+0000","last_became_active":"2024-05-14T09:40:45.770117+0000","last_became_peered":"2024-05-14T09:40:45.770117+0000","last_unstale":"2024-05-14T09:41:04.205871+0000","last_undegraded":"2024-05-14T09:41:04.205871+0000","last_fullsized":"2024-05-14T09:41:04.205871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:28.718450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.192677+0000","last_change":"2024-05-14T09:40:53.652049+0000","last_active":"2024-05-14T09:41:04.192677+0000","last_peered":"2024-05-14T09:41:04.192677+0000","last_clean":"2024-05-14T09:41:04.192677+0000","last_became_active":"2024-05-14T09:40:53.651570+0000","last_became_peered":"2024-05-14T09:40:53.651570+0000","last_unstale":"2024-05-14T09:41:04.192677+0000","last_undegraded":"2024-05-14T09:41:04.192677+0000","last_fullsized":"2024-05-14T09:41:04.192677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:30.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595721+0000","last_change":"2024-05-14T09:40:45.753771+0000","last_active":"2024-05-14T09:41:04.595721+0000","last_peered":"2024-05-14T09:41:04.595721+0000","last_clean":"2024-05-14T09:41:04.595721+0000","last_became_active":"2024-05-14T09:40:45.753319+0000","last_became_peered":"2024-05-14T09:40:45.753319+0000","last_unstale":"2024-05-14T09:41:04.595721+0000","last_undegraded":"2024-05-14T09:41:04.595721+0000","last_fullsized":"2024-05-14T09:41:04.595721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.542521+0000","last_change":"2024-05-14T09:40:43.125708+0000","last_active":"2024-05-14T09:41:27.542521+0000","last_peered":"2024-05-14T09:41:27.542521+0000","last_clean":"2024-05-14T09:41:27.542521+0000","last_became_active":"2024-05-14T09:40:43.125239+0000","last_became_peered":"2024-05-14T09:40:43.125239+0000","last_unstale":"2024-05-14T09:41:27.542521+0000","last_undegraded":"2024-05-14T09:41:27.542521+0000","last_fullsized":"2024-05-14T09:41:27.542521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:22.781125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.194099+0000","last_change":"2024-05-14T09:40:53.663353+0000","last_active":"2024-05-14T09:41:04.194099+0000","last_peered":"2024-05-14T09:41:04.194099+0000","last_clean":"2024-05-14T09:41:04.194099+0000","last_became_active":"2024-05-14T09:40:53.662559+0000","last_became_peered":"2024-05-14T09:40:53.662559+0000","last_unstale":"2024-05-14T09:41:04.194099+0000","last_undegraded":"2024-05-14T09:41:04.194099+0000","last_fullsized":"2024-05-14T09:41:04.194099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:14.708431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197527+0000","last_change":"2024-05-14T09:40:45.751929+0000","last_active":"2024-05-14T09:41:04.197527+0000","last_peered":"2024-05-14T09:41:04.197527+0000","last_clean":"2024-05-14T09:41:04.197527+0000","last_became_active":"2024-05-14T09:40:45.751015+0000","last_became_peered":"2024-05-14T09:40:45.751015+0000","last_unstale":"2024-05-14T09:41:04.197527+0000","last_undegraded":"2024-05-14T09:41:04.197527+0000","last_fullsized":"2024-05-14T09:41:04.197527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:12.550231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247228+0000","last_change":"2024-05-14T09:40:43.023070+0000","last_active":"2024-05-14T09:41:04.247228+0000","last_peered":"2024-05-14T09:41:04.247228+0000","last_clean":"2024-05-14T09:41:04.247228+0000","last_became_active":"2024-05-14T09:40:43.022234+0000","last_became_peered":"2024-05-14T09:40:43.022234+0000","last_unstale":"2024-05-14T09:41:04.247228+0000","last_undegraded":"2024-05-14T09:41:04.247228+0000","last_fullsized":"2024-05-14T09:41:04.247228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:30:06.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.601663+0000","last_change":"2024-05-14T09:41:04.601663+0000","last_active":"2024-05-14T09:41:04.601663+0000","last_peered":"2024-05-14T09:41:04.601663+0000","last_clean":"2024-05-14T09:41:04.601663+0000","last_became_active":"2024-05-14T09:41:04.600186+0000","last_became_peered":"2024-05-14T09:41:04.600186+0000","last_unstale":"2024-05-14T09:41:04.601663+0000","last_undegraded":"2024-05-14T09:41:04.601663+0000","last_fullsized":"2024-05-14T09:41:04.601663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196422+0000","last_change":"2024-05-14T09:40:45.746999+0000","last_active":"2024-05-14T09:41:04.196422+0000","last_peered":"2024-05-14T09:41:04.196422+0000","last_clean":"2024-05-14T09:41:04.196422+0000","last_became_active":"2024-05-14T09:40:45.746607+0000","last_became_peered":"2024-05-14T09:40:45.746607+0000","last_unstale":"2024-05-14T09:41:04.196422+0000","last_undegraded":"2024-05-14T09:41:04.196422+0000","last_fullsized":"2024-05-14T09:41:04.196422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:03.565510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.774259+0000","last_change":"2024-05-14T09:40:43.105149+0000","last_active":"2024-05-14T09:41:27.774259+0000","last_peered":"2024-05-14T09:41:27.774259+0000","last_clean":"2024-05-14T09:41:27.774259+0000","last_became_active":"2024-05-14T09:40:43.104277+0000","last_became_peered":"2024-05-14T09:40:43.104277+0000","last_unstale":"2024-05-14T09:41:27.774259+0000","last_undegraded":"2024-05-14T09:41:27.774259+0000","last_fullsized":"2024-05-14T09:41:27.774259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:48.598915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247251+0000","last_change":"2024-05-14T09:40:53.649256+0000","last_active":"2024-05-14T09:41:04.247251+0000","last_peered":"2024-05-14T09:41:04.247251+0000","last_clean":"2024-05-14T09:41:04.247251+0000","last_became_active":"2024-05-14T09:40:53.648765+0000","last_became_peered":"2024-05-14T09:40:53.648765+0000","last_unstale":"2024-05-14T09:41:04.247251+0000","last_undegraded":"2024-05-14T09:41:04.247251+0000","last_fullsized":"2024-05-14T09:41:04.247251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:25.060381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196117+0000","last_change":"2024-05-14T09:40:45.730862+0000","last_active":"2024-05-14T09:41:04.196117+0000","last_peered":"2024-05-14T09:41:04.196117+0000","last_clean":"2024-05-14T09:41:04.196117+0000","last_became_active":"2024-05-14T09:40:45.730014+0000","last_became_peered":"2024-05-14T09:40:45.730014+0000","last_unstale":"2024-05-14T09:41:04.196117+0000","last_undegraded":"2024-05-14T09:41:04.196117+0000","last_fullsized":"2024-05-14T09:41:04.196117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:05.679719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.533383+0000","last_change":"2024-05-14T09:40:43.112127+0000","last_active":"2024-05-14T09:41:27.533383+0000","last_peered":"2024-05-14T09:41:27.533383+0000","last_clean":"2024-05-14T09:41:27.533383+0000","last_became_active":"2024-05-14T09:40:43.111574+0000","last_became_peered":"2024-05-14T09:40:43.111574+0000","last_unstale":"2024-05-14T09:41:27.533383+0000","last_undegraded":"2024-05-14T09:41:27.533383+0000","last_fullsized":"2024-05-14T09:41:27.533383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:13.668017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193742+0000","last_change":"2024-05-14T09:40:53.666100+0000","last_active":"2024-05-14T09:41:04.193742+0000","last_peered":"2024-05-14T09:41:04.193742+0000","last_clean":"2024-05-14T09:41:04.193742+0000","last_became_active":"2024-05-14T09:40:53.665635+0000","last_became_peered":"2024-05-14T09:40:53.665635+0000","last_unstale":"2024-05-14T09:41:04.193742+0000","last_undegraded":"2024-05-14T09:41:04.193742+0000","last_fullsized":"2024-05-14T09:41:04.193742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:21.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205010+0000","last_change":"2024-05-14T09:40:45.758554+0000","last_active":"2024-05-14T09:41:04.205010+0000","last_peered":"2024-05-14T09:41:04.205010+0000","last_clean":"2024-05-14T09:41:04.205010+0000","last_became_active":"2024-05-14T09:40:45.757938+0000","last_became_peered":"2024-05-14T09:40:45.757938+0000","last_unstale":"2024-05-14T09:41:04.205010+0000","last_undegraded":"2024-05-14T09:41:04.205010+0000","last_fullsized":"2024-05-14T09:41:04.205010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596811+0000","last_change":"2024-05-14T09:40:43.116767+0000","last_active":"2024-05-14T09:41:04.596811+0000","last_peered":"2024-05-14T09:41:04.596811+0000","last_clean":"2024-05-14T09:41:04.596811+0000","last_became_active":"2024-05-14T09:40:43.116142+0000","last_became_peered":"2024-05-14T09:40:43.116142+0000","last_unstale":"2024-05-14T09:41:04.596811+0000","last_undegraded":"2024-05-14T09:41:04.596811+0000","last_fullsized":"2024-05-14T09:41:04.596811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195886+0000","last_change":"2024-05-14T09:40:53.666811+0000","last_active":"2024-05-14T09:41:04.195886+0000","last_peered":"2024-05-14T09:41:04.195886+0000","last_clean":"2024-05-14T09:41:04.195886+0000","last_became_active":"2024-05-14T09:40:53.666455+0000","last_became_peered":"2024-05-14T09:40:53.666455+0000","last_unstale":"2024-05-14T09:41:04.195886+0000","last_undegraded":"2024-05-14T09:41:04.195886+0000","last_fullsized":"2024-05-14T09:41:04.195886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:33.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198714+0000","last_change":"2024-05-14T09:40:45.768162+0000","last_active":"2024-05-14T09:41:04.198714+0000","last_peered":"2024-05-14T09:41:04.198714+0000","last_clean":"2024-05-14T09:41:04.198714+0000","last_became_active":"2024-05-14T09:40:45.767810+0000","last_became_peered":"2024-05-14T09:40:45.767810+0000","last_unstale":"2024-05-14T09:41:04.198714+0000","last_undegraded":"2024-05-14T09:41:04.198714+0000","last_fullsized":"2024-05-14T09:41:04.198714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:25.075246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247616+0000","last_change":"2024-05-14T09:40:43.115650+0000","last_active":"2024-05-14T09:41:04.247616+0000","last_peered":"2024-05-14T09:41:04.247616+0000","last_clean":"2024-05-14T09:41:04.247616+0000","last_became_active":"2024-05-14T09:40:43.114902+0000","last_became_peered":"2024-05-14T09:40:43.114902+0000","last_unstale":"2024-05-14T09:41:04.247616+0000","last_undegraded":"2024-05-14T09:41:04.247616+0000","last_fullsized":"2024-05-14T09:41:04.247616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:19.284998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195677+0000","last_change":"2024-05-14T09:40:53.650297+0000","last_active":"2024-05-14T09:41:04.195677+0000","last_peered":"2024-05-14T09:41:04.195677+0000","last_clean":"2024-05-14T09:41:04.195677+0000","last_became_active":"2024-05-14T09:40:53.649263+0000","last_became_peered":"2024-05-14T09:40:53.649263+0000","last_unstale":"2024-05-14T09:41:04.195677+0000","last_undegraded":"2024-05-14T09:41:04.195677+0000","last_fullsized":"2024-05-14T09:41:04.195677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:22.637337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247816+0000","last_change":"2024-05-14T09:40:45.733131+0000","last_active":"2024-05-14T09:41:04.247816+0000","last_peered":"2024-05-14T09:41:04.247816+0000","last_clean":"2024-05-14T09:41:04.247816+0000","last_became_active":"2024-05-14T09:40:45.732154+0000","last_became_peered":"2024-05-14T09:40:45.732154+0000","last_unstale":"2024-05-14T09:41:04.247816+0000","last_undegraded":"2024-05-14T09:41:04.247816+0000","last_fullsized":"2024-05-14T09:41:04.247816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:23:16.904648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611279+0000","last_change":"2024-05-14T09:40:43.112841+0000","last_active":"2024-05-14T09:41:04.611279+0000","last_peered":"2024-05-14T09:41:04.611279+0000","last_clean":"2024-05-14T09:41:04.611279+0000","last_became_active":"2024-05-14T09:40:43.110703+0000","last_became_peered":"2024-05-14T09:40:43.110703+0000","last_unstale":"2024-05-14T09:41:04.611279+0000","last_undegraded":"2024-05-14T09:41:04.611279+0000","last_fullsized":"2024-05-14T09:41:04.611279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:01.271389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203306+0000","last_change":"2024-05-14T09:40:53.657532+0000","last_active":"2024-05-14T09:41:04.203306+0000","last_peered":"2024-05-14T09:41:04.203306+0000","last_clean":"2024-05-14T09:41:04.203306+0000","last_became_active":"2024-05-14T09:40:53.657073+0000","last_became_peered":"2024-05-14T09:40:53.657073+0000","last_unstale":"2024-05-14T09:41:04.203306+0000","last_undegraded":"2024-05-14T09:41:04.203306+0000","last_fullsized":"2024-05-14T09:41:04.203306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:56.882153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.206106+0000","last_change":"2024-05-14T09:40:45.752122+0000","last_active":"2024-05-14T09:41:04.206106+0000","last_peered":"2024-05-14T09:41:04.206106+0000","last_clean":"2024-05-14T09:41:04.206106+0000","last_became_active":"2024-05-14T09:40:45.751546+0000","last_became_peered":"2024-05-14T09:40:45.751546+0000","last_unstale":"2024-05-14T09:41:04.206106+0000","last_undegraded":"2024-05-14T09:41:04.206106+0000","last_fullsized":"2024-05-14T09:41:04.206106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:19:55.897772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247921+0000","last_change":"2024-05-14T09:40:43.099478+0000","last_active":"2024-05-14T09:41:04.247921+0000","last_peered":"2024-05-14T09:41:04.247921+0000","last_clean":"2024-05-14T09:41:04.247921+0000","last_became_active":"2024-05-14T09:40:43.098776+0000","last_became_peered":"2024-05-14T09:40:43.098776+0000","last_unstale":"2024-05-14T09:41:04.247921+0000","last_undegraded":"2024-05-14T09:41:04.247921+0000","last_fullsized":"2024-05-14T09:41:04.247921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:35.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.246451+0000","last_change":"2024-05-14T09:40:53.650794+0000","last_active":"2024-05-14T09:41:04.246451+0000","last_peered":"2024-05-14T09:41:04.246451+0000","last_clean":"2024-05-14T09:41:04.246451+0000","last_became_active":"2024-05-14T09:40:53.650139+0000","last_became_peered":"2024-05-14T09:40:53.650139+0000","last_unstale":"2024-05-14T09:41:04.246451+0000","last_undegraded":"2024-05-14T09:41:04.246451+0000","last_fullsized":"2024-05-14T09:41:04.246451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:36.877806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193914+0000","last_change":"2024-05-14T09:40:45.748430+0000","last_active":"2024-05-14T09:41:04.193914+0000","last_peered":"2024-05-14T09:41:04.193914+0000","last_clean":"2024-05-14T09:41:04.193914+0000","last_became_active":"2024-05-14T09:40:45.748048+0000","last_became_peered":"2024-05-14T09:40:45.748048+0000","last_unstale":"2024-05-14T09:41:04.193914+0000","last_undegraded":"2024-05-14T09:41:04.193914+0000","last_fullsized":"2024-05-14T09:41:04.193914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:29.240543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205404+0000","last_change":"2024-05-14T09:40:43.088293+0000","last_active":"2024-05-14T09:41:04.205404+0000","last_peered":"2024-05-14T09:41:04.205404+0000","last_clean":"2024-05-14T09:41:04.205404+0000","last_became_active":"2024-05-14T09:40:43.087310+0000","last_became_peered":"2024-05-14T09:40:43.087310+0000","last_unstale":"2024-05-14T09:41:04.205404+0000","last_undegraded":"2024-05-14T09:41:04.205404+0000","last_fullsized":"2024-05-14T09:41:04.205404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:38.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.604273+0000","last_change":"2024-05-14T09:41:04.598844+0000","last_active":"2024-05-14T09:41:04.604273+0000","last_peered":"2024-05-14T09:41:04.604273+0000","last_clean":"2024-05-14T09:41:04.604273+0000","last_became_active":"2024-05-14T09:41:04.597473+0000","last_became_peered":"2024-05-14T09:41:04.597473+0000","last_unstale":"2024-05-14T09:41:04.604273+0000","last_undegraded":"2024-05-14T09:41:04.604273+0000","last_fullsized":"2024-05-14T09:41:04.604273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:48.257782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245464+0000","last_change":"2024-05-14T09:40:45.740074+0000","last_active":"2024-05-14T09:41:04.245464+0000","last_peered":"2024-05-14T09:41:04.245464+0000","last_clean":"2024-05-14T09:41:04.245464+0000","last_became_active":"2024-05-14T09:40:45.739647+0000","last_became_peered":"2024-05-14T09:40:45.739647+0000","last_unstale":"2024-05-14T09:41:04.245464+0000","last_undegraded":"2024-05-14T09:41:04.245464+0000","last_fullsized":"2024-05-14T09:41:04.245464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:38.401151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211238+0000","last_change":"2024-05-14T09:40:43.043210+0000","last_active":"2024-05-14T09:41:04.211238+0000","last_peered":"2024-05-14T09:41:04.211238+0000","last_clean":"2024-05-14T09:41:04.211238+0000","last_became_active":"2024-05-14T09:40:43.042243+0000","last_became_peered":"2024-05-14T09:40:43.042243+0000","last_unstale":"2024-05-14T09:41:04.211238+0000","last_undegraded":"2024-05-14T09:41:04.211238+0000","last_fullsized":"2024-05-14T09:41:04.211238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.946422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247618+0000","last_change":"2024-05-14T09:40:53.652161+0000","last_active":"2024-05-14T09:41:04.247618+0000","last_peered":"2024-05-14T09:41:04.247618+0000","last_clean":"2024-05-14T09:41:04.247618+0000","last_became_active":"2024-05-14T09:40:53.649990+0000","last_became_peered":"2024-05-14T09:40:53.649990+0000","last_unstale":"2024-05-14T09:41:04.247618+0000","last_undegraded":"2024-05-14T09:41:04.247618+0000","last_fullsized":"2024-05-14T09:41:04.247618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:20:04.057127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203229+0000","last_change":"2024-05-14T09:40:45.754250+0000","last_active":"2024-05-14T09:41:04.203229+0000","last_peered":"2024-05-14T09:41:04.203229+0000","last_clean":"2024-05-14T09:41:04.203229+0000","last_became_active":"2024-05-14T09:40:45.753850+0000","last_became_peered":"2024-05-14T09:40:45.753850+0000","last_unstale":"2024-05-14T09:41:04.203229+0000","last_undegraded":"2024-05-14T09:41:04.203229+0000","last_fullsized":"2024-05-14T09:41:04.203229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:15.962138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.608850+0000","last_change":"2024-05-14T09:40:43.111905+0000","last_active":"2024-05-14T09:41:04.608850+0000","last_peered":"2024-05-14T09:41:04.608850+0000","last_clean":"2024-05-14T09:41:04.608850+0000","last_became_active":"2024-05-14T09:40:43.108233+0000","last_became_peered":"2024-05-14T09:40:43.108233+0000","last_unstale":"2024-05-14T09:41:04.608850+0000","last_undegraded":"2024-05-14T09:41:04.608850+0000","last_fullsized":"2024-05-14T09:41:04.608850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204679+0000","last_change":"2024-05-14T09:40:53.663789+0000","last_active":"2024-05-14T09:41:04.204679+0000","last_peered":"2024-05-14T09:41:04.204679+0000","last_clean":"2024-05-14T09:41:04.204679+0000","last_became_active":"2024-05-14T09:40:53.662980+0000","last_became_peered":"2024-05-14T09:40:53.662980+0000","last_unstale":"2024-05-14T09:41:04.204679+0000","last_undegraded":"2024-05-14T09:41:04.204679+0000","last_fullsized":"2024-05-14T09:41:04.204679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:46.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196055+0000","last_change":"2024-05-14T09:40:45.754347+0000","last_active":"2024-05-14T09:41:04.196055+0000","last_peered":"2024-05-14T09:41:04.196055+0000","last_clean":"2024-05-14T09:41:04.196055+0000","last_became_active":"2024-05-14T09:40:45.753869+0000","last_became_peered":"2024-05-14T09:40:45.753869+0000","last_unstale":"2024-05-14T09:41:04.196055+0000","last_undegraded":"2024-05-14T09:41:04.196055+0000","last_fullsized":"2024-05-14T09:41:04.196055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.544619+0000","last_change":"2024-05-14T09:40:43.087481+0000","last_active":"2024-05-14T09:41:27.544619+0000","last_peered":"2024-05-14T09:41:27.544619+0000","last_clean":"2024-05-14T09:41:27.544619+0000","last_became_active":"2024-05-14T09:40:43.086487+0000","last_became_peered":"2024-05-14T09:40:43.086487+0000","last_unstale":"2024-05-14T09:41:27.544619+0000","last_undegraded":"2024-05-14T09:41:27.544619+0000","last_fullsized":"2024-05-14T09:41:27.544619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:54.225063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.608887+0000","last_change":"2024-05-14T09:40:22.705545+0000","last_active":"2024-05-14T09:41:04.608887+0000","last_peered":"2024-05-14T09:41:04.608887+0000","last_clean":"2024-05-14T09:41:04.608887+0000","last_became_active":"2024-05-14T09:40:22.701797+0000","last_became_peered":"2024-05-14T09:40:22.701797+0000","last_unstale":"2024-05-14T09:41:04.608887+0000","last_undegraded":"2024-05-14T09:41:04.608887+0000","last_fullsized":"2024-05-14T09:41:04.608887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_clean_scrub_stamp":"2024-05-14T09:40:17.767400+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:48:21.700172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596932+0000","last_change":"2024-05-14T09:40:53.681915+0000","last_active":"2024-05-14T09:41:04.596932+0000","last_peered":"2024-05-14T09:41:04.596932+0000","last_clean":"2024-05-14T09:41:04.596932+0000","last_became_active":"2024-05-14T09:40:53.681296+0000","last_became_peered":"2024-05-14T09:40:53.681296+0000","last_unstale":"2024-05-14T09:41:04.596932+0000","last_undegraded":"2024-05-14T09:41:04.596932+0000","last_fullsized":"2024-05-14T09:41:04.596932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:21.455981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.216856+0000","last_change":"2024-05-14T09:41:04.213355+0000","last_active":"2024-05-14T09:41:04.216856+0000","last_peered":"2024-05-14T09:41:04.216856+0000","last_clean":"2024-05-14T09:41:04.216856+0000","last_became_active":"2024-05-14T09:41:04.212709+0000","last_became_peered":"2024-05-14T09:41:04.212709+0000","last_unstale":"2024-05-14T09:41:04.216856+0000","last_undegraded":"2024-05-14T09:41:04.216856+0000","last_fullsized":"2024-05-14T09:41:04.216856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211994+0000","last_change":"2024-05-14T09:40:43.090401+0000","last_active":"2024-05-14T09:41:04.211994+0000","last_peered":"2024-05-14T09:41:04.211994+0000","last_clean":"2024-05-14T09:41:04.211994+0000","last_became_active":"2024-05-14T09:40:43.089548+0000","last_became_peered":"2024-05-14T09:40:43.089548+0000","last_unstale":"2024-05-14T09:41:04.211994+0000","last_undegraded":"2024-05-14T09:41:04.211994+0000","last_fullsized":"2024-05-14T09:41:04.211994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:03.385598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595424+0000","last_change":"2024-05-14T09:40:53.677072+0000","last_active":"2024-05-14T09:41:04.595424+0000","last_peered":"2024-05-14T09:41:04.595424+0000","last_clean":"2024-05-14T09:41:04.595424+0000","last_became_active":"2024-05-14T09:40:53.676636+0000","last_became_peered":"2024-05-14T09:40:53.676636+0000","last_unstale":"2024-05-14T09:41:04.595424+0000","last_undegraded":"2024-05-14T09:41:04.595424+0000","last_fullsized":"2024-05-14T09:41:04.595424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205238+0000","last_change":"2024-05-14T09:40:45.750962+0000","last_active":"2024-05-14T09:41:04.205238+0000","last_peered":"2024-05-14T09:41:04.205238+0000","last_clean":"2024-05-14T09:41:04.205238+0000","last_became_active":"2024-05-14T09:40:45.750539+0000","last_became_peered":"2024-05-14T09:40:45.750539+0000","last_unstale":"2024-05-14T09:41:04.205238+0000","last_undegraded":"2024-05-14T09:41:04.205238+0000","last_fullsized":"2024-05-14T09:41:04.205238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:42.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247645+0000","last_change":"2024-05-14T09:40:43.122483+0000","last_active":"2024-05-14T09:41:04.247645+0000","last_peered":"2024-05-14T09:41:04.247645+0000","last_clean":"2024-05-14T09:41:04.247645+0000","last_became_active":"2024-05-14T09:40:43.121427+0000","last_became_peered":"2024-05-14T09:40:43.121427+0000","last_unstale":"2024-05-14T09:41:04.247645+0000","last_undegraded":"2024-05-14T09:41:04.247645+0000","last_fullsized":"2024-05-14T09:41:04.247645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:31.384470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203609+0000","last_change":"2024-05-14T09:40:53.656157+0000","last_active":"2024-05-14T09:41:04.203609+0000","last_peered":"2024-05-14T09:41:04.203609+0000","last_clean":"2024-05-14T09:41:04.203609+0000","last_became_active":"2024-05-14T09:40:53.655141+0000","last_became_peered":"2024-05-14T09:40:53.655141+0000","last_unstale":"2024-05-14T09:41:04.203609+0000","last_undegraded":"2024-05-14T09:41:04.203609+0000","last_fullsized":"2024-05-14T09:41:04.203609+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611389+0000","last_change":"2024-05-14T09:40:45.778555+0000","last_active":"2024-05-14T09:41:04.611389+0000","last_peered":"2024-05-14T09:41:04.611389+0000","last_clean":"2024-05-14T09:41:04.611389+0000","last_became_active":"2024-05-14T09:40:45.776967+0000","last_became_peered":"2024-05-14T09:40:45.776967+0000","last_unstale":"2024-05-14T09:41:04.611389+0000","last_undegraded":"2024-05-14T09:41:04.611389+0000","last_fullsized":"2024-05-14T09:41:04.611389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:45:35.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211879+0000","last_change":"2024-05-14T09:40:43.043359+0000","last_active":"2024-05-14T09:41:04.211879+0000","last_peered":"2024-05-14T09:41:04.211879+0000","last_clean":"2024-05-14T09:41:04.211879+0000","last_became_active":"2024-05-14T09:40:43.042486+0000","last_became_peered":"2024-05-14T09:40:43.042486+0000","last_unstale":"2024-05-14T09:41:04.211879+0000","last_undegraded":"2024-05-14T09:41:04.211879+0000","last_fullsized":"2024-05-14T09:41:04.211879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:15.480365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203108+0000","last_change":"2024-05-14T09:40:53.662719+0000","last_active":"2024-05-14T09:41:04.203108+0000","last_peered":"2024-05-14T09:41:04.203108+0000","last_clean":"2024-05-14T09:41:04.203108+0000","last_became_active":"2024-05-14T09:40:53.660933+0000","last_became_peered":"2024-05-14T09:40:53.660933+0000","last_unstale":"2024-05-14T09:41:04.203108+0000","last_undegraded":"2024-05-14T09:41:04.203108+0000","last_fullsized":"2024-05-14T09:41:04.203108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:02.584358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610643+0000","last_change":"2024-05-14T09:40:45.776336+0000","last_active":"2024-05-14T09:41:04.610643+0000","last_peered":"2024-05-14T09:41:04.610643+0000","last_clean":"2024-05-14T09:41:04.610643+0000","last_became_active":"2024-05-14T09:40:45.775936+0000","last_became_peered":"2024-05-14T09:40:45.775936+0000","last_unstale":"2024-05-14T09:41:04.610643+0000","last_undegraded":"2024-05-14T09:41:04.610643+0000","last_fullsized":"2024-05-14T09:41:04.610643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:59.300900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.194627+0000","last_change":"2024-05-14T09:40:43.124714+0000","last_active":"2024-05-14T09:41:04.194627+0000","last_peered":"2024-05-14T09:41:04.194627+0000","last_clean":"2024-05-14T09:41:04.194627+0000","last_became_active":"2024-05-14T09:40:43.124370+0000","last_became_peered":"2024-05-14T09:40:43.124370+0000","last_unstale":"2024-05-14T09:41:04.194627+0000","last_undegraded":"2024-05-14T09:41:04.194627+0000","last_fullsized":"2024-05-14T09:41:04.194627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:52.132214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195468+0000","last_change":"2024-05-14T09:40:53.667102+0000","last_active":"2024-05-14T09:41:04.195468+0000","last_peered":"2024-05-14T09:41:04.195468+0000","last_clean":"2024-05-14T09:41:04.195468+0000","last_became_active":"2024-05-14T09:40:53.666666+0000","last_became_peered":"2024-05-14T09:40:53.666666+0000","last_unstale":"2024-05-14T09:41:04.195468+0000","last_undegraded":"2024-05-14T09:41:04.195468+0000","last_fullsized":"2024-05-14T09:41:04.195468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609479+0000","last_change":"2024-05-14T09:40:45.777251+0000","last_active":"2024-05-14T09:41:04.609479+0000","last_peered":"2024-05-14T09:41:04.609479+0000","last_clean":"2024-05-14T09:41:04.609479+0000","last_became_active":"2024-05-14T09:40:45.775668+0000","last_became_peered":"2024-05-14T09:40:45.775668+0000","last_unstale":"2024-05-14T09:41:04.609479+0000","last_undegraded":"2024-05-14T09:41:04.609479+0000","last_fullsized":"2024-05-14T09:41:04.609479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:54.917354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.210496+0000","last_change":"2024-05-14T09:40:43.040000+0000","last_active":"2024-05-14T09:41:04.210496+0000","last_peered":"2024-05-14T09:41:04.210496+0000","last_clean":"2024-05-14T09:41:04.210496+0000","last_became_active":"2024-05-14T09:40:43.039186+0000","last_became_peered":"2024-05-14T09:40:43.039186+0000","last_unstale":"2024-05-14T09:41:04.210496+0000","last_undegraded":"2024-05-14T09:41:04.210496+0000","last_fullsized":"2024-05-14T09:41:04.210496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:41:44.514114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204660+0000","last_change":"2024-05-14T09:40:53.667056+0000","last_active":"2024-05-14T09:41:04.204660+0000","last_peered":"2024-05-14T09:41:04.204660+0000","last_clean":"2024-05-14T09:41:04.204660+0000","last_became_active":"2024-05-14T09:40:53.666575+0000","last_became_peered":"2024-05-14T09:40:53.666575+0000","last_unstale":"2024-05-14T09:41:04.204660+0000","last_undegraded":"2024-05-14T09:41:04.204660+0000","last_fullsized":"2024-05-14T09:41:04.204660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594614+0000","last_change":"2024-05-14T09:40:45.754466+0000","last_active":"2024-05-14T09:41:04.594614+0000","last_peered":"2024-05-14T09:41:04.594614+0000","last_clean":"2024-05-14T09:41:04.594614+0000","last_became_active":"2024-05-14T09:40:45.753839+0000","last_became_peered":"2024-05-14T09:40:45.753839+0000","last_unstale":"2024-05-14T09:41:04.594614+0000","last_undegraded":"2024-05-14T09:41:04.594614+0000","last_fullsized":"2024-05-14T09:41:04.594614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595070+0000","last_change":"2024-05-14T09:40:43.121744+0000","last_active":"2024-05-14T09:41:04.595070+0000","last_peered":"2024-05-14T09:41:04.595070+0000","last_clean":"2024-05-14T09:41:04.595070+0000","last_became_active":"2024-05-14T09:40:43.121388+0000","last_became_peered":"2024-05-14T09:40:43.121388+0000","last_unstale":"2024-05-14T09:41:04.595070+0000","last_undegraded":"2024-05-14T09:41:04.595070+0000","last_fullsized":"2024-05-14T09:41:04.595070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198145+0000","last_change":"2024-05-14T09:40:53.659658+0000","last_active":"2024-05-14T09:41:04.198145+0000","last_peered":"2024-05-14T09:41:04.198145+0000","last_clean":"2024-05-14T09:41:04.198145+0000","last_became_active":"2024-05-14T09:40:53.659191+0000","last_became_peered":"2024-05-14T09:40:53.659191+0000","last_unstale":"2024-05-14T09:41:04.198145+0000","last_undegraded":"2024-05-14T09:41:04.198145+0000","last_fullsized":"2024-05-14T09:41:04.198145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:15:39.587593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609972+0000","last_change":"2024-05-14T09:40:45.776748+0000","last_active":"2024-05-14T09:41:04.609972+0000","last_peered":"2024-05-14T09:41:04.609972+0000","last_clean":"2024-05-14T09:41:04.609972+0000","last_became_active":"2024-05-14T09:40:45.776451+0000","last_became_peered":"2024-05-14T09:40:45.776451+0000","last_unstale":"2024-05-14T09:41:04.609972+0000","last_undegraded":"2024-05-14T09:41:04.609972+0000","last_fullsized":"2024-05-14T09:41:04.609972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:39.890407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.545190+0000","last_change":"2024-05-14T09:40:43.086185+0000","last_active":"2024-05-14T09:41:27.545190+0000","last_peered":"2024-05-14T09:41:27.545190+0000","last_clean":"2024-05-14T09:41:27.545190+0000","last_became_active":"2024-05-14T09:40:43.085320+0000","last_became_peered":"2024-05-14T09:40:43.085320+0000","last_unstale":"2024-05-14T09:41:27.545190+0000","last_undegraded":"2024-05-14T09:41:27.545190+0000","last_fullsized":"2024-05-14T09:41:27.545190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:26:22.301593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196812+0000","last_change":"2024-05-14T09:40:53.673710+0000","last_active":"2024-05-14T09:41:04.196812+0000","last_peered":"2024-05-14T09:41:04.196812+0000","last_clean":"2024-05-14T09:41:04.196812+0000","last_became_active":"2024-05-14T09:40:53.672089+0000","last_became_peered":"2024-05-14T09:40:53.672089+0000","last_unstale":"2024-05-14T09:41:04.196812+0000","last_undegraded":"2024-05-14T09:41:04.196812+0000","last_fullsized":"2024-05-14T09:41:04.196812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:48:16.697615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205653+0000","last_change":"2024-05-14T09:40:45.767220+0000","last_active":"2024-05-14T09:41:04.205653+0000","last_peered":"2024-05-14T09:41:04.205653+0000","last_clean":"2024-05-14T09:41:04.205653+0000","last_became_active":"2024-05-14T09:40:45.766895+0000","last_became_peered":"2024-05-14T09:40:45.766895+0000","last_unstale":"2024-05-14T09:41:04.205653+0000","last_undegraded":"2024-05-14T09:41:04.205653+0000","last_fullsized":"2024-05-14T09:41:04.205653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204057+0000","last_change":"2024-05-14T09:40:43.124937+0000","last_active":"2024-05-14T09:41:04.204057+0000","last_peered":"2024-05-14T09:41:04.204057+0000","last_clean":"2024-05-14T09:41:04.204057+0000","last_became_active":"2024-05-14T09:40:43.124129+0000","last_became_peered":"2024-05-14T09:40:43.124129+0000","last_unstale":"2024-05-14T09:41:04.204057+0000","last_undegraded":"2024-05-14T09:41:04.204057+0000","last_fullsized":"2024-05-14T09:41:04.204057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205748+0000","last_change":"2024-05-14T09:40:53.664722+0000","last_active":"2024-05-14T09:41:04.205748+0000","last_peered":"2024-05-14T09:41:04.205748+0000","last_clean":"2024-05-14T09:41:04.205748+0000","last_became_active":"2024-05-14T09:40:53.664194+0000","last_became_peered":"2024-05-14T09:40:53.664194+0000","last_unstale":"2024-05-14T09:41:04.205748+0000","last_undegraded":"2024-05-14T09:41:04.205748+0000","last_fullsized":"2024-05-14T09:41:04.205748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:35:57.826557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610449+0000","last_change":"2024-05-14T09:40:45.770662+0000","last_active":"2024-05-14T09:41:04.610449+0000","last_peered":"2024-05-14T09:41:04.610449+0000","last_clean":"2024-05-14T09:41:04.610449+0000","last_became_active":"2024-05-14T09:40:45.768058+0000","last_became_peered":"2024-05-14T09:40:45.768058+0000","last_unstale":"2024-05-14T09:41:04.610449+0000","last_undegraded":"2024-05-14T09:41:04.610449+0000","last_fullsized":"2024-05-14T09:41:04.610449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:13.296625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'10","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:10.610068+0000","last_change":"2024-05-14T09:40:43.113989+0000","last_active":"2024-05-14T09:41:10.610068+0000","last_peered":"2024-05-14T09:41:10.610068+0000","last_clean":"2024-05-14T09:41:10.610068+0000","last_became_active":"2024-05-14T09:40:43.113589+0000","last_became_peered":"2024-05-14T09:40:43.113589+0000","last_unstale":"2024-05-14T09:41:10.610068+0000","last_undegraded":"2024-05-14T09:41:10.610068+0000","last_fullsized":"2024-05-14T09:41:10.610068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:42:17.351523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.246643+0000","last_change":"2024-05-14T09:40:53.663887+0000","last_active":"2024-05-14T09:41:04.246643+0000","last_peered":"2024-05-14T09:41:04.246643+0000","last_clean":"2024-05-14T09:41:04.246643+0000","last_became_active":"2024-05-14T09:40:53.663419+0000","last_became_peered":"2024-05-14T09:40:53.663419+0000","last_unstale":"2024-05-14T09:41:04.246643+0000","last_undegraded":"2024-05-14T09:41:04.246643+0000","last_fullsized":"2024-05-14T09:41:04.246643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:18.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196203+0000","last_change":"2024-05-14T09:40:45.767184+0000","last_active":"2024-05-14T09:41:04.196203+0000","last_peered":"2024-05-14T09:41:04.196203+0000","last_clean":"2024-05-14T09:41:04.196203+0000","last_became_active":"2024-05-14T09:40:45.766784+0000","last_became_peered":"2024-05-14T09:40:45.766784+0000","last_unstale":"2024-05-14T09:41:04.196203+0000","last_undegraded":"2024-05-14T09:41:04.196203+0000","last_fullsized":"2024-05-14T09:41:04.196203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247559+0000","last_change":"2024-05-14T09:40:43.089869+0000","last_active":"2024-05-14T09:41:04.247559+0000","last_peered":"2024-05-14T09:41:04.247559+0000","last_clean":"2024-05-14T09:41:04.247559+0000","last_became_active":"2024-05-14T09:40:43.088906+0000","last_became_peered":"2024-05-14T09:40:43.088906+0000","last_unstale":"2024-05-14T09:41:04.247559+0000","last_undegraded":"2024-05-14T09:41:04.247559+0000","last_fullsized":"2024-05-14T09:41:04.247559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:28.223322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193385+0000","last_change":"2024-05-14T09:40:53.667412+0000","last_active":"2024-05-14T09:41:04.193385+0000","last_peered":"2024-05-14T09:41:04.193385+0000","last_clean":"2024-05-14T09:41:04.193385+0000","last_became_active":"2024-05-14T09:40:53.666533+0000","last_became_peered":"2024-05-14T09:40:53.666533+0000","last_unstale":"2024-05-14T09:41:04.193385+0000","last_undegraded":"2024-05-14T09:41:04.193385+0000","last_fullsized":"2024-05-14T09:41:04.193385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:53:41.310701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.250664+0000","last_change":"2024-05-14T09:41:04.250664+0000","last_active":"2024-05-14T09:41:04.250664+0000","last_peered":"2024-05-14T09:41:04.250664+0000","last_clean":"2024-05-14T09:41:04.250664+0000","last_became_active":"2024-05-14T09:41:04.250043+0000","last_became_peered":"2024-05-14T09:41:04.250043+0000","last_unstale":"2024-05-14T09:41:04.250664+0000","last_undegraded":"2024-05-14T09:41:04.250664+0000","last_fullsized":"2024-05-14T09:41:04.250664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:46:49.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.542416+0000","last_change":"2024-05-14T09:40:43.116130+0000","last_active":"2024-05-14T09:41:27.542416+0000","last_peered":"2024-05-14T09:41:27.542416+0000","last_clean":"2024-05-14T09:41:27.542416+0000","last_became_active":"2024-05-14T09:40:43.115741+0000","last_became_peered":"2024-05-14T09:40:43.115741+0000","last_unstale":"2024-05-14T09:41:27.542416+0000","last_undegraded":"2024-05-14T09:41:27.542416+0000","last_fullsized":"2024-05-14T09:41:27.542416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:35.083285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196132+0000","last_change":"2024-05-14T09:40:53.667088+0000","last_active":"2024-05-14T09:41:04.196132+0000","last_peered":"2024-05-14T09:41:04.196132+0000","last_clean":"2024-05-14T09:41:04.196132+0000","last_became_active":"2024-05-14T09:40:53.662581+0000","last_became_peered":"2024-05-14T09:40:53.662581+0000","last_unstale":"2024-05-14T09:41:04.196132+0000","last_undegraded":"2024-05-14T09:41:04.196132+0000","last_fullsized":"2024-05-14T09:41:04.196132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:14:18.824424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204868+0000","last_change":"2024-05-14T09:40:45.774302+0000","last_active":"2024-05-14T09:41:04.204868+0000","last_peered":"2024-05-14T09:41:04.204868+0000","last_clean":"2024-05-14T09:41:04.204868+0000","last_became_active":"2024-05-14T09:40:45.773879+0000","last_became_peered":"2024-05-14T09:40:45.773879+0000","last_unstale":"2024-05-14T09:41:04.204868+0000","last_undegraded":"2024-05-14T09:41:04.204868+0000","last_fullsized":"2024-05-14T09:41:04.204868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:09.921679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596540+0000","last_change":"2024-05-14T09:40:43.116616+0000","last_active":"2024-05-14T09:41:04.596540+0000","last_peered":"2024-05-14T09:41:04.596540+0000","last_clean":"2024-05-14T09:41:04.596540+0000","last_became_active":"2024-05-14T09:40:43.115166+0000","last_became_peered":"2024-05-14T09:40:43.115166+0000","last_unstale":"2024-05-14T09:41:04.596540+0000","last_undegraded":"2024-05-14T09:41:04.596540+0000","last_fullsized":"2024-05-14T09:41:04.596540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:52.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196032+0000","last_change":"2024-05-14T09:40:53.668423+0000","last_active":"2024-05-14T09:41:04.196032+0000","last_peered":"2024-05-14T09:41:04.196032+0000","last_clean":"2024-05-14T09:41:04.196032+0000","last_became_active":"2024-05-14T09:40:53.664838+0000","last_became_peered":"2024-05-14T09:40:53.664838+0000","last_unstale":"2024-05-14T09:41:04.196032+0000","last_undegraded":"2024-05-14T09:41:04.196032+0000","last_fullsized":"2024-05-14T09:41:04.196032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:00:35.633754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204241+0000","last_change":"2024-05-14T09:40:53.656095+0000","last_active":"2024-05-14T09:41:04.204241+0000","last_peered":"2024-05-14T09:41:04.204241+0000","last_clean":"2024-05-14T09:41:04.204241+0000","last_became_active":"2024-05-14T09:40:53.655439+0000","last_became_peered":"2024-05-14T09:40:53.655439+0000","last_unstale":"2024-05-14T09:41:04.204241+0000","last_undegraded":"2024-05-14T09:41:04.204241+0000","last_fullsized":"2024-05-14T09:41:04.204241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:44.521319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245578+0000","last_change":"2024-05-14T09:40:45.744447+0000","last_active":"2024-05-14T09:41:04.245578+0000","last_peered":"2024-05-14T09:41:04.245578+0000","last_clean":"2024-05-14T09:41:04.245578+0000","last_became_active":"2024-05-14T09:40:45.743611+0000","last_became_peered":"2024-05-14T09:40:45.743611+0000","last_unstale":"2024-05-14T09:41:04.245578+0000","last_undegraded":"2024-05-14T09:41:04.245578+0000","last_fullsized":"2024-05-14T09:41:04.245578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:56.519183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203943+0000","last_change":"2024-05-14T09:40:43.122005+0000","last_active":"2024-05-14T09:41:04.203943+0000","last_peered":"2024-05-14T09:41:04.203943+0000","last_clean":"2024-05-14T09:41:04.203943+0000","last_became_active":"2024-05-14T09:40:43.121629+0000","last_became_peered":"2024-05-14T09:40:43.121629+0000","last_unstale":"2024-05-14T09:41:04.203943+0000","last_undegraded":"2024-05-14T09:41:04.203943+0000","last_fullsized":"2024-05-14T09:41:04.203943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:31:03.016812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596267+0000","last_change":"2024-05-14T09:40:53.679415+0000","last_active":"2024-05-14T09:41:04.596267+0000","last_peered":"2024-05-14T09:41:04.596267+0000","last_clean":"2024-05-14T09:41:04.596267+0000","last_became_active":"2024-05-14T09:40:53.678851+0000","last_became_peered":"2024-05-14T09:40:53.678851+0000","last_unstale":"2024-05-14T09:41:04.596267+0000","last_undegraded":"2024-05-14T09:41:04.596267+0000","last_fullsized":"2024-05-14T09:41:04.596267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:48.049763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196225+0000","last_change":"2024-05-14T09:40:45.743111+0000","last_active":"2024-05-14T09:41:04.196225+0000","last_peered":"2024-05-14T09:41:04.196225+0000","last_clean":"2024-05-14T09:41:04.196225+0000","last_became_active":"2024-05-14T09:40:45.742702+0000","last_became_peered":"2024-05-14T09:40:45.742702+0000","last_unstale":"2024-05-14T09:41:04.196225+0000","last_undegraded":"2024-05-14T09:41:04.196225+0000","last_fullsized":"2024-05-14T09:41:04.196225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:17:39.673477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196692+0000","last_change":"2024-05-14T09:40:43.116535+0000","last_active":"2024-05-14T09:41:04.196692+0000","last_peered":"2024-05-14T09:41:04.196692+0000","last_clean":"2024-05-14T09:41:04.196692+0000","last_became_active":"2024-05-14T09:40:43.115860+0000","last_became_peered":"2024-05-14T09:40:43.115860+0000","last_unstale":"2024-05-14T09:41:04.196692+0000","last_undegraded":"2024-05-14T09:41:04.196692+0000","last_fullsized":"2024-05-14T09:41:04.196692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596150+0000","last_change":"2024-05-14T09:40:43.120700+0000","last_active":"2024-05-14T09:41:04.596150+0000","last_peered":"2024-05-14T09:41:04.596150+0000","last_clean":"2024-05-14T09:41:04.596150+0000","last_became_active":"2024-05-14T09:40:43.120353+0000","last_became_peered":"2024-05-14T09:40:43.120353+0000","last_unstale":"2024-05-14T09:41:04.596150+0000","last_undegraded":"2024-05-14T09:41:04.596150+0000","last_fullsized":"2024-05-14T09:41:04.596150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:35.425012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203768+0000","last_change":"2024-05-14T09:40:45.758385+0000","last_active":"2024-05-14T09:41:04.203768+0000","last_peered":"2024-05-14T09:41:04.203768+0000","last_clean":"2024-05-14T09:41:04.203768+0000","last_became_active":"2024-05-14T09:40:45.758017+0000","last_became_peered":"2024-05-14T09:40:45.758017+0000","last_unstale":"2024-05-14T09:41:04.203768+0000","last_undegraded":"2024-05-14T09:41:04.203768+0000","last_fullsized":"2024-05-14T09:41:04.203768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.210781+0000","last_change":"2024-05-14T09:40:53.671995+0000","last_active":"2024-05-14T09:41:04.210781+0000","last_peered":"2024-05-14T09:41:04.210781+0000","last_clean":"2024-05-14T09:41:04.210781+0000","last_became_active":"2024-05-14T09:40:53.671145+0000","last_became_peered":"2024-05-14T09:40:53.671145+0000","last_unstale":"2024-05-14T09:41:04.210781+0000","last_undegraded":"2024-05-14T09:41:04.210781+0000","last_fullsized":"2024-05-14T09:41:04.210781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:02.991096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197691+0000","last_change":"2024-05-14T09:40:43.105812+0000","last_active":"2024-05-14T09:41:04.197691+0000","last_peered":"2024-05-14T09:41:04.197691+0000","last_clean":"2024-05-14T09:41:04.197691+0000","last_became_active":"2024-05-14T09:40:43.104821+0000","last_became_peered":"2024-05-14T09:40:43.104821+0000","last_unstale":"2024-05-14T09:41:04.197691+0000","last_undegraded":"2024-05-14T09:41:04.197691+0000","last_fullsized":"2024-05-14T09:41:04.197691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193448+0000","last_change":"2024-05-14T09:40:45.746294+0000","last_active":"2024-05-14T09:41:04.193448+0000","last_peered":"2024-05-14T09:41:04.193448+0000","last_clean":"2024-05-14T09:41:04.193448+0000","last_became_active":"2024-05-14T09:40:45.745850+0000","last_became_peered":"2024-05-14T09:40:45.745850+0000","last_unstale":"2024-05-14T09:41:04.193448+0000","last_undegraded":"2024-05-14T09:41:04.193448+0000","last_fullsized":"2024-05-14T09:41:04.193448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:17.774486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197287+0000","last_change":"2024-05-14T09:40:53.670990+0000","last_active":"2024-05-14T09:41:04.197287+0000","last_peered":"2024-05-14T09:41:04.197287+0000","last_clean":"2024-05-14T09:41:04.197287+0000","last_became_active":"2024-05-14T09:40:53.669094+0000","last_became_peered":"2024-05-14T09:40:53.669094+0000","last_unstale":"2024-05-14T09:41:04.197287+0000","last_undegraded":"2024-05-14T09:41:04.197287+0000","last_fullsized":"2024-05-14T09:41:04.197287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:35:15.483140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594603+0000","last_change":"2024-05-14T09:40:45.754615+0000","last_active":"2024-05-14T09:41:04.594603+0000","last_peered":"2024-05-14T09:41:04.594603+0000","last_clean":"2024-05-14T09:41:04.594603+0000","last_became_active":"2024-05-14T09:40:45.754283+0000","last_became_peered":"2024-05-14T09:40:45.754283+0000","last_unstale":"2024-05-14T09:41:04.594603+0000","last_undegraded":"2024-05-14T09:41:04.594603+0000","last_fullsized":"2024-05-14T09:41:04.594603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211227+0000","last_change":"2024-05-14T09:40:45.753218+0000","last_active":"2024-05-14T09:41:04.211227+0000","last_peered":"2024-05-14T09:41:04.211227+0000","last_clean":"2024-05-14T09:41:04.211227+0000","last_became_active":"2024-05-14T09:40:45.752599+0000","last_became_peered":"2024-05-14T09:40:45.752599+0000","last_unstale":"2024-05-14T09:41:04.211227+0000","last_undegraded":"2024-05-14T09:41:04.211227+0000","last_fullsized":"2024-05-14T09:41:04.211227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205092+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T09:41:04.205092+0000","last_peered":"2024-05-14T09:41:04.205092+0000","last_clean":"2024-05-14T09:41:04.205092+0000","last_became_active":"2024-05-14T09:40:45.750387+0000","last_became_peered":"2024-05-14T09:40:45.750387+0000","last_unstale":"2024-05-14T09:41:04.205092+0000","last_undegraded":"2024-05-14T09:41:04.205092+0000","last_fullsized":"2024-05-14T09:41:04.205092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:54.689111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.251002+0000","last_change":"2024-05-14T09:41:04.251002+0000","last_active":"2024-05-14T09:41:04.251002+0000","last_peered":"2024-05-14T09:41:04.251002+0000","last_clean":"2024-05-14T09:41:04.251002+0000","last_became_active":"2024-05-14T09:41:04.250037+0000","last_became_peered":"2024-05-14T09:41:04.250037+0000","last_unstale":"2024-05-14T09:41:04.251002+0000","last_undegraded":"2024-05-14T09:41:04.251002+0000","last_fullsized":"2024-05-14T09:41:04.251002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:42:35.669137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197833+0000","last_change":"2024-05-14T09:40:45.723956+0000","last_active":"2024-05-14T09:41:04.197833+0000","last_peered":"2024-05-14T09:41:04.197833+0000","last_clean":"2024-05-14T09:41:04.197833+0000","last_became_active":"2024-05-14T09:40:45.723040+0000","last_became_peered":"2024-05-14T09:40:45.723040+0000","last_unstale":"2024-05-14T09:41:04.197833+0000","last_undegraded":"2024-05-14T09:41:04.197833+0000","last_fullsized":"2024-05-14T09:41:04.197833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:45.690725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247145+0000","last_change":"2024-05-14T09:40:45.746942+0000","last_active":"2024-05-14T09:41:04.247145+0000","last_peered":"2024-05-14T09:41:04.247145+0000","last_clean":"2024-05-14T09:41:04.247145+0000","last_became_active":"2024-05-14T09:40:45.745393+0000","last_became_peered":"2024-05-14T09:40:45.745393+0000","last_unstale":"2024-05-14T09:41:04.247145+0000","last_undegraded":"2024-05-14T09:41:04.247145+0000","last_fullsized":"2024-05-14T09:41:04.247145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:37.377406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595966+0000","last_change":"2024-05-14T09:40:45.772238+0000","last_active":"2024-05-14T09:41:04.595966+0000","last_peered":"2024-05-14T09:41:04.595966+0000","last_clean":"2024-05-14T09:41:04.595966+0000","last_became_active":"2024-05-14T09:40:45.771838+0000","last_became_peered":"2024-05-14T09:40:45.771838+0000","last_unstale":"2024-05-14T09:41:04.595966+0000","last_undegraded":"2024-05-14T09:41:04.595966+0000","last_fullsized":"2024-05-14T09:41:04.595966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198586+0000","last_change":"2024-05-14T09:40:45.727770+0000","last_active":"2024-05-14T09:41:04.198586+0000","last_peered":"2024-05-14T09:41:04.198586+0000","last_clean":"2024-05-14T09:41:04.198586+0000","last_became_active":"2024-05-14T09:40:45.725283+0000","last_became_peered":"2024-05-14T09:40:45.725283+0000","last_unstale":"2024-05-14T09:41:04.198586+0000","last_undegraded":"2024-05-14T09:41:04.198586+0000","last_fullsized":"2024-05-14T09:41:04.198586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:22.638700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203472+0000","last_change":"2024-05-14T09:40:45.749288+0000","last_active":"2024-05-14T09:41:04.203472+0000","last_peered":"2024-05-14T09:41:04.203472+0000","last_clean":"2024-05-14T09:41:04.203472+0000","last_became_active":"2024-05-14T09:40:45.748925+0000","last_became_peered":"2024-05-14T09:40:45.748925+0000","last_unstale":"2024-05-14T09:41:04.203472+0000","last_undegraded":"2024-05-14T09:41:04.203472+0000","last_fullsized":"2024-05-14T09:41:04.203472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:03.576418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196797+0000","last_change":"2024-05-14T09:40:45.724197+0000","last_active":"2024-05-14T09:41:04.196797+0000","last_peered":"2024-05-14T09:41:04.196797+0000","last_clean":"2024-05-14T09:41:04.196797+0000","last_became_active":"2024-05-14T09:40:45.723317+0000","last_became_peered":"2024-05-14T09:40:45.723317+0000","last_unstale":"2024-05-14T09:41:04.196797+0000","last_undegraded":"2024-05-14T09:41:04.196797+0000","last_fullsized":"2024-05-14T09:41:04.196797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204963+0000","last_change":"2024-05-14T09:40:45.770723+0000","last_active":"2024-05-14T09:41:04.204963+0000","last_peered":"2024-05-14T09:41:04.204963+0000","last_clean":"2024-05-14T09:41:04.204963+0000","last_became_active":"2024-05-14T09:40:45.769772+0000","last_became_peered":"2024-05-14T09:40:45.769772+0000","last_unstale":"2024-05-14T09:41:04.204963+0000","last_undegraded":"2024-05-14T09:41:04.204963+0000","last_fullsized":"2024-05-14T09:41:04.204963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:44.852533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203481+0000","last_change":"2024-05-14T09:40:45.766217+0000","last_active":"2024-05-14T09:41:04.203481+0000","last_peered":"2024-05-14T09:41:04.203481+0000","last_clean":"2024-05-14T09:41:04.203481+0000","last_became_active":"2024-05-14T09:40:45.765830+0000","last_became_peered":"2024-05-14T09:40:45.765830+0000","last_unstale":"2024-05-14T09:41:04.203481+0000","last_undegraded":"2024-05-14T09:41:04.203481+0000","last_fullsized":"2024-05-14T09:41:04.203481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594937+0000","last_change":"2024-05-14T09:40:45.760838+0000","last_active":"2024-05-14T09:41:04.594937+0000","last_peered":"2024-05-14T09:41:04.594937+0000","last_clean":"2024-05-14T09:41:04.594937+0000","last_became_active":"2024-05-14T09:40:45.760535+0000","last_became_peered":"2024-05-14T09:40:45.760535+0000","last_unstale":"2024-05-14T09:41:04.594937+0000","last_undegraded":"2024-05-14T09:41:04.594937+0000","last_fullsized":"2024-05-14T09:41:04.594937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610853+0000","last_change":"2024-05-14T09:40:45.778218+0000","last_active":"2024-05-14T09:41:04.610853+0000","last_peered":"2024-05-14T09:41:04.610853+0000","last_clean":"2024-05-14T09:41:04.610853+0000","last_became_active":"2024-05-14T09:40:45.775602+0000","last_became_peered":"2024-05-14T09:40:45.775602+0000","last_unstale":"2024-05-14T09:41:04.610853+0000","last_undegraded":"2024-05-14T09:41:04.610853+0000","last_fullsized":"2024-05-14T09:41:04.610853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:40.574917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211569+0000","last_change":"2024-05-14T09:40:45.748996+0000","last_active":"2024-05-14T09:41:04.211569+0000","last_peered":"2024-05-14T09:41:04.211569+0000","last_clean":"2024-05-14T09:41:04.211569+0000","last_became_active":"2024-05-14T09:40:45.748266+0000","last_became_peered":"2024-05-14T09:40:45.748266+0000","last_unstale":"2024-05-14T09:41:04.211569+0000","last_undegraded":"2024-05-14T09:41:04.211569+0000","last_fullsized":"2024-05-14T09:41:04.211569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.615498+0000","last_change":"2024-05-14T09:41:04.613266+0000","last_active":"2024-05-14T09:41:04.615498+0000","last_peered":"2024-05-14T09:41:04.615498+0000","last_clean":"2024-05-14T09:41:04.615498+0000","last_became_active":"2024-05-14T09:41:04.612160+0000","last_became_peered":"2024-05-14T09:41:04.612160+0000","last_unstale":"2024-05-14T09:41:04.615498+0000","last_undegraded":"2024-05-14T09:41:04.615498+0000","last_fullsized":"2024-05-14T09:41:04.615498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203375+0000","last_change":"2024-05-14T09:40:45.757279+0000","last_active":"2024-05-14T09:41:04.203375+0000","last_peered":"2024-05-14T09:41:04.203375+0000","last_clean":"2024-05-14T09:41:04.203375+0000","last_became_active":"2024-05-14T09:40:45.749692+0000","last_became_peered":"2024-05-14T09:40:45.749692+0000","last_unstale":"2024-05-14T09:41:04.203375+0000","last_undegraded":"2024-05-14T09:41:04.203375+0000","last_fullsized":"2024-05-14T09:41:04.203375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:39:52.486187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245774+0000","last_change":"2024-05-14T09:40:45.744802+0000","last_active":"2024-05-14T09:41:04.245774+0000","last_peered":"2024-05-14T09:41:04.245774+0000","last_clean":"2024-05-14T09:41:04.245774+0000","last_became_active":"2024-05-14T09:40:45.744011+0000","last_became_peered":"2024-05-14T09:40:45.744011+0000","last_unstale":"2024-05-14T09:41:04.245774+0000","last_undegraded":"2024-05-14T09:41:04.245774+0000","last_fullsized":"2024-05-14T09:41:04.245774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:20.468216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205334+0000","last_change":"2024-05-14T09:40:45.757983+0000","last_active":"2024-05-14T09:41:04.205334+0000","last_peered":"2024-05-14T09:41:04.205334+0000","last_clean":"2024-05-14T09:41:04.205334+0000","last_became_active":"2024-05-14T09:40:45.757450+0000","last_became_peered":"2024-05-14T09:40:45.757450+0000","last_unstale":"2024-05-14T09:41:04.205334+0000","last_undegraded":"2024-05-14T09:41:04.205334+0000","last_fullsized":"2024-05-14T09:41:04.205334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:07.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197114+0000","last_change":"2024-05-14T09:40:45.745021+0000","last_active":"2024-05-14T09:41:04.197114+0000","last_peered":"2024-05-14T09:41:04.197114+0000","last_clean":"2024-05-14T09:41:04.197114+0000","last_became_active":"2024-05-14T09:40:45.744550+0000","last_became_peered":"2024-05-14T09:40:45.744550+0000","last_unstale":"2024-05-14T09:41:04.197114+0000","last_undegraded":"2024-05-14T09:41:04.197114+0000","last_fullsized":"2024-05-14T09:41:04.197114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195987+0000","last_change":"2024-05-14T09:40:45.749109+0000","last_active":"2024-05-14T09:41:04.195987+0000","last_peered":"2024-05-14T09:41:04.195987+0000","last_clean":"2024-05-14T09:41:04.195987+0000","last_became_active":"2024-05-14T09:40:45.748419+0000","last_became_peered":"2024-05-14T09:40:45.748419+0000","last_unstale":"2024-05-14T09:41:04.195987+0000","last_undegraded":"2024-05-14T09:41:04.195987+0000","last_fullsized":"2024-05-14T09:41:04.195987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.597196+0000","last_change":"2024-05-14T09:40:45.753508+0000","last_active":"2024-05-14T09:41:04.597196+0000","last_peered":"2024-05-14T09:41:04.597196+0000","last_clean":"2024-05-14T09:41:04.597196+0000","last_became_active":"2024-05-14T09:40:45.752982+0000","last_became_peered":"2024-05-14T09:40:45.752982+0000","last_unstale":"2024-05-14T09:41:04.597196+0000","last_undegraded":"2024-05-14T09:41:04.597196+0000","last_fullsized":"2024-05-14T09:41:04.597196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595663+0000","last_change":"2024-05-14T09:40:45.759266+0000","last_active":"2024-05-14T09:41:04.595663+0000","last_peered":"2024-05-14T09:41:04.595663+0000","last_clean":"2024-05-14T09:41:04.595663+0000","last_became_active":"2024-05-14T09:40:45.758912+0000","last_became_peered":"2024-05-14T09:40:45.758912+0000","last_unstale":"2024-05-14T09:41:04.595663+0000","last_undegraded":"2024-05-14T09:41:04.595663+0000","last_fullsized":"2024-05-14T09:41:04.595663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611324+0000","last_change":"2024-05-14T09:40:45.780527+0000","last_active":"2024-05-14T09:41:04.611324+0000","last_peered":"2024-05-14T09:41:04.611324+0000","last_clean":"2024-05-14T09:41:04.611324+0000","last_became_active":"2024-05-14T09:40:45.780197+0000","last_became_peered":"2024-05-14T09:40:45.780197+0000","last_unstale":"2024-05-14T09:41:04.611324+0000","last_undegraded":"2024-05-14T09:41:04.611324+0000","last_fullsized":"2024-05-14T09:41:04.611324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:38.220230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195825+0000","last_change":"2024-05-14T09:40:45.761049+0000","last_active":"2024-05-14T09:41:04.195825+0000","last_peered":"2024-05-14T09:41:04.195825+0000","last_clean":"2024-05-14T09:41:04.195825+0000","last_became_active":"2024-05-14T09:40:45.760738+0000","last_became_peered":"2024-05-14T09:40:45.760738+0000","last_unstale":"2024-05-14T09:41:04.195825+0000","last_undegraded":"2024-05-14T09:41:04.195825+0000","last_fullsized":"2024-05-14T09:41:04.195825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609336+0000","last_change":"2024-05-14T09:40:45.776380+0000","last_active":"2024-05-14T09:41:04.609336+0000","last_peered":"2024-05-14T09:41:04.609336+0000","last_clean":"2024-05-14T09:41:04.609336+0000","last_became_active":"2024-05-14T09:40:45.776005+0000","last_became_peered":"2024-05-14T09:40:45.776005+0000","last_unstale":"2024-05-14T09:41:04.609336+0000","last_undegraded":"2024-05-14T09:41:04.609336+0000","last_fullsized":"2024-05-14T09:41:04.609336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:27.969792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.219398+0000","last_change":"2024-05-14T09:41:04.214552+0000","last_active":"2024-05-14T09:41:04.219398+0000","last_peered":"2024-05-14T09:41:04.219398+0000","last_clean":"2024-05-14T09:41:04.219398+0000","last_became_active":"2024-05-14T09:41:04.213721+0000","last_became_peered":"2024-05-14T09:41:04.213721+0000","last_unstale":"2024-05-14T09:41:04.219398+0000","last_undegraded":"2024-05-14T09:41:04.219398+0000","last_fullsized":"2024-05-14T09:41:04.219398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609591+0000","last_change":"2024-05-14T09:40:45.776955+0000","last_active":"2024-05-14T09:41:04.609591+0000","last_peered":"2024-05-14T09:41:04.609591+0000","last_clean":"2024-05-14T09:41:04.609591+0000","last_became_active":"2024-05-14T09:40:45.775953+0000","last_became_peered":"2024-05-14T09:40:45.775953+0000","last_unstale":"2024-05-14T09:41:04.609591+0000","last_undegraded":"2024-05-14T09:41:04.609591+0000","last_fullsized":"2024-05-14T09:41:04.609591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:13.534273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204293+0000","last_change":"2024-05-14T09:40:45.750766+0000","last_active":"2024-05-14T09:41:04.204293+0000","last_peered":"2024-05-14T09:41:04.204293+0000","last_clean":"2024-05-14T09:41:04.204293+0000","last_became_active":"2024-05-14T09:40:45.750416+0000","last_became_peered":"2024-05-14T09:40:45.750416+0000","last_unstale":"2024-05-14T09:41:04.204293+0000","last_undegraded":"2024-05-14T09:41:04.204293+0000","last_fullsized":"2024-05-14T09:41:04.204293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:29:30.022171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204845+0000","last_change":"2024-05-14T09:40:45.748573+0000","last_active":"2024-05-14T09:41:04.204845+0000","last_peered":"2024-05-14T09:41:04.204845+0000","last_clean":"2024-05-14T09:41:04.204845+0000","last_became_active":"2024-05-14T09:40:45.746640+0000","last_became_peered":"2024-05-14T09:40:45.746640+0000","last_unstale":"2024-05-14T09:41:04.204845+0000","last_undegraded":"2024-05-14T09:41:04.204845+0000","last_fullsized":"2024-05-14T09:41:04.204845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247941+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T09:41:04.247941+0000","last_peered":"2024-05-14T09:41:04.247941+0000","last_clean":"2024-05-14T09:41:04.247941+0000","last_became_active":"2024-05-14T09:40:45.752589+0000","last_became_peered":"2024-05-14T09:40:45.752589+0000","last_unstale":"2024-05-14T09:41:04.247941+0000","last_undegraded":"2024-05-14T09:41:04.247941+0000","last_fullsized":"2024-05-14T09:41:04.247941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:43.043120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611042+0000","last_change":"2024-05-14T09:40:45.771577+0000","last_active":"2024-05-14T09:41:04.611042+0000","last_peered":"2024-05-14T09:41:04.611042+0000","last_clean":"2024-05-14T09:41:04.611042+0000","last_became_active":"2024-05-14T09:40:45.771228+0000","last_became_peered":"2024-05-14T09:40:45.771228+0000","last_unstale":"2024-05-14T09:41:04.611042+0000","last_undegraded":"2024-05-14T09:41:04.611042+0000","last_fullsized":"2024-05-14T09:41:04.611042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:36.361964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5334,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":11358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476753,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":152445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476755,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":148729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":16,"seq":68719476756,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":152445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476752,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":148603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476752,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":739609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":966656,"data_stored":740287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":148693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":148763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T09:41:32.356 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T09:41:32.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.667+0000 7f0ada000640 1 Processor -- start 2024-05-14T09:41:32.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.668+0000 7f0ada000640 1 -- start start 2024-05-14T09:41:32.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.672+0000 7f0ada000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ad40c6740 0x7f0ad4156800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:32.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.672+0000 7f0ada000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad41608d0 con 0x7f0ad406c6f0 2024-05-14T09:41:32.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.672+0000 7f0ada000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad40c6ef0 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.672+0000 7f0ada000640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad40c71d0 con 0x7f0ad40c6740 2024-05-14T09:41:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.733+0000 7f0ad3400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0ad40cdbc0 0x7f0ad415fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:58766/0 (socket says 172.21.15.135:58766) 2024-05-14T09:41:32.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.733+0000 7f0ad3400640 1 -- 172.21.15.135:0/2169640231 learned_addr learned my addr 172.21.15.135:0/2169640231 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:32.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.734+0000 7f0ad3e00640 1 --2- 172.21.15.135:0/2169640231 >> v2:172.21.15.135:3300/0 conn(0x7f0ad40c6740 0x7f0ad4156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:32.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.745+0000 7f0ad2a00640 1 -- 172.21.15.135:0/2169640231 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890145971 0 0) 0x7f0ad40c6ef0 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.745+0000 7f0ad2a00640 1 -- 172.21.15.135:0/2169640231 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ab8003520 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.746+0000 7f0ad3e00640 1 -- 172.21.15.135:0/2169640231 >> v1:172.21.15.196:6789/0 conn(0x7f0ad40cdbc0 legacy=0x7f0ad415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:32.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.746+0000 7f0ad3e00640 1 -- 172.21.15.135:0/2169640231 >> v1:172.21.15.135:6789/0 conn(0x7f0ad406c6f0 legacy=0x7f0ad4164dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:32.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.746+0000 7f0ad3e00640 1 -- 172.21.15.135:0/2169640231 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad40c7770 con 0x7f0ad40c6740 2024-05-14T09:41:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.760+0000 7f0ad3e00640 1 --2- 172.21.15.135:0/2169640231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ad40c6740 0x7f0ad4156800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009d90 tx=0x7f0acc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e714093c0f10a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:32.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.774+0000 7f0ad2a00640 1 -- 172.21.15.135:0/2169640231 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc007740 con 0x7f0ad40c6740 2024-05-14T09:41:32.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.774+0000 7f0ad2a00640 1 -- 172.21.15.135:0/2169640231 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc0078e0 con 0x7f0ad40c6740 2024-05-14T09:41:32.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.774+0000 7f0ad2a00640 1 -- 172.21.15.135:0/2169640231 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc007cb0 con 0x7f0ad40c6740 2024-05-14T09:41:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.776+0000 7f0ada000640 1 -- 172.21.15.135:0/2169640231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ad40c6740 msgr2=0x7f0ad4156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:32.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.776+0000 7f0ada000640 1 --2- 172.21.15.135:0/2169640231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ad40c6740 0x7f0ad4156800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009d90 tx=0x7f0acc02a660 comp rx=0 tx=0).stop 2024-05-14T09:41:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.776+0000 7f0ada000640 1 -- 172.21.15.135:0/2169640231 shutdown_connections 2024-05-14T09:41:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.776+0000 7f0ada000640 1 --2- 172.21.15.135:0/2169640231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ad40c6740 0x7f0ad4156800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.776+0000 7f0ada000640 1 -- 172.21.15.135:0/2169640231 >> 172.21.15.135:0/2169640231 conn(0x7f0ad408e2f0 msgr2=0x7f0ad40d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.776+0000 7f0ada000640 1 -- 172.21.15.135:0/2169640231 shutdown_connections 2024-05-14T09:41:32.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.777+0000 7f0ada000640 1 -- 172.21.15.135:0/2169640231 wait complete. 2024-05-14T09:41:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.781+0000 7f0ada000640 1 Processor -- start 2024-05-14T09:41:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.782+0000 7f0ada000640 1 -- start start 2024-05-14T09:41:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.785+0000 7f0ada000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ad406c6f0 0x7f0ad41e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.785+0000 7f0ada000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ad40c6740 0x7f0ad4151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.785+0000 7f0ada000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ad40cdbc0 0x7f0ad414dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.785+0000 7f0ada000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40c8250 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.785+0000 7f0ada000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad40c7d30 con 0x7f0ad40c6740 2024-05-14T09:41:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.785+0000 7f0ada000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad40c83d0 con 0x7f0ad406c6f0 2024-05-14T09:41:32.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.786+0000 7f0ad3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ad40cdbc0 0x7f0ad414dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:32.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.787+0000 7f0ad3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ad40cdbc0 0x7f0ad414dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55464/0 (socket says 172.21.15.135:55464) 2024-05-14T09:41:32.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.787+0000 7f0ad3e00640 1 -- 172.21.15.135:0/1547258311 learned_addr learned my addr 172.21.15.135:0/1547258311 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:32.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.787+0000 7f0ad3400640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ad406c6f0 0x7f0ad41e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:32.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.787+0000 7f0acbe00640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ad40c6740 0x7f0ad4151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.791+0000 7f0ad3e00640 1 -- 172.21.15.135:0/1547258311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ad406c6f0 msgr2=0x7f0ad41e6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.791+0000 7f0ad3e00640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ad406c6f0 0x7f0ad41e6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.791+0000 7f0ad3e00640 1 -- 172.21.15.135:0/1547258311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ad40c6740 msgr2=0x7f0ad4151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.791+0000 7f0ad3e00640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ad40c6740 0x7f0ad4151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:32.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.791+0000 7f0ad3e00640 1 -- 172.21.15.135:0/1547258311 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad41f3060 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.795+0000 7f0ad3e00640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ad40cdbc0 0x7f0ad414dfa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0acc02ac50 tx=0x7f0acc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.800+0000 7f0acb400640 1 -- 172.21.15.135:0/1547258311 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc03f070 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.801+0000 7f0acb400640 1 -- 172.21.15.135:0/1547258311 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc031b40 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.801+0000 7f0acb400640 1 -- 172.21.15.135:0/1547258311 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc044460 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.801+0000 7f0ada000640 1 -- 172.21.15.135:0/1547258311 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad41e73f0 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.801+0000 7f0ada000640 1 -- 172.21.15.135:0/1547258311 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad415e370 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.802+0000 7f0ada000640 1 -- 172.21.15.135:0/1547258311 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad4076290 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.835+0000 7f0acb400640 1 -- 172.21.15.135:0/1547258311 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0acc03b410 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.837+0000 7f0acb400640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0ab0076320 0x7f0ab0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:32.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.838+0000 7f0ad3400640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0ab0076320 0x7f0ab0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:32.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.838+0000 7f0acb400640 1 -- 172.21.15.135:0/1547258311 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f0acc007840 con 0x7f0ad40cdbc0 2024-05-14T09:41:32.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:32.839+0000 7f0ad3400640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0ab0076320 0x7f0ab0078830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4005880 tx=0x7f0ac4006aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:33.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.162+0000 7f0acb400640 1 -- 172.21.15.135:0/1547258311 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ad41f3060 con 0x7f0ad40cdbc0 2024-05-14T09:41:33.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.380+0000 7f0ada000640 1 -- 172.21.15.135:0/1547258311 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ad41f35e0 con 0x7f0ab0076320 2024-05-14T09:41:33.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.401+0000 7f0acb400640 1 -- 172.21.15.135:0/1547258311 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332688 (secure 0 0 0) 0x7f0ad41f35e0 con 0x7f0ab0076320 2024-05-14T09:41:33.404 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:33.407 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-14T09:41:33.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.408+0000 7f0ada000640 1 -- 172.21.15.135:0/1547258311 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0ab0076320 msgr2=0x7f0ab0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:33.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.408+0000 7f0ada000640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0ab0076320 0x7f0ab0078830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4005880 tx=0x7f0ac4006aa0 comp rx=0 tx=0).stop 2024-05-14T09:41:33.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.408+0000 7f0ada000640 1 -- 172.21.15.135:0/1547258311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ad40cdbc0 msgr2=0x7f0ad414dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:33.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.408+0000 7f0ada000640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ad40cdbc0 0x7f0ad414dfa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0acc02ac50 tx=0x7f0acc004a40 comp rx=0 tx=0).stop 2024-05-14T09:41:33.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.409+0000 7f0ada000640 1 -- 172.21.15.135:0/1547258311 shutdown_connections 2024-05-14T09:41:33.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.409+0000 7f0ada000640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0ab0076320 0x7f0ab0078830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:33.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.409+0000 7f0ada000640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ad40c6740 0x7f0ad4151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:33.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.409+0000 7f0ada000640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ad40cdbc0 0x7f0ad414dfa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:33.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.409+0000 7f0ada000640 1 --2- 172.21.15.135:0/1547258311 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ad406c6f0 0x7f0ad41e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:33.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.409+0000 7f0ada000640 1 -- 172.21.15.135:0/1547258311 >> 172.21.15.135:0/1547258311 conn(0x7f0ad408e2f0 msgr2=0x7f0ad4154220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:33.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.409+0000 7f0ada000640 1 -- 172.21.15.135:0/1547258311 shutdown_connections 2024-05-14T09:41:33.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.409+0000 7f0ada000640 1 -- 172.21.15.135:0/1547258311 wait complete. 2024-05-14T09:41:33.434 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-05-14T09:41:32.347978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597198,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":205,"num_write_kb":1663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220148,"kb_used_data":4012,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754572,"statfs":{"total":773094113280,"available":772868681728,"internally_reserved":0,"allocated":4108288,"data_stored":2380398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2190,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005692"},"pg_stats":[{"pgid":"2.1f","version":"26'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204940+0000","last_change":"2024-05-14T09:40:43.106486+0000","last_active":"2024-05-14T09:41:04.204940+0000","last_peered":"2024-05-14T09:41:04.204940+0000","last_clean":"2024-05-14T09:41:04.204940+0000","last_became_active":"2024-05-14T09:40:43.105731+0000","last_became_peered":"2024-05-14T09:40:43.105731+0000","last_unstale":"2024-05-14T09:41:04.204940+0000","last_undegraded":"2024-05-14T09:41:04.204940+0000","last_fullsized":"2024-05-14T09:41:04.204940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:32:09.735265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197157+0000","last_change":"2024-05-14T09:40:45.750103+0000","last_active":"2024-05-14T09:41:04.197157+0000","last_peered":"2024-05-14T09:41:04.197157+0000","last_clean":"2024-05-14T09:41:04.197157+0000","last_became_active":"2024-05-14T09:40:45.747865+0000","last_became_peered":"2024-05-14T09:40:45.747865+0000","last_unstale":"2024-05-14T09:41:04.197157+0000","last_undegraded":"2024-05-14T09:41:04.197157+0000","last_fullsized":"2024-05-14T09:41:04.197157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:06.549076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195817+0000","last_change":"2024-05-14T09:40:53.664918+0000","last_active":"2024-05-14T09:41:04.195817+0000","last_peered":"2024-05-14T09:41:04.195817+0000","last_clean":"2024-05-14T09:41:04.195817+0000","last_became_active":"2024-05-14T09:40:53.664366+0000","last_became_peered":"2024-05-14T09:40:53.664366+0000","last_unstale":"2024-05-14T09:41:04.195817+0000","last_undegraded":"2024-05-14T09:41:04.195817+0000","last_fullsized":"2024-05-14T09:41:04.195817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:20:52.204134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198009+0000","last_change":"2024-05-14T09:40:43.101185+0000","last_active":"2024-05-14T09:41:04.198009+0000","last_peered":"2024-05-14T09:41:04.198009+0000","last_clean":"2024-05-14T09:41:04.198009+0000","last_became_active":"2024-05-14T09:40:43.098862+0000","last_became_peered":"2024-05-14T09:40:43.098862+0000","last_unstale":"2024-05-14T09:41:04.198009+0000","last_undegraded":"2024-05-14T09:41:04.198009+0000","last_fullsized":"2024-05-14T09:41:04.198009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203770+0000","last_change":"2024-05-14T09:40:45.752960+0000","last_active":"2024-05-14T09:41:04.203770+0000","last_peered":"2024-05-14T09:41:04.203770+0000","last_clean":"2024-05-14T09:41:04.203770+0000","last_became_active":"2024-05-14T09:40:45.752627+0000","last_became_peered":"2024-05-14T09:40:45.752627+0000","last_unstale":"2024-05-14T09:41:04.203770+0000","last_undegraded":"2024-05-14T09:41:04.203770+0000","last_fullsized":"2024-05-14T09:41:04.203770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.192616+0000","last_change":"2024-05-14T09:40:53.662032+0000","last_active":"2024-05-14T09:41:04.192616+0000","last_peered":"2024-05-14T09:41:04.192616+0000","last_clean":"2024-05-14T09:41:04.192616+0000","last_became_active":"2024-05-14T09:40:53.661453+0000","last_became_peered":"2024-05-14T09:40:53.661453+0000","last_unstale":"2024-05-14T09:41:04.192616+0000","last_undegraded":"2024-05-14T09:41:04.192616+0000","last_fullsized":"2024-05-14T09:41:04.192616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:11.724866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610802+0000","last_change":"2024-05-14T09:40:43.114965+0000","last_active":"2024-05-14T09:41:04.610802+0000","last_peered":"2024-05-14T09:41:04.610802+0000","last_clean":"2024-05-14T09:41:04.610802+0000","last_became_active":"2024-05-14T09:40:43.114379+0000","last_became_peered":"2024-05-14T09:40:43.114379+0000","last_unstale":"2024-05-14T09:41:04.610802+0000","last_undegraded":"2024-05-14T09:41:04.610802+0000","last_fullsized":"2024-05-14T09:41:04.610802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:43.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204333+0000","last_change":"2024-05-14T09:40:45.758305+0000","last_active":"2024-05-14T09:41:04.204333+0000","last_peered":"2024-05-14T09:41:04.204333+0000","last_clean":"2024-05-14T09:41:04.204333+0000","last_became_active":"2024-05-14T09:40:45.754110+0000","last_became_peered":"2024-05-14T09:40:45.754110+0000","last_unstale":"2024-05-14T09:41:04.204333+0000","last_undegraded":"2024-05-14T09:41:04.204333+0000","last_fullsized":"2024-05-14T09:41:04.204333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:12:42.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.601574+0000","last_change":"2024-05-14T09:41:04.601574+0000","last_active":"2024-05-14T09:41:04.601574+0000","last_peered":"2024-05-14T09:41:04.601574+0000","last_clean":"2024-05-14T09:41:04.601574+0000","last_became_active":"2024-05-14T09:41:04.599475+0000","last_became_peered":"2024-05-14T09:41:04.599475+0000","last_unstale":"2024-05-14T09:41:04.601574+0000","last_undegraded":"2024-05-14T09:41:04.601574+0000","last_fullsized":"2024-05-14T09:41:04.601574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610183+0000","last_change":"2024-05-14T09:40:43.110296+0000","last_active":"2024-05-14T09:41:04.610183+0000","last_peered":"2024-05-14T09:41:04.610183+0000","last_clean":"2024-05-14T09:41:04.610183+0000","last_became_active":"2024-05-14T09:40:43.109932+0000","last_became_peered":"2024-05-14T09:40:43.109932+0000","last_unstale":"2024-05-14T09:41:04.610183+0000","last_undegraded":"2024-05-14T09:41:04.610183+0000","last_fullsized":"2024-05-14T09:41:04.610183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:29.003048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205871+0000","last_change":"2024-05-14T09:40:45.773110+0000","last_active":"2024-05-14T09:41:04.205871+0000","last_peered":"2024-05-14T09:41:04.205871+0000","last_clean":"2024-05-14T09:41:04.205871+0000","last_became_active":"2024-05-14T09:40:45.770117+0000","last_became_peered":"2024-05-14T09:40:45.770117+0000","last_unstale":"2024-05-14T09:41:04.205871+0000","last_undegraded":"2024-05-14T09:41:04.205871+0000","last_fullsized":"2024-05-14T09:41:04.205871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:28.718450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.192677+0000","last_change":"2024-05-14T09:40:53.652049+0000","last_active":"2024-05-14T09:41:04.192677+0000","last_peered":"2024-05-14T09:41:04.192677+0000","last_clean":"2024-05-14T09:41:04.192677+0000","last_became_active":"2024-05-14T09:40:53.651570+0000","last_became_peered":"2024-05-14T09:40:53.651570+0000","last_unstale":"2024-05-14T09:41:04.192677+0000","last_undegraded":"2024-05-14T09:41:04.192677+0000","last_fullsized":"2024-05-14T09:41:04.192677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:30.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595721+0000","last_change":"2024-05-14T09:40:45.753771+0000","last_active":"2024-05-14T09:41:04.595721+0000","last_peered":"2024-05-14T09:41:04.595721+0000","last_clean":"2024-05-14T09:41:04.595721+0000","last_became_active":"2024-05-14T09:40:45.753319+0000","last_became_peered":"2024-05-14T09:40:45.753319+0000","last_unstale":"2024-05-14T09:41:04.595721+0000","last_undegraded":"2024-05-14T09:41:04.595721+0000","last_fullsized":"2024-05-14T09:41:04.595721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.542521+0000","last_change":"2024-05-14T09:40:43.125708+0000","last_active":"2024-05-14T09:41:27.542521+0000","last_peered":"2024-05-14T09:41:27.542521+0000","last_clean":"2024-05-14T09:41:27.542521+0000","last_became_active":"2024-05-14T09:40:43.125239+0000","last_became_peered":"2024-05-14T09:40:43.125239+0000","last_unstale":"2024-05-14T09:41:27.542521+0000","last_undegraded":"2024-05-14T09:41:27.542521+0000","last_fullsized":"2024-05-14T09:41:27.542521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:22.781125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.194099+0000","last_change":"2024-05-14T09:40:53.663353+0000","last_active":"2024-05-14T09:41:04.194099+0000","last_peered":"2024-05-14T09:41:04.194099+0000","last_clean":"2024-05-14T09:41:04.194099+0000","last_became_active":"2024-05-14T09:40:53.662559+0000","last_became_peered":"2024-05-14T09:40:53.662559+0000","last_unstale":"2024-05-14T09:41:04.194099+0000","last_undegraded":"2024-05-14T09:41:04.194099+0000","last_fullsized":"2024-05-14T09:41:04.194099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:14.708431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197527+0000","last_change":"2024-05-14T09:40:45.751929+0000","last_active":"2024-05-14T09:41:04.197527+0000","last_peered":"2024-05-14T09:41:04.197527+0000","last_clean":"2024-05-14T09:41:04.197527+0000","last_became_active":"2024-05-14T09:40:45.751015+0000","last_became_peered":"2024-05-14T09:40:45.751015+0000","last_unstale":"2024-05-14T09:41:04.197527+0000","last_undegraded":"2024-05-14T09:41:04.197527+0000","last_fullsized":"2024-05-14T09:41:04.197527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:12.550231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247228+0000","last_change":"2024-05-14T09:40:43.023070+0000","last_active":"2024-05-14T09:41:04.247228+0000","last_peered":"2024-05-14T09:41:04.247228+0000","last_clean":"2024-05-14T09:41:04.247228+0000","last_became_active":"2024-05-14T09:40:43.022234+0000","last_became_peered":"2024-05-14T09:40:43.022234+0000","last_unstale":"2024-05-14T09:41:04.247228+0000","last_undegraded":"2024-05-14T09:41:04.247228+0000","last_fullsized":"2024-05-14T09:41:04.247228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:30:06.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.601663+0000","last_change":"2024-05-14T09:41:04.601663+0000","last_active":"2024-05-14T09:41:04.601663+0000","last_peered":"2024-05-14T09:41:04.601663+0000","last_clean":"2024-05-14T09:41:04.601663+0000","last_became_active":"2024-05-14T09:41:04.600186+0000","last_became_peered":"2024-05-14T09:41:04.600186+0000","last_unstale":"2024-05-14T09:41:04.601663+0000","last_undegraded":"2024-05-14T09:41:04.601663+0000","last_fullsized":"2024-05-14T09:41:04.601663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196422+0000","last_change":"2024-05-14T09:40:45.746999+0000","last_active":"2024-05-14T09:41:04.196422+0000","last_peered":"2024-05-14T09:41:04.196422+0000","last_clean":"2024-05-14T09:41:04.196422+0000","last_became_active":"2024-05-14T09:40:45.746607+0000","last_became_peered":"2024-05-14T09:40:45.746607+0000","last_unstale":"2024-05-14T09:41:04.196422+0000","last_undegraded":"2024-05-14T09:41:04.196422+0000","last_fullsized":"2024-05-14T09:41:04.196422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:03.565510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.774259+0000","last_change":"2024-05-14T09:40:43.105149+0000","last_active":"2024-05-14T09:41:27.774259+0000","last_peered":"2024-05-14T09:41:27.774259+0000","last_clean":"2024-05-14T09:41:27.774259+0000","last_became_active":"2024-05-14T09:40:43.104277+0000","last_became_peered":"2024-05-14T09:40:43.104277+0000","last_unstale":"2024-05-14T09:41:27.774259+0000","last_undegraded":"2024-05-14T09:41:27.774259+0000","last_fullsized":"2024-05-14T09:41:27.774259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:48.598915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247251+0000","last_change":"2024-05-14T09:40:53.649256+0000","last_active":"2024-05-14T09:41:04.247251+0000","last_peered":"2024-05-14T09:41:04.247251+0000","last_clean":"2024-05-14T09:41:04.247251+0000","last_became_active":"2024-05-14T09:40:53.648765+0000","last_became_peered":"2024-05-14T09:40:53.648765+0000","last_unstale":"2024-05-14T09:41:04.247251+0000","last_undegraded":"2024-05-14T09:41:04.247251+0000","last_fullsized":"2024-05-14T09:41:04.247251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:25.060381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196117+0000","last_change":"2024-05-14T09:40:45.730862+0000","last_active":"2024-05-14T09:41:04.196117+0000","last_peered":"2024-05-14T09:41:04.196117+0000","last_clean":"2024-05-14T09:41:04.196117+0000","last_became_active":"2024-05-14T09:40:45.730014+0000","last_became_peered":"2024-05-14T09:40:45.730014+0000","last_unstale":"2024-05-14T09:41:04.196117+0000","last_undegraded":"2024-05-14T09:41:04.196117+0000","last_fullsized":"2024-05-14T09:41:04.196117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:05.679719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.533383+0000","last_change":"2024-05-14T09:40:43.112127+0000","last_active":"2024-05-14T09:41:27.533383+0000","last_peered":"2024-05-14T09:41:27.533383+0000","last_clean":"2024-05-14T09:41:27.533383+0000","last_became_active":"2024-05-14T09:40:43.111574+0000","last_became_peered":"2024-05-14T09:40:43.111574+0000","last_unstale":"2024-05-14T09:41:27.533383+0000","last_undegraded":"2024-05-14T09:41:27.533383+0000","last_fullsized":"2024-05-14T09:41:27.533383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:13.668017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193742+0000","last_change":"2024-05-14T09:40:53.666100+0000","last_active":"2024-05-14T09:41:04.193742+0000","last_peered":"2024-05-14T09:41:04.193742+0000","last_clean":"2024-05-14T09:41:04.193742+0000","last_became_active":"2024-05-14T09:40:53.665635+0000","last_became_peered":"2024-05-14T09:40:53.665635+0000","last_unstale":"2024-05-14T09:41:04.193742+0000","last_undegraded":"2024-05-14T09:41:04.193742+0000","last_fullsized":"2024-05-14T09:41:04.193742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:21.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205010+0000","last_change":"2024-05-14T09:40:45.758554+0000","last_active":"2024-05-14T09:41:04.205010+0000","last_peered":"2024-05-14T09:41:04.205010+0000","last_clean":"2024-05-14T09:41:04.205010+0000","last_became_active":"2024-05-14T09:40:45.757938+0000","last_became_peered":"2024-05-14T09:40:45.757938+0000","last_unstale":"2024-05-14T09:41:04.205010+0000","last_undegraded":"2024-05-14T09:41:04.205010+0000","last_fullsized":"2024-05-14T09:41:04.205010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.545839+0000","last_change":"2024-05-14T09:40:43.116767+0000","last_active":"2024-05-14T09:41:27.545839+0000","last_peered":"2024-05-14T09:41:27.545839+0000","last_clean":"2024-05-14T09:41:27.545839+0000","last_became_active":"2024-05-14T09:40:43.116142+0000","last_became_peered":"2024-05-14T09:40:43.116142+0000","last_unstale":"2024-05-14T09:41:27.545839+0000","last_undegraded":"2024-05-14T09:41:27.545839+0000","last_fullsized":"2024-05-14T09:41:27.545839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195886+0000","last_change":"2024-05-14T09:40:53.666811+0000","last_active":"2024-05-14T09:41:04.195886+0000","last_peered":"2024-05-14T09:41:04.195886+0000","last_clean":"2024-05-14T09:41:04.195886+0000","last_became_active":"2024-05-14T09:40:53.666455+0000","last_became_peered":"2024-05-14T09:40:53.666455+0000","last_unstale":"2024-05-14T09:41:04.195886+0000","last_undegraded":"2024-05-14T09:41:04.195886+0000","last_fullsized":"2024-05-14T09:41:04.195886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:33.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198714+0000","last_change":"2024-05-14T09:40:45.768162+0000","last_active":"2024-05-14T09:41:04.198714+0000","last_peered":"2024-05-14T09:41:04.198714+0000","last_clean":"2024-05-14T09:41:04.198714+0000","last_became_active":"2024-05-14T09:40:45.767810+0000","last_became_peered":"2024-05-14T09:40:45.767810+0000","last_unstale":"2024-05-14T09:41:04.198714+0000","last_undegraded":"2024-05-14T09:41:04.198714+0000","last_fullsized":"2024-05-14T09:41:04.198714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:25.075246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247616+0000","last_change":"2024-05-14T09:40:43.115650+0000","last_active":"2024-05-14T09:41:04.247616+0000","last_peered":"2024-05-14T09:41:04.247616+0000","last_clean":"2024-05-14T09:41:04.247616+0000","last_became_active":"2024-05-14T09:40:43.114902+0000","last_became_peered":"2024-05-14T09:40:43.114902+0000","last_unstale":"2024-05-14T09:41:04.247616+0000","last_undegraded":"2024-05-14T09:41:04.247616+0000","last_fullsized":"2024-05-14T09:41:04.247616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:19.284998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195677+0000","last_change":"2024-05-14T09:40:53.650297+0000","last_active":"2024-05-14T09:41:04.195677+0000","last_peered":"2024-05-14T09:41:04.195677+0000","last_clean":"2024-05-14T09:41:04.195677+0000","last_became_active":"2024-05-14T09:40:53.649263+0000","last_became_peered":"2024-05-14T09:40:53.649263+0000","last_unstale":"2024-05-14T09:41:04.195677+0000","last_undegraded":"2024-05-14T09:41:04.195677+0000","last_fullsized":"2024-05-14T09:41:04.195677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:22.637337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247816+0000","last_change":"2024-05-14T09:40:45.733131+0000","last_active":"2024-05-14T09:41:04.247816+0000","last_peered":"2024-05-14T09:41:04.247816+0000","last_clean":"2024-05-14T09:41:04.247816+0000","last_became_active":"2024-05-14T09:40:45.732154+0000","last_became_peered":"2024-05-14T09:40:45.732154+0000","last_unstale":"2024-05-14T09:41:04.247816+0000","last_undegraded":"2024-05-14T09:41:04.247816+0000","last_fullsized":"2024-05-14T09:41:04.247816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:23:16.904648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611279+0000","last_change":"2024-05-14T09:40:43.112841+0000","last_active":"2024-05-14T09:41:04.611279+0000","last_peered":"2024-05-14T09:41:04.611279+0000","last_clean":"2024-05-14T09:41:04.611279+0000","last_became_active":"2024-05-14T09:40:43.110703+0000","last_became_peered":"2024-05-14T09:40:43.110703+0000","last_unstale":"2024-05-14T09:41:04.611279+0000","last_undegraded":"2024-05-14T09:41:04.611279+0000","last_fullsized":"2024-05-14T09:41:04.611279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:01.271389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203306+0000","last_change":"2024-05-14T09:40:53.657532+0000","last_active":"2024-05-14T09:41:04.203306+0000","last_peered":"2024-05-14T09:41:04.203306+0000","last_clean":"2024-05-14T09:41:04.203306+0000","last_became_active":"2024-05-14T09:40:53.657073+0000","last_became_peered":"2024-05-14T09:40:53.657073+0000","last_unstale":"2024-05-14T09:41:04.203306+0000","last_undegraded":"2024-05-14T09:41:04.203306+0000","last_fullsized":"2024-05-14T09:41:04.203306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:56.882153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.206106+0000","last_change":"2024-05-14T09:40:45.752122+0000","last_active":"2024-05-14T09:41:04.206106+0000","last_peered":"2024-05-14T09:41:04.206106+0000","last_clean":"2024-05-14T09:41:04.206106+0000","last_became_active":"2024-05-14T09:40:45.751546+0000","last_became_peered":"2024-05-14T09:40:45.751546+0000","last_unstale":"2024-05-14T09:41:04.206106+0000","last_undegraded":"2024-05-14T09:41:04.206106+0000","last_fullsized":"2024-05-14T09:41:04.206106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:19:55.897772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247921+0000","last_change":"2024-05-14T09:40:43.099478+0000","last_active":"2024-05-14T09:41:04.247921+0000","last_peered":"2024-05-14T09:41:04.247921+0000","last_clean":"2024-05-14T09:41:04.247921+0000","last_became_active":"2024-05-14T09:40:43.098776+0000","last_became_peered":"2024-05-14T09:40:43.098776+0000","last_unstale":"2024-05-14T09:41:04.247921+0000","last_undegraded":"2024-05-14T09:41:04.247921+0000","last_fullsized":"2024-05-14T09:41:04.247921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:35.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.246451+0000","last_change":"2024-05-14T09:40:53.650794+0000","last_active":"2024-05-14T09:41:04.246451+0000","last_peered":"2024-05-14T09:41:04.246451+0000","last_clean":"2024-05-14T09:41:04.246451+0000","last_became_active":"2024-05-14T09:40:53.650139+0000","last_became_peered":"2024-05-14T09:40:53.650139+0000","last_unstale":"2024-05-14T09:41:04.246451+0000","last_undegraded":"2024-05-14T09:41:04.246451+0000","last_fullsized":"2024-05-14T09:41:04.246451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:36.877806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193914+0000","last_change":"2024-05-14T09:40:45.748430+0000","last_active":"2024-05-14T09:41:04.193914+0000","last_peered":"2024-05-14T09:41:04.193914+0000","last_clean":"2024-05-14T09:41:04.193914+0000","last_became_active":"2024-05-14T09:40:45.748048+0000","last_became_peered":"2024-05-14T09:40:45.748048+0000","last_unstale":"2024-05-14T09:41:04.193914+0000","last_undegraded":"2024-05-14T09:41:04.193914+0000","last_fullsized":"2024-05-14T09:41:04.193914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:29.240543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205404+0000","last_change":"2024-05-14T09:40:43.088293+0000","last_active":"2024-05-14T09:41:04.205404+0000","last_peered":"2024-05-14T09:41:04.205404+0000","last_clean":"2024-05-14T09:41:04.205404+0000","last_became_active":"2024-05-14T09:40:43.087310+0000","last_became_peered":"2024-05-14T09:40:43.087310+0000","last_unstale":"2024-05-14T09:41:04.205404+0000","last_undegraded":"2024-05-14T09:41:04.205404+0000","last_fullsized":"2024-05-14T09:41:04.205404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:38.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.604273+0000","last_change":"2024-05-14T09:41:04.598844+0000","last_active":"2024-05-14T09:41:04.604273+0000","last_peered":"2024-05-14T09:41:04.604273+0000","last_clean":"2024-05-14T09:41:04.604273+0000","last_became_active":"2024-05-14T09:41:04.597473+0000","last_became_peered":"2024-05-14T09:41:04.597473+0000","last_unstale":"2024-05-14T09:41:04.604273+0000","last_undegraded":"2024-05-14T09:41:04.604273+0000","last_fullsized":"2024-05-14T09:41:04.604273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:48.257782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245464+0000","last_change":"2024-05-14T09:40:45.740074+0000","last_active":"2024-05-14T09:41:04.245464+0000","last_peered":"2024-05-14T09:41:04.245464+0000","last_clean":"2024-05-14T09:41:04.245464+0000","last_became_active":"2024-05-14T09:40:45.739647+0000","last_became_peered":"2024-05-14T09:40:45.739647+0000","last_unstale":"2024-05-14T09:41:04.245464+0000","last_undegraded":"2024-05-14T09:41:04.245464+0000","last_fullsized":"2024-05-14T09:41:04.245464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:38.401151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.853150+0000","last_change":"2024-05-14T09:40:43.043210+0000","last_active":"2024-05-14T09:41:30.853150+0000","last_peered":"2024-05-14T09:41:30.853150+0000","last_clean":"2024-05-14T09:41:30.853150+0000","last_became_active":"2024-05-14T09:40:43.042243+0000","last_became_peered":"2024-05-14T09:40:43.042243+0000","last_unstale":"2024-05-14T09:41:30.853150+0000","last_undegraded":"2024-05-14T09:41:30.853150+0000","last_fullsized":"2024-05-14T09:41:30.853150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.946422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247618+0000","last_change":"2024-05-14T09:40:53.652161+0000","last_active":"2024-05-14T09:41:04.247618+0000","last_peered":"2024-05-14T09:41:04.247618+0000","last_clean":"2024-05-14T09:41:04.247618+0000","last_became_active":"2024-05-14T09:40:53.649990+0000","last_became_peered":"2024-05-14T09:40:53.649990+0000","last_unstale":"2024-05-14T09:41:04.247618+0000","last_undegraded":"2024-05-14T09:41:04.247618+0000","last_fullsized":"2024-05-14T09:41:04.247618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:20:04.057127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203229+0000","last_change":"2024-05-14T09:40:45.754250+0000","last_active":"2024-05-14T09:41:04.203229+0000","last_peered":"2024-05-14T09:41:04.203229+0000","last_clean":"2024-05-14T09:41:04.203229+0000","last_became_active":"2024-05-14T09:40:45.753850+0000","last_became_peered":"2024-05-14T09:40:45.753850+0000","last_unstale":"2024-05-14T09:41:04.203229+0000","last_undegraded":"2024-05-14T09:41:04.203229+0000","last_fullsized":"2024-05-14T09:41:04.203229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:15.962138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.608850+0000","last_change":"2024-05-14T09:40:43.111905+0000","last_active":"2024-05-14T09:41:04.608850+0000","last_peered":"2024-05-14T09:41:04.608850+0000","last_clean":"2024-05-14T09:41:04.608850+0000","last_became_active":"2024-05-14T09:40:43.108233+0000","last_became_peered":"2024-05-14T09:40:43.108233+0000","last_unstale":"2024-05-14T09:41:04.608850+0000","last_undegraded":"2024-05-14T09:41:04.608850+0000","last_fullsized":"2024-05-14T09:41:04.608850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204679+0000","last_change":"2024-05-14T09:40:53.663789+0000","last_active":"2024-05-14T09:41:04.204679+0000","last_peered":"2024-05-14T09:41:04.204679+0000","last_clean":"2024-05-14T09:41:04.204679+0000","last_became_active":"2024-05-14T09:40:53.662980+0000","last_became_peered":"2024-05-14T09:40:53.662980+0000","last_unstale":"2024-05-14T09:41:04.204679+0000","last_undegraded":"2024-05-14T09:41:04.204679+0000","last_fullsized":"2024-05-14T09:41:04.204679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:46.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196055+0000","last_change":"2024-05-14T09:40:45.754347+0000","last_active":"2024-05-14T09:41:04.196055+0000","last_peered":"2024-05-14T09:41:04.196055+0000","last_clean":"2024-05-14T09:41:04.196055+0000","last_became_active":"2024-05-14T09:40:45.753869+0000","last_became_peered":"2024-05-14T09:40:45.753869+0000","last_unstale":"2024-05-14T09:41:04.196055+0000","last_undegraded":"2024-05-14T09:41:04.196055+0000","last_fullsized":"2024-05-14T09:41:04.196055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.544619+0000","last_change":"2024-05-14T09:40:43.087481+0000","last_active":"2024-05-14T09:41:27.544619+0000","last_peered":"2024-05-14T09:41:27.544619+0000","last_clean":"2024-05-14T09:41:27.544619+0000","last_became_active":"2024-05-14T09:40:43.086487+0000","last_became_peered":"2024-05-14T09:40:43.086487+0000","last_unstale":"2024-05-14T09:41:27.544619+0000","last_undegraded":"2024-05-14T09:41:27.544619+0000","last_fullsized":"2024-05-14T09:41:27.544619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:54.225063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.608887+0000","last_change":"2024-05-14T09:40:22.705545+0000","last_active":"2024-05-14T09:41:04.608887+0000","last_peered":"2024-05-14T09:41:04.608887+0000","last_clean":"2024-05-14T09:41:04.608887+0000","last_became_active":"2024-05-14T09:40:22.701797+0000","last_became_peered":"2024-05-14T09:40:22.701797+0000","last_unstale":"2024-05-14T09:41:04.608887+0000","last_undegraded":"2024-05-14T09:41:04.608887+0000","last_fullsized":"2024-05-14T09:41:04.608887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_clean_scrub_stamp":"2024-05-14T09:40:17.767400+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:48:21.700172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596932+0000","last_change":"2024-05-14T09:40:53.681915+0000","last_active":"2024-05-14T09:41:04.596932+0000","last_peered":"2024-05-14T09:41:04.596932+0000","last_clean":"2024-05-14T09:41:04.596932+0000","last_became_active":"2024-05-14T09:40:53.681296+0000","last_became_peered":"2024-05-14T09:40:53.681296+0000","last_unstale":"2024-05-14T09:41:04.596932+0000","last_undegraded":"2024-05-14T09:41:04.596932+0000","last_fullsized":"2024-05-14T09:41:04.596932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:21.455981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.216856+0000","last_change":"2024-05-14T09:41:04.213355+0000","last_active":"2024-05-14T09:41:04.216856+0000","last_peered":"2024-05-14T09:41:04.216856+0000","last_clean":"2024-05-14T09:41:04.216856+0000","last_became_active":"2024-05-14T09:41:04.212709+0000","last_became_peered":"2024-05-14T09:41:04.212709+0000","last_unstale":"2024-05-14T09:41:04.216856+0000","last_undegraded":"2024-05-14T09:41:04.216856+0000","last_fullsized":"2024-05-14T09:41:04.216856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.848240+0000","last_change":"2024-05-14T09:40:43.090401+0000","last_active":"2024-05-14T09:41:30.848240+0000","last_peered":"2024-05-14T09:41:30.848240+0000","last_clean":"2024-05-14T09:41:30.848240+0000","last_became_active":"2024-05-14T09:40:43.089548+0000","last_became_peered":"2024-05-14T09:40:43.089548+0000","last_unstale":"2024-05-14T09:41:30.848240+0000","last_undegraded":"2024-05-14T09:41:30.848240+0000","last_fullsized":"2024-05-14T09:41:30.848240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:03.385598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595424+0000","last_change":"2024-05-14T09:40:53.677072+0000","last_active":"2024-05-14T09:41:04.595424+0000","last_peered":"2024-05-14T09:41:04.595424+0000","last_clean":"2024-05-14T09:41:04.595424+0000","last_became_active":"2024-05-14T09:40:53.676636+0000","last_became_peered":"2024-05-14T09:40:53.676636+0000","last_unstale":"2024-05-14T09:41:04.595424+0000","last_undegraded":"2024-05-14T09:41:04.595424+0000","last_fullsized":"2024-05-14T09:41:04.595424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205238+0000","last_change":"2024-05-14T09:40:45.750962+0000","last_active":"2024-05-14T09:41:04.205238+0000","last_peered":"2024-05-14T09:41:04.205238+0000","last_clean":"2024-05-14T09:41:04.205238+0000","last_became_active":"2024-05-14T09:40:45.750539+0000","last_became_peered":"2024-05-14T09:40:45.750539+0000","last_unstale":"2024-05-14T09:41:04.205238+0000","last_undegraded":"2024-05-14T09:41:04.205238+0000","last_fullsized":"2024-05-14T09:41:04.205238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:42.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247645+0000","last_change":"2024-05-14T09:40:43.122483+0000","last_active":"2024-05-14T09:41:04.247645+0000","last_peered":"2024-05-14T09:41:04.247645+0000","last_clean":"2024-05-14T09:41:04.247645+0000","last_became_active":"2024-05-14T09:40:43.121427+0000","last_became_peered":"2024-05-14T09:40:43.121427+0000","last_unstale":"2024-05-14T09:41:04.247645+0000","last_undegraded":"2024-05-14T09:41:04.247645+0000","last_fullsized":"2024-05-14T09:41:04.247645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:31.384470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203609+0000","last_change":"2024-05-14T09:40:53.656157+0000","last_active":"2024-05-14T09:41:04.203609+0000","last_peered":"2024-05-14T09:41:04.203609+0000","last_clean":"2024-05-14T09:41:04.203609+0000","last_became_active":"2024-05-14T09:40:53.655141+0000","last_became_peered":"2024-05-14T09:40:53.655141+0000","last_unstale":"2024-05-14T09:41:04.203609+0000","last_undegraded":"2024-05-14T09:41:04.203609+0000","last_fullsized":"2024-05-14T09:41:04.203609+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611389+0000","last_change":"2024-05-14T09:40:45.778555+0000","last_active":"2024-05-14T09:41:04.611389+0000","last_peered":"2024-05-14T09:41:04.611389+0000","last_clean":"2024-05-14T09:41:04.611389+0000","last_became_active":"2024-05-14T09:40:45.776967+0000","last_became_peered":"2024-05-14T09:40:45.776967+0000","last_unstale":"2024-05-14T09:41:04.611389+0000","last_undegraded":"2024-05-14T09:41:04.611389+0000","last_fullsized":"2024-05-14T09:41:04.611389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:45:35.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211879+0000","last_change":"2024-05-14T09:40:43.043359+0000","last_active":"2024-05-14T09:41:04.211879+0000","last_peered":"2024-05-14T09:41:04.211879+0000","last_clean":"2024-05-14T09:41:04.211879+0000","last_became_active":"2024-05-14T09:40:43.042486+0000","last_became_peered":"2024-05-14T09:40:43.042486+0000","last_unstale":"2024-05-14T09:41:04.211879+0000","last_undegraded":"2024-05-14T09:41:04.211879+0000","last_fullsized":"2024-05-14T09:41:04.211879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:15.480365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203108+0000","last_change":"2024-05-14T09:40:53.662719+0000","last_active":"2024-05-14T09:41:04.203108+0000","last_peered":"2024-05-14T09:41:04.203108+0000","last_clean":"2024-05-14T09:41:04.203108+0000","last_became_active":"2024-05-14T09:40:53.660933+0000","last_became_peered":"2024-05-14T09:40:53.660933+0000","last_unstale":"2024-05-14T09:41:04.203108+0000","last_undegraded":"2024-05-14T09:41:04.203108+0000","last_fullsized":"2024-05-14T09:41:04.203108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:02.584358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610643+0000","last_change":"2024-05-14T09:40:45.776336+0000","last_active":"2024-05-14T09:41:04.610643+0000","last_peered":"2024-05-14T09:41:04.610643+0000","last_clean":"2024-05-14T09:41:04.610643+0000","last_became_active":"2024-05-14T09:40:45.775936+0000","last_became_peered":"2024-05-14T09:40:45.775936+0000","last_unstale":"2024-05-14T09:41:04.610643+0000","last_undegraded":"2024-05-14T09:41:04.610643+0000","last_fullsized":"2024-05-14T09:41:04.610643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:59.300900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.194627+0000","last_change":"2024-05-14T09:40:43.124714+0000","last_active":"2024-05-14T09:41:04.194627+0000","last_peered":"2024-05-14T09:41:04.194627+0000","last_clean":"2024-05-14T09:41:04.194627+0000","last_became_active":"2024-05-14T09:40:43.124370+0000","last_became_peered":"2024-05-14T09:40:43.124370+0000","last_unstale":"2024-05-14T09:41:04.194627+0000","last_undegraded":"2024-05-14T09:41:04.194627+0000","last_fullsized":"2024-05-14T09:41:04.194627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:52.132214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195468+0000","last_change":"2024-05-14T09:40:53.667102+0000","last_active":"2024-05-14T09:41:04.195468+0000","last_peered":"2024-05-14T09:41:04.195468+0000","last_clean":"2024-05-14T09:41:04.195468+0000","last_became_active":"2024-05-14T09:40:53.666666+0000","last_became_peered":"2024-05-14T09:40:53.666666+0000","last_unstale":"2024-05-14T09:41:04.195468+0000","last_undegraded":"2024-05-14T09:41:04.195468+0000","last_fullsized":"2024-05-14T09:41:04.195468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609479+0000","last_change":"2024-05-14T09:40:45.777251+0000","last_active":"2024-05-14T09:41:04.609479+0000","last_peered":"2024-05-14T09:41:04.609479+0000","last_clean":"2024-05-14T09:41:04.609479+0000","last_became_active":"2024-05-14T09:40:45.775668+0000","last_became_peered":"2024-05-14T09:40:45.775668+0000","last_unstale":"2024-05-14T09:41:04.609479+0000","last_undegraded":"2024-05-14T09:41:04.609479+0000","last_fullsized":"2024-05-14T09:41:04.609479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:54.917354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.859595+0000","last_change":"2024-05-14T09:40:43.040000+0000","last_active":"2024-05-14T09:41:30.859595+0000","last_peered":"2024-05-14T09:41:30.859595+0000","last_clean":"2024-05-14T09:41:30.859595+0000","last_became_active":"2024-05-14T09:40:43.039186+0000","last_became_peered":"2024-05-14T09:40:43.039186+0000","last_unstale":"2024-05-14T09:41:30.859595+0000","last_undegraded":"2024-05-14T09:41:30.859595+0000","last_fullsized":"2024-05-14T09:41:30.859595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:41:44.514114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204660+0000","last_change":"2024-05-14T09:40:53.667056+0000","last_active":"2024-05-14T09:41:04.204660+0000","last_peered":"2024-05-14T09:41:04.204660+0000","last_clean":"2024-05-14T09:41:04.204660+0000","last_became_active":"2024-05-14T09:40:53.666575+0000","last_became_peered":"2024-05-14T09:40:53.666575+0000","last_unstale":"2024-05-14T09:41:04.204660+0000","last_undegraded":"2024-05-14T09:41:04.204660+0000","last_fullsized":"2024-05-14T09:41:04.204660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594614+0000","last_change":"2024-05-14T09:40:45.754466+0000","last_active":"2024-05-14T09:41:04.594614+0000","last_peered":"2024-05-14T09:41:04.594614+0000","last_clean":"2024-05-14T09:41:04.594614+0000","last_became_active":"2024-05-14T09:40:45.753839+0000","last_became_peered":"2024-05-14T09:40:45.753839+0000","last_unstale":"2024-05-14T09:41:04.594614+0000","last_undegraded":"2024-05-14T09:41:04.594614+0000","last_fullsized":"2024-05-14T09:41:04.594614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595070+0000","last_change":"2024-05-14T09:40:43.121744+0000","last_active":"2024-05-14T09:41:04.595070+0000","last_peered":"2024-05-14T09:41:04.595070+0000","last_clean":"2024-05-14T09:41:04.595070+0000","last_became_active":"2024-05-14T09:40:43.121388+0000","last_became_peered":"2024-05-14T09:40:43.121388+0000","last_unstale":"2024-05-14T09:41:04.595070+0000","last_undegraded":"2024-05-14T09:41:04.595070+0000","last_fullsized":"2024-05-14T09:41:04.595070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198145+0000","last_change":"2024-05-14T09:40:53.659658+0000","last_active":"2024-05-14T09:41:04.198145+0000","last_peered":"2024-05-14T09:41:04.198145+0000","last_clean":"2024-05-14T09:41:04.198145+0000","last_became_active":"2024-05-14T09:40:53.659191+0000","last_became_peered":"2024-05-14T09:40:53.659191+0000","last_unstale":"2024-05-14T09:41:04.198145+0000","last_undegraded":"2024-05-14T09:41:04.198145+0000","last_fullsized":"2024-05-14T09:41:04.198145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:15:39.587593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609972+0000","last_change":"2024-05-14T09:40:45.776748+0000","last_active":"2024-05-14T09:41:04.609972+0000","last_peered":"2024-05-14T09:41:04.609972+0000","last_clean":"2024-05-14T09:41:04.609972+0000","last_became_active":"2024-05-14T09:40:45.776451+0000","last_became_peered":"2024-05-14T09:40:45.776451+0000","last_unstale":"2024-05-14T09:41:04.609972+0000","last_undegraded":"2024-05-14T09:41:04.609972+0000","last_fullsized":"2024-05-14T09:41:04.609972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:39.890407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.545190+0000","last_change":"2024-05-14T09:40:43.086185+0000","last_active":"2024-05-14T09:41:27.545190+0000","last_peered":"2024-05-14T09:41:27.545190+0000","last_clean":"2024-05-14T09:41:27.545190+0000","last_became_active":"2024-05-14T09:40:43.085320+0000","last_became_peered":"2024-05-14T09:40:43.085320+0000","last_unstale":"2024-05-14T09:41:27.545190+0000","last_undegraded":"2024-05-14T09:41:27.545190+0000","last_fullsized":"2024-05-14T09:41:27.545190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:26:22.301593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196812+0000","last_change":"2024-05-14T09:40:53.673710+0000","last_active":"2024-05-14T09:41:04.196812+0000","last_peered":"2024-05-14T09:41:04.196812+0000","last_clean":"2024-05-14T09:41:04.196812+0000","last_became_active":"2024-05-14T09:40:53.672089+0000","last_became_peered":"2024-05-14T09:40:53.672089+0000","last_unstale":"2024-05-14T09:41:04.196812+0000","last_undegraded":"2024-05-14T09:41:04.196812+0000","last_fullsized":"2024-05-14T09:41:04.196812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:48:16.697615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205653+0000","last_change":"2024-05-14T09:40:45.767220+0000","last_active":"2024-05-14T09:41:04.205653+0000","last_peered":"2024-05-14T09:41:04.205653+0000","last_clean":"2024-05-14T09:41:04.205653+0000","last_became_active":"2024-05-14T09:40:45.766895+0000","last_became_peered":"2024-05-14T09:40:45.766895+0000","last_unstale":"2024-05-14T09:41:04.205653+0000","last_undegraded":"2024-05-14T09:41:04.205653+0000","last_fullsized":"2024-05-14T09:41:04.205653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.546582+0000","last_change":"2024-05-14T09:40:43.124937+0000","last_active":"2024-05-14T09:41:27.546582+0000","last_peered":"2024-05-14T09:41:27.546582+0000","last_clean":"2024-05-14T09:41:27.546582+0000","last_became_active":"2024-05-14T09:40:43.124129+0000","last_became_peered":"2024-05-14T09:40:43.124129+0000","last_unstale":"2024-05-14T09:41:27.546582+0000","last_undegraded":"2024-05-14T09:41:27.546582+0000","last_fullsized":"2024-05-14T09:41:27.546582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205748+0000","last_change":"2024-05-14T09:40:53.664722+0000","last_active":"2024-05-14T09:41:04.205748+0000","last_peered":"2024-05-14T09:41:04.205748+0000","last_clean":"2024-05-14T09:41:04.205748+0000","last_became_active":"2024-05-14T09:40:53.664194+0000","last_became_peered":"2024-05-14T09:40:53.664194+0000","last_unstale":"2024-05-14T09:41:04.205748+0000","last_undegraded":"2024-05-14T09:41:04.205748+0000","last_fullsized":"2024-05-14T09:41:04.205748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:35:57.826557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610449+0000","last_change":"2024-05-14T09:40:45.770662+0000","last_active":"2024-05-14T09:41:04.610449+0000","last_peered":"2024-05-14T09:41:04.610449+0000","last_clean":"2024-05-14T09:41:04.610449+0000","last_became_active":"2024-05-14T09:40:45.768058+0000","last_became_peered":"2024-05-14T09:40:45.768058+0000","last_unstale":"2024-05-14T09:41:04.610449+0000","last_undegraded":"2024-05-14T09:41:04.610449+0000","last_fullsized":"2024-05-14T09:41:04.610449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:13.296625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'12","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.546757+0000","last_change":"2024-05-14T09:40:43.113989+0000","last_active":"2024-05-14T09:41:27.546757+0000","last_peered":"2024-05-14T09:41:27.546757+0000","last_clean":"2024-05-14T09:41:27.546757+0000","last_became_active":"2024-05-14T09:40:43.113589+0000","last_became_peered":"2024-05-14T09:40:43.113589+0000","last_unstale":"2024-05-14T09:41:27.546757+0000","last_undegraded":"2024-05-14T09:41:27.546757+0000","last_fullsized":"2024-05-14T09:41:27.546757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:42:17.351523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.246643+0000","last_change":"2024-05-14T09:40:53.663887+0000","last_active":"2024-05-14T09:41:04.246643+0000","last_peered":"2024-05-14T09:41:04.246643+0000","last_clean":"2024-05-14T09:41:04.246643+0000","last_became_active":"2024-05-14T09:40:53.663419+0000","last_became_peered":"2024-05-14T09:40:53.663419+0000","last_unstale":"2024-05-14T09:41:04.246643+0000","last_undegraded":"2024-05-14T09:41:04.246643+0000","last_fullsized":"2024-05-14T09:41:04.246643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:18.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196203+0000","last_change":"2024-05-14T09:40:45.767184+0000","last_active":"2024-05-14T09:41:04.196203+0000","last_peered":"2024-05-14T09:41:04.196203+0000","last_clean":"2024-05-14T09:41:04.196203+0000","last_became_active":"2024-05-14T09:40:45.766784+0000","last_became_peered":"2024-05-14T09:40:45.766784+0000","last_unstale":"2024-05-14T09:41:04.196203+0000","last_undegraded":"2024-05-14T09:41:04.196203+0000","last_fullsized":"2024-05-14T09:41:04.196203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247559+0000","last_change":"2024-05-14T09:40:43.089869+0000","last_active":"2024-05-14T09:41:04.247559+0000","last_peered":"2024-05-14T09:41:04.247559+0000","last_clean":"2024-05-14T09:41:04.247559+0000","last_became_active":"2024-05-14T09:40:43.088906+0000","last_became_peered":"2024-05-14T09:40:43.088906+0000","last_unstale":"2024-05-14T09:41:04.247559+0000","last_undegraded":"2024-05-14T09:41:04.247559+0000","last_fullsized":"2024-05-14T09:41:04.247559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:28.223322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193385+0000","last_change":"2024-05-14T09:40:53.667412+0000","last_active":"2024-05-14T09:41:04.193385+0000","last_peered":"2024-05-14T09:41:04.193385+0000","last_clean":"2024-05-14T09:41:04.193385+0000","last_became_active":"2024-05-14T09:40:53.666533+0000","last_became_peered":"2024-05-14T09:40:53.666533+0000","last_unstale":"2024-05-14T09:41:04.193385+0000","last_undegraded":"2024-05-14T09:41:04.193385+0000","last_fullsized":"2024-05-14T09:41:04.193385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:53:41.310701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.250664+0000","last_change":"2024-05-14T09:41:04.250664+0000","last_active":"2024-05-14T09:41:04.250664+0000","last_peered":"2024-05-14T09:41:04.250664+0000","last_clean":"2024-05-14T09:41:04.250664+0000","last_became_active":"2024-05-14T09:41:04.250043+0000","last_became_peered":"2024-05-14T09:41:04.250043+0000","last_unstale":"2024-05-14T09:41:04.250664+0000","last_undegraded":"2024-05-14T09:41:04.250664+0000","last_fullsized":"2024-05-14T09:41:04.250664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:46:49.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.542416+0000","last_change":"2024-05-14T09:40:43.116130+0000","last_active":"2024-05-14T09:41:27.542416+0000","last_peered":"2024-05-14T09:41:27.542416+0000","last_clean":"2024-05-14T09:41:27.542416+0000","last_became_active":"2024-05-14T09:40:43.115741+0000","last_became_peered":"2024-05-14T09:40:43.115741+0000","last_unstale":"2024-05-14T09:41:27.542416+0000","last_undegraded":"2024-05-14T09:41:27.542416+0000","last_fullsized":"2024-05-14T09:41:27.542416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:35.083285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196132+0000","last_change":"2024-05-14T09:40:53.667088+0000","last_active":"2024-05-14T09:41:04.196132+0000","last_peered":"2024-05-14T09:41:04.196132+0000","last_clean":"2024-05-14T09:41:04.196132+0000","last_became_active":"2024-05-14T09:40:53.662581+0000","last_became_peered":"2024-05-14T09:40:53.662581+0000","last_unstale":"2024-05-14T09:41:04.196132+0000","last_undegraded":"2024-05-14T09:41:04.196132+0000","last_fullsized":"2024-05-14T09:41:04.196132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:14:18.824424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204868+0000","last_change":"2024-05-14T09:40:45.774302+0000","last_active":"2024-05-14T09:41:04.204868+0000","last_peered":"2024-05-14T09:41:04.204868+0000","last_clean":"2024-05-14T09:41:04.204868+0000","last_became_active":"2024-05-14T09:40:45.773879+0000","last_became_peered":"2024-05-14T09:40:45.773879+0000","last_unstale":"2024-05-14T09:41:04.204868+0000","last_undegraded":"2024-05-14T09:41:04.204868+0000","last_fullsized":"2024-05-14T09:41:04.204868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:09.921679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.549532+0000","last_change":"2024-05-14T09:40:43.116616+0000","last_active":"2024-05-14T09:41:27.549532+0000","last_peered":"2024-05-14T09:41:27.549532+0000","last_clean":"2024-05-14T09:41:27.549532+0000","last_became_active":"2024-05-14T09:40:43.115166+0000","last_became_peered":"2024-05-14T09:40:43.115166+0000","last_unstale":"2024-05-14T09:41:27.549532+0000","last_undegraded":"2024-05-14T09:41:27.549532+0000","last_fullsized":"2024-05-14T09:41:27.549532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:52.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196032+0000","last_change":"2024-05-14T09:40:53.668423+0000","last_active":"2024-05-14T09:41:04.196032+0000","last_peered":"2024-05-14T09:41:04.196032+0000","last_clean":"2024-05-14T09:41:04.196032+0000","last_became_active":"2024-05-14T09:40:53.664838+0000","last_became_peered":"2024-05-14T09:40:53.664838+0000","last_unstale":"2024-05-14T09:41:04.196032+0000","last_undegraded":"2024-05-14T09:41:04.196032+0000","last_fullsized":"2024-05-14T09:41:04.196032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:00:35.633754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204241+0000","last_change":"2024-05-14T09:40:53.656095+0000","last_active":"2024-05-14T09:41:04.204241+0000","last_peered":"2024-05-14T09:41:04.204241+0000","last_clean":"2024-05-14T09:41:04.204241+0000","last_became_active":"2024-05-14T09:40:53.655439+0000","last_became_peered":"2024-05-14T09:40:53.655439+0000","last_unstale":"2024-05-14T09:41:04.204241+0000","last_undegraded":"2024-05-14T09:41:04.204241+0000","last_fullsized":"2024-05-14T09:41:04.204241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:44.521319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245578+0000","last_change":"2024-05-14T09:40:45.744447+0000","last_active":"2024-05-14T09:41:04.245578+0000","last_peered":"2024-05-14T09:41:04.245578+0000","last_clean":"2024-05-14T09:41:04.245578+0000","last_became_active":"2024-05-14T09:40:45.743611+0000","last_became_peered":"2024-05-14T09:40:45.743611+0000","last_unstale":"2024-05-14T09:41:04.245578+0000","last_undegraded":"2024-05-14T09:41:04.245578+0000","last_fullsized":"2024-05-14T09:41:04.245578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:56.519183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203943+0000","last_change":"2024-05-14T09:40:43.122005+0000","last_active":"2024-05-14T09:41:04.203943+0000","last_peered":"2024-05-14T09:41:04.203943+0000","last_clean":"2024-05-14T09:41:04.203943+0000","last_became_active":"2024-05-14T09:40:43.121629+0000","last_became_peered":"2024-05-14T09:40:43.121629+0000","last_unstale":"2024-05-14T09:41:04.203943+0000","last_undegraded":"2024-05-14T09:41:04.203943+0000","last_fullsized":"2024-05-14T09:41:04.203943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:31:03.016812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596267+0000","last_change":"2024-05-14T09:40:53.679415+0000","last_active":"2024-05-14T09:41:04.596267+0000","last_peered":"2024-05-14T09:41:04.596267+0000","last_clean":"2024-05-14T09:41:04.596267+0000","last_became_active":"2024-05-14T09:40:53.678851+0000","last_became_peered":"2024-05-14T09:40:53.678851+0000","last_unstale":"2024-05-14T09:41:04.596267+0000","last_undegraded":"2024-05-14T09:41:04.596267+0000","last_fullsized":"2024-05-14T09:41:04.596267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:48.049763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196225+0000","last_change":"2024-05-14T09:40:45.743111+0000","last_active":"2024-05-14T09:41:04.196225+0000","last_peered":"2024-05-14T09:41:04.196225+0000","last_clean":"2024-05-14T09:41:04.196225+0000","last_became_active":"2024-05-14T09:40:45.742702+0000","last_became_peered":"2024-05-14T09:40:45.742702+0000","last_unstale":"2024-05-14T09:41:04.196225+0000","last_undegraded":"2024-05-14T09:41:04.196225+0000","last_fullsized":"2024-05-14T09:41:04.196225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:17:39.673477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.682978+0000","last_change":"2024-05-14T09:40:43.116535+0000","last_active":"2024-05-14T09:41:30.682978+0000","last_peered":"2024-05-14T09:41:30.682978+0000","last_clean":"2024-05-14T09:41:30.682978+0000","last_became_active":"2024-05-14T09:40:43.115860+0000","last_became_peered":"2024-05-14T09:40:43.115860+0000","last_unstale":"2024-05-14T09:41:30.682978+0000","last_undegraded":"2024-05-14T09:41:30.682978+0000","last_fullsized":"2024-05-14T09:41:30.682978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596150+0000","last_change":"2024-05-14T09:40:43.120700+0000","last_active":"2024-05-14T09:41:04.596150+0000","last_peered":"2024-05-14T09:41:04.596150+0000","last_clean":"2024-05-14T09:41:04.596150+0000","last_became_active":"2024-05-14T09:40:43.120353+0000","last_became_peered":"2024-05-14T09:40:43.120353+0000","last_unstale":"2024-05-14T09:41:04.596150+0000","last_undegraded":"2024-05-14T09:41:04.596150+0000","last_fullsized":"2024-05-14T09:41:04.596150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:35.425012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203768+0000","last_change":"2024-05-14T09:40:45.758385+0000","last_active":"2024-05-14T09:41:04.203768+0000","last_peered":"2024-05-14T09:41:04.203768+0000","last_clean":"2024-05-14T09:41:04.203768+0000","last_became_active":"2024-05-14T09:40:45.758017+0000","last_became_peered":"2024-05-14T09:40:45.758017+0000","last_unstale":"2024-05-14T09:41:04.203768+0000","last_undegraded":"2024-05-14T09:41:04.203768+0000","last_fullsized":"2024-05-14T09:41:04.203768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.210781+0000","last_change":"2024-05-14T09:40:53.671995+0000","last_active":"2024-05-14T09:41:04.210781+0000","last_peered":"2024-05-14T09:41:04.210781+0000","last_clean":"2024-05-14T09:41:04.210781+0000","last_became_active":"2024-05-14T09:40:53.671145+0000","last_became_peered":"2024-05-14T09:40:53.671145+0000","last_unstale":"2024-05-14T09:41:04.210781+0000","last_undegraded":"2024-05-14T09:41:04.210781+0000","last_fullsized":"2024-05-14T09:41:04.210781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:02.991096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'5","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.652423+0000","last_change":"2024-05-14T09:40:43.105812+0000","last_active":"2024-05-14T09:41:27.652423+0000","last_peered":"2024-05-14T09:41:27.652423+0000","last_clean":"2024-05-14T09:41:27.652423+0000","last_became_active":"2024-05-14T09:40:43.104821+0000","last_became_peered":"2024-05-14T09:40:43.104821+0000","last_unstale":"2024-05-14T09:41:27.652423+0000","last_undegraded":"2024-05-14T09:41:27.652423+0000","last_fullsized":"2024-05-14T09:41:27.652423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193448+0000","last_change":"2024-05-14T09:40:45.746294+0000","last_active":"2024-05-14T09:41:04.193448+0000","last_peered":"2024-05-14T09:41:04.193448+0000","last_clean":"2024-05-14T09:41:04.193448+0000","last_became_active":"2024-05-14T09:40:45.745850+0000","last_became_peered":"2024-05-14T09:40:45.745850+0000","last_unstale":"2024-05-14T09:41:04.193448+0000","last_undegraded":"2024-05-14T09:41:04.193448+0000","last_fullsized":"2024-05-14T09:41:04.193448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:17.774486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197287+0000","last_change":"2024-05-14T09:40:53.670990+0000","last_active":"2024-05-14T09:41:04.197287+0000","last_peered":"2024-05-14T09:41:04.197287+0000","last_clean":"2024-05-14T09:41:04.197287+0000","last_became_active":"2024-05-14T09:40:53.669094+0000","last_became_peered":"2024-05-14T09:40:53.669094+0000","last_unstale":"2024-05-14T09:41:04.197287+0000","last_undegraded":"2024-05-14T09:41:04.197287+0000","last_fullsized":"2024-05-14T09:41:04.197287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:35:15.483140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594603+0000","last_change":"2024-05-14T09:40:45.754615+0000","last_active":"2024-05-14T09:41:04.594603+0000","last_peered":"2024-05-14T09:41:04.594603+0000","last_clean":"2024-05-14T09:41:04.594603+0000","last_became_active":"2024-05-14T09:40:45.754283+0000","last_became_peered":"2024-05-14T09:40:45.754283+0000","last_unstale":"2024-05-14T09:41:04.594603+0000","last_undegraded":"2024-05-14T09:41:04.594603+0000","last_fullsized":"2024-05-14T09:41:04.594603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211227+0000","last_change":"2024-05-14T09:40:45.753218+0000","last_active":"2024-05-14T09:41:04.211227+0000","last_peered":"2024-05-14T09:41:04.211227+0000","last_clean":"2024-05-14T09:41:04.211227+0000","last_became_active":"2024-05-14T09:40:45.752599+0000","last_became_peered":"2024-05-14T09:40:45.752599+0000","last_unstale":"2024-05-14T09:41:04.211227+0000","last_undegraded":"2024-05-14T09:41:04.211227+0000","last_fullsized":"2024-05-14T09:41:04.211227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205092+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T09:41:04.205092+0000","last_peered":"2024-05-14T09:41:04.205092+0000","last_clean":"2024-05-14T09:41:04.205092+0000","last_became_active":"2024-05-14T09:40:45.750387+0000","last_became_peered":"2024-05-14T09:40:45.750387+0000","last_unstale":"2024-05-14T09:41:04.205092+0000","last_undegraded":"2024-05-14T09:41:04.205092+0000","last_fullsized":"2024-05-14T09:41:04.205092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:54.689111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.251002+0000","last_change":"2024-05-14T09:41:04.251002+0000","last_active":"2024-05-14T09:41:04.251002+0000","last_peered":"2024-05-14T09:41:04.251002+0000","last_clean":"2024-05-14T09:41:04.251002+0000","last_became_active":"2024-05-14T09:41:04.250037+0000","last_became_peered":"2024-05-14T09:41:04.250037+0000","last_unstale":"2024-05-14T09:41:04.251002+0000","last_undegraded":"2024-05-14T09:41:04.251002+0000","last_fullsized":"2024-05-14T09:41:04.251002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:42:35.669137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197833+0000","last_change":"2024-05-14T09:40:45.723956+0000","last_active":"2024-05-14T09:41:04.197833+0000","last_peered":"2024-05-14T09:41:04.197833+0000","last_clean":"2024-05-14T09:41:04.197833+0000","last_became_active":"2024-05-14T09:40:45.723040+0000","last_became_peered":"2024-05-14T09:40:45.723040+0000","last_unstale":"2024-05-14T09:41:04.197833+0000","last_undegraded":"2024-05-14T09:41:04.197833+0000","last_fullsized":"2024-05-14T09:41:04.197833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:45.690725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247145+0000","last_change":"2024-05-14T09:40:45.746942+0000","last_active":"2024-05-14T09:41:04.247145+0000","last_peered":"2024-05-14T09:41:04.247145+0000","last_clean":"2024-05-14T09:41:04.247145+0000","last_became_active":"2024-05-14T09:40:45.745393+0000","last_became_peered":"2024-05-14T09:40:45.745393+0000","last_unstale":"2024-05-14T09:41:04.247145+0000","last_undegraded":"2024-05-14T09:41:04.247145+0000","last_fullsized":"2024-05-14T09:41:04.247145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:37.377406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595966+0000","last_change":"2024-05-14T09:40:45.772238+0000","last_active":"2024-05-14T09:41:04.595966+0000","last_peered":"2024-05-14T09:41:04.595966+0000","last_clean":"2024-05-14T09:41:04.595966+0000","last_became_active":"2024-05-14T09:40:45.771838+0000","last_became_peered":"2024-05-14T09:40:45.771838+0000","last_unstale":"2024-05-14T09:41:04.595966+0000","last_undegraded":"2024-05-14T09:41:04.595966+0000","last_fullsized":"2024-05-14T09:41:04.595966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198586+0000","last_change":"2024-05-14T09:40:45.727770+0000","last_active":"2024-05-14T09:41:04.198586+0000","last_peered":"2024-05-14T09:41:04.198586+0000","last_clean":"2024-05-14T09:41:04.198586+0000","last_became_active":"2024-05-14T09:40:45.725283+0000","last_became_peered":"2024-05-14T09:40:45.725283+0000","last_unstale":"2024-05-14T09:41:04.198586+0000","last_undegraded":"2024-05-14T09:41:04.198586+0000","last_fullsized":"2024-05-14T09:41:04.198586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:22.638700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203472+0000","last_change":"2024-05-14T09:40:45.749288+0000","last_active":"2024-05-14T09:41:04.203472+0000","last_peered":"2024-05-14T09:41:04.203472+0000","last_clean":"2024-05-14T09:41:04.203472+0000","last_became_active":"2024-05-14T09:40:45.748925+0000","last_became_peered":"2024-05-14T09:40:45.748925+0000","last_unstale":"2024-05-14T09:41:04.203472+0000","last_undegraded":"2024-05-14T09:41:04.203472+0000","last_fullsized":"2024-05-14T09:41:04.203472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:03.576418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196797+0000","last_change":"2024-05-14T09:40:45.724197+0000","last_active":"2024-05-14T09:41:04.196797+0000","last_peered":"2024-05-14T09:41:04.196797+0000","last_clean":"2024-05-14T09:41:04.196797+0000","last_became_active":"2024-05-14T09:40:45.723317+0000","last_became_peered":"2024-05-14T09:40:45.723317+0000","last_unstale":"2024-05-14T09:41:04.196797+0000","last_undegraded":"2024-05-14T09:41:04.196797+0000","last_fullsized":"2024-05-14T09:41:04.196797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204963+0000","last_change":"2024-05-14T09:40:45.770723+0000","last_active":"2024-05-14T09:41:04.204963+0000","last_peered":"2024-05-14T09:41:04.204963+0000","last_clean":"2024-05-14T09:41:04.204963+0000","last_became_active":"2024-05-14T09:40:45.769772+0000","last_became_peered":"2024-05-14T09:40:45.769772+0000","last_unstale":"2024-05-14T09:41:04.204963+0000","last_undegraded":"2024-05-14T09:41:04.204963+0000","last_fullsized":"2024-05-14T09:41:04.204963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:44.852533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203481+0000","last_change":"2024-05-14T09:40:45.766217+0000","last_active":"2024-05-14T09:41:04.203481+0000","last_peered":"2024-05-14T09:41:04.203481+0000","last_clean":"2024-05-14T09:41:04.203481+0000","last_became_active":"2024-05-14T09:40:45.765830+0000","last_became_peered":"2024-05-14T09:40:45.765830+0000","last_unstale":"2024-05-14T09:41:04.203481+0000","last_undegraded":"2024-05-14T09:41:04.203481+0000","last_fullsized":"2024-05-14T09:41:04.203481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594937+0000","last_change":"2024-05-14T09:40:45.760838+0000","last_active":"2024-05-14T09:41:04.594937+0000","last_peered":"2024-05-14T09:41:04.594937+0000","last_clean":"2024-05-14T09:41:04.594937+0000","last_became_active":"2024-05-14T09:40:45.760535+0000","last_became_peered":"2024-05-14T09:40:45.760535+0000","last_unstale":"2024-05-14T09:41:04.594937+0000","last_undegraded":"2024-05-14T09:41:04.594937+0000","last_fullsized":"2024-05-14T09:41:04.594937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610853+0000","last_change":"2024-05-14T09:40:45.778218+0000","last_active":"2024-05-14T09:41:04.610853+0000","last_peered":"2024-05-14T09:41:04.610853+0000","last_clean":"2024-05-14T09:41:04.610853+0000","last_became_active":"2024-05-14T09:40:45.775602+0000","last_became_peered":"2024-05-14T09:40:45.775602+0000","last_unstale":"2024-05-14T09:41:04.610853+0000","last_undegraded":"2024-05-14T09:41:04.610853+0000","last_fullsized":"2024-05-14T09:41:04.610853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:40.574917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211569+0000","last_change":"2024-05-14T09:40:45.748996+0000","last_active":"2024-05-14T09:41:04.211569+0000","last_peered":"2024-05-14T09:41:04.211569+0000","last_clean":"2024-05-14T09:41:04.211569+0000","last_became_active":"2024-05-14T09:40:45.748266+0000","last_became_peered":"2024-05-14T09:40:45.748266+0000","last_unstale":"2024-05-14T09:41:04.211569+0000","last_undegraded":"2024-05-14T09:41:04.211569+0000","last_fullsized":"2024-05-14T09:41:04.211569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.615498+0000","last_change":"2024-05-14T09:41:04.613266+0000","last_active":"2024-05-14T09:41:04.615498+0000","last_peered":"2024-05-14T09:41:04.615498+0000","last_clean":"2024-05-14T09:41:04.615498+0000","last_became_active":"2024-05-14T09:41:04.612160+0000","last_became_peered":"2024-05-14T09:41:04.612160+0000","last_unstale":"2024-05-14T09:41:04.615498+0000","last_undegraded":"2024-05-14T09:41:04.615498+0000","last_fullsized":"2024-05-14T09:41:04.615498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203375+0000","last_change":"2024-05-14T09:40:45.757279+0000","last_active":"2024-05-14T09:41:04.203375+0000","last_peered":"2024-05-14T09:41:04.203375+0000","last_clean":"2024-05-14T09:41:04.203375+0000","last_became_active":"2024-05-14T09:40:45.749692+0000","last_became_peered":"2024-05-14T09:40:45.749692+0000","last_unstale":"2024-05-14T09:41:04.203375+0000","last_undegraded":"2024-05-14T09:41:04.203375+0000","last_fullsized":"2024-05-14T09:41:04.203375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:39:52.486187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245774+0000","last_change":"2024-05-14T09:40:45.744802+0000","last_active":"2024-05-14T09:41:04.245774+0000","last_peered":"2024-05-14T09:41:04.245774+0000","last_clean":"2024-05-14T09:41:04.245774+0000","last_became_active":"2024-05-14T09:40:45.744011+0000","last_became_peered":"2024-05-14T09:40:45.744011+0000","last_unstale":"2024-05-14T09:41:04.245774+0000","last_undegraded":"2024-05-14T09:41:04.245774+0000","last_fullsized":"2024-05-14T09:41:04.245774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:20.468216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205334+0000","last_change":"2024-05-14T09:40:45.757983+0000","last_active":"2024-05-14T09:41:04.205334+0000","last_peered":"2024-05-14T09:41:04.205334+0000","last_clean":"2024-05-14T09:41:04.205334+0000","last_became_active":"2024-05-14T09:40:45.757450+0000","last_became_peered":"2024-05-14T09:40:45.757450+0000","last_unstale":"2024-05-14T09:41:04.205334+0000","last_undegraded":"2024-05-14T09:41:04.205334+0000","last_fullsized":"2024-05-14T09:41:04.205334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:07.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197114+0000","last_change":"2024-05-14T09:40:45.745021+0000","last_active":"2024-05-14T09:41:04.197114+0000","last_peered":"2024-05-14T09:41:04.197114+0000","last_clean":"2024-05-14T09:41:04.197114+0000","last_became_active":"2024-05-14T09:40:45.744550+0000","last_became_peered":"2024-05-14T09:40:45.744550+0000","last_unstale":"2024-05-14T09:41:04.197114+0000","last_undegraded":"2024-05-14T09:41:04.197114+0000","last_fullsized":"2024-05-14T09:41:04.197114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195987+0000","last_change":"2024-05-14T09:40:45.749109+0000","last_active":"2024-05-14T09:41:04.195987+0000","last_peered":"2024-05-14T09:41:04.195987+0000","last_clean":"2024-05-14T09:41:04.195987+0000","last_became_active":"2024-05-14T09:40:45.748419+0000","last_became_peered":"2024-05-14T09:40:45.748419+0000","last_unstale":"2024-05-14T09:41:04.195987+0000","last_undegraded":"2024-05-14T09:41:04.195987+0000","last_fullsized":"2024-05-14T09:41:04.195987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.597196+0000","last_change":"2024-05-14T09:40:45.753508+0000","last_active":"2024-05-14T09:41:04.597196+0000","last_peered":"2024-05-14T09:41:04.597196+0000","last_clean":"2024-05-14T09:41:04.597196+0000","last_became_active":"2024-05-14T09:40:45.752982+0000","last_became_peered":"2024-05-14T09:40:45.752982+0000","last_unstale":"2024-05-14T09:41:04.597196+0000","last_undegraded":"2024-05-14T09:41:04.597196+0000","last_fullsized":"2024-05-14T09:41:04.597196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595663+0000","last_change":"2024-05-14T09:40:45.759266+0000","last_active":"2024-05-14T09:41:04.595663+0000","last_peered":"2024-05-14T09:41:04.595663+0000","last_clean":"2024-05-14T09:41:04.595663+0000","last_became_active":"2024-05-14T09:40:45.758912+0000","last_became_peered":"2024-05-14T09:40:45.758912+0000","last_unstale":"2024-05-14T09:41:04.595663+0000","last_undegraded":"2024-05-14T09:41:04.595663+0000","last_fullsized":"2024-05-14T09:41:04.595663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611324+0000","last_change":"2024-05-14T09:40:45.780527+0000","last_active":"2024-05-14T09:41:04.611324+0000","last_peered":"2024-05-14T09:41:04.611324+0000","last_clean":"2024-05-14T09:41:04.611324+0000","last_became_active":"2024-05-14T09:40:45.780197+0000","last_became_peered":"2024-05-14T09:40:45.780197+0000","last_unstale":"2024-05-14T09:41:04.611324+0000","last_undegraded":"2024-05-14T09:41:04.611324+0000","last_fullsized":"2024-05-14T09:41:04.611324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:38.220230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195825+0000","last_change":"2024-05-14T09:40:45.761049+0000","last_active":"2024-05-14T09:41:04.195825+0000","last_peered":"2024-05-14T09:41:04.195825+0000","last_clean":"2024-05-14T09:41:04.195825+0000","last_became_active":"2024-05-14T09:40:45.760738+0000","last_became_peered":"2024-05-14T09:40:45.760738+0000","last_unstale":"2024-05-14T09:41:04.195825+0000","last_undegraded":"2024-05-14T09:41:04.195825+0000","last_fullsized":"2024-05-14T09:41:04.195825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609336+0000","last_change":"2024-05-14T09:40:45.776380+0000","last_active":"2024-05-14T09:41:04.609336+0000","last_peered":"2024-05-14T09:41:04.609336+0000","last_clean":"2024-05-14T09:41:04.609336+0000","last_became_active":"2024-05-14T09:40:45.776005+0000","last_became_peered":"2024-05-14T09:40:45.776005+0000","last_unstale":"2024-05-14T09:41:04.609336+0000","last_undegraded":"2024-05-14T09:41:04.609336+0000","last_fullsized":"2024-05-14T09:41:04.609336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:27.969792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.219398+0000","last_change":"2024-05-14T09:41:04.214552+0000","last_active":"2024-05-14T09:41:04.219398+0000","last_peered":"2024-05-14T09:41:04.219398+0000","last_clean":"2024-05-14T09:41:04.219398+0000","last_became_active":"2024-05-14T09:41:04.213721+0000","last_became_peered":"2024-05-14T09:41:04.213721+0000","last_unstale":"2024-05-14T09:41:04.219398+0000","last_undegraded":"2024-05-14T09:41:04.219398+0000","last_fullsized":"2024-05-14T09:41:04.219398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609591+0000","last_change":"2024-05-14T09:40:45.776955+0000","last_active":"2024-05-14T09:41:04.609591+0000","last_peered":"2024-05-14T09:41:04.609591+0000","last_clean":"2024-05-14T09:41:04.609591+0000","last_became_active":"2024-05-14T09:40:45.775953+0000","last_became_peered":"2024-05-14T09:40:45.775953+0000","last_unstale":"2024-05-14T09:41:04.609591+0000","last_undegraded":"2024-05-14T09:41:04.609591+0000","last_fullsized":"2024-05-14T09:41:04.609591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:13.534273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204293+0000","last_change":"2024-05-14T09:40:45.750766+0000","last_active":"2024-05-14T09:41:04.204293+0000","last_peered":"2024-05-14T09:41:04.204293+0000","last_clean":"2024-05-14T09:41:04.204293+0000","last_became_active":"2024-05-14T09:40:45.750416+0000","last_became_peered":"2024-05-14T09:40:45.750416+0000","last_unstale":"2024-05-14T09:41:04.204293+0000","last_undegraded":"2024-05-14T09:41:04.204293+0000","last_fullsized":"2024-05-14T09:41:04.204293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:29:30.022171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204845+0000","last_change":"2024-05-14T09:40:45.748573+0000","last_active":"2024-05-14T09:41:04.204845+0000","last_peered":"2024-05-14T09:41:04.204845+0000","last_clean":"2024-05-14T09:41:04.204845+0000","last_became_active":"2024-05-14T09:40:45.746640+0000","last_became_peered":"2024-05-14T09:40:45.746640+0000","last_unstale":"2024-05-14T09:41:04.204845+0000","last_undegraded":"2024-05-14T09:41:04.204845+0000","last_fullsized":"2024-05-14T09:41:04.204845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247941+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T09:41:04.247941+0000","last_peered":"2024-05-14T09:41:04.247941+0000","last_clean":"2024-05-14T09:41:04.247941+0000","last_became_active":"2024-05-14T09:40:45.752589+0000","last_became_peered":"2024-05-14T09:40:45.752589+0000","last_unstale":"2024-05-14T09:41:04.247941+0000","last_undegraded":"2024-05-14T09:41:04.247941+0000","last_fullsized":"2024-05-14T09:41:04.247941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:43.043120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611042+0000","last_change":"2024-05-14T09:40:45.771577+0000","last_active":"2024-05-14T09:41:04.611042+0000","last_peered":"2024-05-14T09:41:04.611042+0000","last_clean":"2024-05-14T09:41:04.611042+0000","last_became_active":"2024-05-14T09:40:45.771228+0000","last_became_peered":"2024-05-14T09:40:45.771228+0000","last_unstale":"2024-05-14T09:41:04.611042+0000","last_undegraded":"2024-05-14T09:41:04.611042+0000","last_fullsized":"2024-05-14T09:41:04.611042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:36.361964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6830,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":13000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476754,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":152535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476756,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":148729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":16,"seq":68719476757,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":153157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476753,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":148603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476753,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":962560,"data_stored":739631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":966656,"data_stored":740287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":148693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":148763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T09:41:33.438 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T09:41:33.439 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-14T09:41:33.439 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-14T09:41:33.439 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-14T09:41:33.439 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-14T09:41:33.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.751+0000 7f2f6a800640 1 Processor -- start 2024-05-14T09:41:33.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.751+0000 7f2f6a800640 1 -- start start 2024-05-14T09:41:33.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.753+0000 7f2f6a800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2f640c9880 0x7f2f640ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:33.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.754+0000 7f2f6a800640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f640b39d0 con 0x7f2f64153eb0 2024-05-14T09:41:33.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.754+0000 7f2f6a800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f64070e10 con 0x7f2f640c9350 2024-05-14T09:41:33.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.754+0000 7f2f6a800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f2f6406e880 con 0x7f2f640c9880 2024-05-14T09:41:33.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.756+0000 7f2f69e00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f2f64153eb0 0x7f2f64159fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:48460/0 (socket says 172.21.15.135:48460) 2024-05-14T09:41:33.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.756+0000 7f2f69e00640 1 -- 172.21.15.135:0/1066675601 learned_addr learned my addr 172.21.15.135:0/1066675601 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:33.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.760+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038634022 0 0) 0x7f2f640b39d0 con 0x7f2f64153eb0 2024-05-14T09:41:33.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.760+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f4c003520 con 0x7f2f64153eb0 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3964225224 0 0) 0x7f2f4c003520 con 0x7f2f64153eb0 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 >> v2:172.21.15.196:3300/0 conn(0x7f2f640c9880 msgr2=0x7f2f640ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 --2- 172.21.15.135:0/1066675601 >> v2:172.21.15.196:3300/0 conn(0x7f2f640c9880 0x7f2f640ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 >> v1:172.21.15.196:6789/0 conn(0x7f2f640c9350 legacy=0x7f2f6406e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f640710f0 con 0x7f2f64153eb0 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f2f5c001a90 con 0x7f2f64153eb0 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 >> v1:172.21.15.135:6789/0 conn(0x7f2f64153eb0 legacy=0x7f2f64159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 --2- 172.21.15.135:0/1066675601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f4c003a50 0x7f2f4c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 --2- 172.21.15.135:0/1066675601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4c004800 0x7f2f4c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 --2- 172.21.15.135:0/1066675601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f4c0053f0 0x7f2f4c00ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6406e880 con 0x7f2f4c004800 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c00c350 con 0x7f2f4c0053f0 2024-05-14T09:41:33.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.764+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2f4c00c550 con 0x7f2f4c003a50 2024-05-14T09:41:33.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.768+0000 7f2f68a00640 1 --2- 172.21.15.135:0/1066675601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4c004800 0x7f2f4c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:33.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.773+0000 7f2f68a00640 1 -- 172.21.15.135:0/1066675601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f4c003a50 msgr2=0x7f2f4c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:33.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.773+0000 7f2f68a00640 1 --2- 172.21.15.135:0/1066675601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f4c003a50 0x7f2f4c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:33.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.773+0000 7f2f68a00640 1 -- 172.21.15.135:0/1066675601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f4c0053f0 msgr2=0x7f2f4c00ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:33.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.773+0000 7f2f68a00640 1 --2- 172.21.15.135:0/1066675601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f4c0053f0 0x7f2f4c00ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:33.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.773+0000 7f2f68a00640 1 -- 172.21.15.135:0/1066675601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4c003520 con 0x7f2f4c004800 2024-05-14T09:41:33.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.773+0000 7f2f69e00640 1 -- 172.21.15.135:0/1066675601 reap_dead start 2024-05-14T09:41:33.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.776+0000 7f2f68a00640 1 --2- 172.21.15.135:0/1066675601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4c004800 0x7f2f4c004c10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2f50001640 tx=0x7f2f4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463d5db2b4b0bbbe server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:33.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.780+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50001240 con 0x7f2f4c004800 2024-05-14T09:41:33.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.780+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5002e070 con 0x7f2f4c004800 2024-05-14T09:41:33.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.780+0000 7f2f63e00640 1 -- 172.21.15.135:0/1066675601 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5002a7c0 con 0x7f2f4c004800 2024-05-14T09:41:33.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.781+0000 7f2f6a800640 1 -- 172.21.15.135:0/1066675601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4c004800 msgr2=0x7f2f4c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:33.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.781+0000 7f2f6a800640 1 --2- 172.21.15.135:0/1066675601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4c004800 0x7f2f4c004c10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2f50001640 tx=0x7f2f4c005830 comp rx=0 tx=0).stop 2024-05-14T09:41:33.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.781+0000 7f2f6a800640 1 -- 172.21.15.135:0/1066675601 shutdown_connections 2024-05-14T09:41:33.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.781+0000 7f2f6a800640 1 --2- 172.21.15.135:0/1066675601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f4c004800 0x7f2f4c004c10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:33.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.781+0000 7f2f6a800640 1 -- 172.21.15.135:0/1066675601 >> 172.21.15.135:0/1066675601 conn(0x7f2f640717d0 msgr2=0x7f2f64071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:33.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.781+0000 7f2f6a800640 1 -- 172.21.15.135:0/1066675601 shutdown_connections 2024-05-14T09:41:33.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.781+0000 7f2f6a800640 1 -- 172.21.15.135:0/1066675601 wait complete. 2024-05-14T09:41:33.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.784+0000 7f2f6a800640 1 Processor -- start 2024-05-14T09:41:33.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.784+0000 7f2f6a800640 1 -- start start 2024-05-14T09:41:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.786+0000 7f2f6a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f4c004800 0x7f2f64159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.786+0000 7f2f6a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f640ccf70 0x7f2f64149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.786+0000 7f2f6a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f640cd380 0x7f2f64149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.786+0000 7f2f6a800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f640b3c70 con 0x7f2f640ccf70 2024-05-14T09:41:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.786+0000 7f2f6a800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2f640c8b90 con 0x7f2f4c004800 2024-05-14T09:41:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.786+0000 7f2f6a800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2f640ca320 con 0x7f2f640cd380 2024-05-14T09:41:33.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.788+0000 7f2f68a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f640ccf70 0x7f2f64149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:33.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.789+0000 7f2f68a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f640ccf70 0x7f2f64149600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55496/0 (socket says 172.21.15.135:55496) 2024-05-14T09:41:33.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.789+0000 7f2f68a00640 1 -- 172.21.15.135:0/1272837603 learned_addr learned my addr 172.21.15.135:0/1272837603 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:33.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.790+0000 7f2f69e00640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f640cd380 0x7f2f64149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:33.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.793+0000 7f2f68a00640 1 -- 172.21.15.135:0/1272837603 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f640cd380 msgr2=0x7f2f64149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:33.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.793+0000 7f2f68a00640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f640cd380 0x7f2f64149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:33.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.793+0000 7f2f68a00640 1 -- 172.21.15.135:0/1272837603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f4c004800 msgr2=0x7f2f64159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:33.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.793+0000 7f2f68a00640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f4c004800 0x7f2f64159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:33.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.793+0000 7f2f68a00640 1 -- 172.21.15.135:0/1272837603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f64159ac0 con 0x7f2f640ccf70 2024-05-14T09:41:33.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.796+0000 7f2f68a00640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f640ccf70 0x7f2f64149600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2f5002ac40 tx=0x7f2f50000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:33.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.801+0000 7f2f61600640 1 -- 172.21.15.135:0/1272837603 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50043070 con 0x7f2f640ccf70 2024-05-14T09:41:33.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.801+0000 7f2f61600640 1 -- 172.21.15.135:0/1272837603 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f50003a20 con 0x7f2f640ccf70 2024-05-14T09:41:33.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.801+0000 7f2f61600640 1 -- 172.21.15.135:0/1272837603 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50001240 con 0x7f2f640ccf70 2024-05-14T09:41:33.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.802+0000 7f2f6a800640 1 -- 172.21.15.135:0/1272837603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f641f5680 con 0x7f2f640ccf70 2024-05-14T09:41:33.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.802+0000 7f2f6a800640 1 -- 172.21.15.135:0/1272837603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f641f1ee0 con 0x7f2f640ccf70 2024-05-14T09:41:33.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:33.803+0000 7f2f6a800640 1 -- 172.21.15.135:0/1272837603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6406c940 con 0x7f2f640ccf70 2024-05-14T09:41:34.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.143+0000 7f2f61600640 1 -- 172.21.15.135:0/1272837603 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2f50033470 con 0x7f2f640ccf70 2024-05-14T09:41:34.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.146+0000 7f2f61600640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f44076350 0x7f2f44078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:34.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.147+0000 7f2f69400640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f44076350 0x7f2f44078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:34.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.148+0000 7f2f69400640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f44076350 0x7f2f44078860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2f6406a9e0 tx=0x7f2f58006d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:34.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.172+0000 7f2f61600640 1 -- 172.21.15.135:0/1272837603 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f2f5007cc00 con 0x7f2f640ccf70 2024-05-14T09:41:34.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.173+0000 7f2f61600640 1 -- 172.21.15.135:0/1272837603 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2f5004c080 con 0x7f2f640ccf70 2024-05-14T09:41:34.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.461+0000 7f2f6a800640 1 -- 172.21.15.135:0/1272837603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2f6414a7d0 con 0x7f2f640ccf70 2024-05-14T09:41:34.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.650+0000 7f2f61600640 1 -- 172.21.15.135:0/1272837603 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189520 (secure 0 0 0) 0x7f2f5002ae20 con 0x7f2f640ccf70 2024-05-14T09:41:34.653 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:34.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.655+0000 7f2f6a800640 1 -- 172.21.15.135:0/1272837603 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f44076350 msgr2=0x7f2f44078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:34.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.655+0000 7f2f6a800640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f44076350 0x7f2f44078860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2f6406a9e0 tx=0x7f2f58006d00 comp rx=0 tx=0).stop 2024-05-14T09:41:34.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.655+0000 7f2f6a800640 1 -- 172.21.15.135:0/1272837603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f640ccf70 msgr2=0x7f2f64149600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:34.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.655+0000 7f2f6a800640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f640ccf70 0x7f2f64149600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2f5002ac40 tx=0x7f2f50000fb0 comp rx=0 tx=0).stop 2024-05-14T09:41:34.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.655+0000 7f2f6a800640 1 -- 172.21.15.135:0/1272837603 shutdown_connections 2024-05-14T09:41:34.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.655+0000 7f2f6a800640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f44076350 0x7f2f44078860 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:34.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.655+0000 7f2f6a800640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f640cd380 0x7f2f64149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:34.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.655+0000 7f2f6a800640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f640ccf70 0x7f2f64149600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:34.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.655+0000 7f2f6a800640 1 --2- 172.21.15.135:0/1272837603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f4c004800 0x7f2f64159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:34.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.655+0000 7f2f6a800640 1 -- 172.21.15.135:0/1272837603 >> 172.21.15.135:0/1272837603 conn(0x7f2f640717d0 msgr2=0x7f2f6414f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:34.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.655+0000 7f2f6a800640 1 -- 172.21.15.135:0/1272837603 shutdown_connections 2024-05-14T09:41:34.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.656+0000 7f2f6a800640 1 -- 172.21.15.135:0/1272837603 wait complete. 2024-05-14T09:41:34.683 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":88161500},{"type":"v1","addr":"172.21.15.135:6801","nonce":88161500}]},"active_addr":"172.21.15.135:6801/88161500","active_change":"2024-05-14T09:40:01.679632+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":747665791}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2333251193}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2287108193}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":213696976}]}]} 2024-05-14T09:41:34.688 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-14T09:41:34.688 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-14T09:41:34.688 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:41:34.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.947+0000 7f7750800640 1 Processor -- start 2024-05-14T09:41:34.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.947+0000 7f7750800640 1 -- start start 2024-05-14T09:41:34.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.949+0000 7f7750800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7748071fe0 0x7f7748154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:34.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.949+0000 7f7750800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7748074810 0x7f77480c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:34.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.949+0000 7f7750800640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f774815b160 con 0x7f77480c97c0 2024-05-14T09:41:34.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.949+0000 7f7750800640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f774815ac30 con 0x7f7748074810 2024-05-14T09:41:34.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.949+0000 7f7750800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f774815ae80 con 0x7f7748071fe0 2024-05-14T09:41:34.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.951+0000 7f774de00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7748071fe0 0x7f7748154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:34.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.952+0000 7f774de00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7748071fe0 0x7f7748154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:58770/0 (socket says 172.21.15.135:58770) 2024-05-14T09:41:34.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.952+0000 7f774de00640 1 -- 172.21.15.135:0/2882869827 learned_addr learned my addr 172.21.15.135:0/2882869827 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:34.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.955+0000 7f774d400640 1 --2- 172.21.15.135:0/2882869827 >> v2:172.21.15.135:3300/0 conn(0x7f7748074810 0x7f77480c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:34.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.960+0000 7f774ca00640 1 -- 172.21.15.135:0/2882869827 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300694061 0 0) 0x7f774815b160 con 0x7f77480c97c0 2024-05-14T09:41:34.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.960+0000 7f774ca00640 1 -- 172.21.15.135:0/2882869827 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7730003520 con 0x7f77480c97c0 2024-05-14T09:41:34.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.962+0000 7f774de00640 1 -- 172.21.15.135:0/2882869827 >> v2:172.21.15.135:3300/0 conn(0x7f7748074810 msgr2=0x7f77480c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:34.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.962+0000 7f774de00640 1 --2- 172.21.15.135:0/2882869827 >> v2:172.21.15.135:3300/0 conn(0x7f7748074810 0x7f77480c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:34.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.962+0000 7f774de00640 1 -- 172.21.15.135:0/2882869827 >> v1:172.21.15.135:6789/0 conn(0x7f77480c97c0 legacy=0x7f77480c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:34.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.962+0000 7f774de00640 1 -- 172.21.15.135:0/2882869827 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77480c8ce0 con 0x7f7748071fe0 2024-05-14T09:41:34.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.970+0000 7f774de00640 1 --2- 172.21.15.135:0/2882869827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7748071fe0 0x7f7748154550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7748073240 tx=0x7f773c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81bbd0129bc5ed77 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:34.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.982+0000 7f774ca00640 1 -- 172.21.15.135:0/2882869827 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c037070 con 0x7f7748071fe0 2024-05-14T09:41:34.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.982+0000 7f774ca00640 1 -- 172.21.15.135:0/2882869827 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f773c032440 con 0x7f7748071fe0 2024-05-14T09:41:34.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.982+0000 7f774ca00640 1 -- 172.21.15.135:0/2882869827 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c032810 con 0x7f7748071fe0 2024-05-14T09:41:34.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.983+0000 7f7750800640 1 -- 172.21.15.135:0/2882869827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7748071fe0 msgr2=0x7f7748154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:34.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.983+0000 7f7750800640 1 --2- 172.21.15.135:0/2882869827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7748071fe0 0x7f7748154550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7748073240 tx=0x7f773c02a270 comp rx=0 tx=0).stop 2024-05-14T09:41:34.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.984+0000 7f7750800640 1 -- 172.21.15.135:0/2882869827 shutdown_connections 2024-05-14T09:41:34.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.984+0000 7f7750800640 1 --2- 172.21.15.135:0/2882869827 >> v2:172.21.15.135:3300/0 conn(0x7f7748074810 0x7f77480c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:34.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.984+0000 7f7750800640 1 --2- 172.21.15.135:0/2882869827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7748071fe0 0x7f7748154550 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:34.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.984+0000 7f7750800640 1 -- 172.21.15.135:0/2882869827 >> 172.21.15.135:0/2882869827 conn(0x7f7748073cf0 msgr2=0x7f7748074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:34.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.984+0000 7f7750800640 1 -- 172.21.15.135:0/2882869827 shutdown_connections 2024-05-14T09:41:34.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.984+0000 7f7750800640 1 -- 172.21.15.135:0/2882869827 wait complete. 2024-05-14T09:41:34.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.987+0000 7f7750800640 1 Processor -- start 2024-05-14T09:41:34.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.988+0000 7f7750800640 1 -- start start 2024-05-14T09:41:34.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.989+0000 7f7750800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7748071fe0 0x7f77480cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:34.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.990+0000 7f7750800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7748074810 0x7f7748148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:34.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.990+0000 7f7750800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77480c97c0 0x7f77481557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:34.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.990+0000 7f7750800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f77480c72a0 con 0x7f77480c97c0 2024-05-14T09:41:34.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.990+0000 7f7750800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f77480c92a0 con 0x7f7748071fe0 2024-05-14T09:41:34.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.990+0000 7f7750800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f77480c7420 con 0x7f7748074810 2024-05-14T09:41:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.991+0000 7f774e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77480c97c0 0x7f77481557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.991+0000 7f774e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77480c97c0 0x7f77481557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55906/0 (socket says 172.21.15.135:55906) 2024-05-14T09:41:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.991+0000 7f774e800640 1 -- 172.21.15.135:0/306220150 learned_addr learned my addr 172.21.15.135:0/306220150 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:34.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.995+0000 7f774de00640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7748071fe0 0x7f77480cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:34.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.997+0000 7f774e800640 1 -- 172.21.15.135:0/306220150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7748074810 msgr2=0x7f7748148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:34.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.997+0000 7f774e800640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7748074810 0x7f7748148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:34.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.997+0000 7f774e800640 1 -- 172.21.15.135:0/306220150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7748071fe0 msgr2=0x7f77480cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:34.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.997+0000 7f774e800640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7748071fe0 0x7f77480cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:34.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:34.997+0000 7f774e800640 1 -- 172.21.15.135:0/306220150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77480cbce0 con 0x7f77480c97c0 2024-05-14T09:41:35.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.000+0000 7f774e800640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77480c97c0 0x7f77481557d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f774400c730 tx=0x7f774400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:35.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.013+0000 7f7742000640 1 -- 172.21.15.135:0/306220150 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744003b70 con 0x7f77480c97c0 2024-05-14T09:41:35.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.013+0000 7f7742000640 1 -- 172.21.15.135:0/306220150 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7744003d30 con 0x7f77480c97c0 2024-05-14T09:41:35.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.013+0000 7f7742000640 1 -- 172.21.15.135:0/306220150 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774400aa90 con 0x7f77480c97c0 2024-05-14T09:41:35.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.013+0000 7f7750800640 1 -- 172.21.15.135:0/306220150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77480cce90 con 0x7f77480c97c0 2024-05-14T09:41:35.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.013+0000 7f7750800640 1 -- 172.21.15.135:0/306220150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77480cbef0 con 0x7f77480c97c0 2024-05-14T09:41:35.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.015+0000 7f7750800640 1 -- 172.21.15.135:0/306220150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774806a3d0 con 0x7f77480c97c0 2024-05-14T09:41:35.190 INFO:tasks.ceph.mds.f.smithi196.stderr:2024-05-14T09:41:35.180+0000 13865640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-14T09:41:35.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.384+0000 7f7742000640 1 -- 172.21.15.135:0/306220150 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f774400ac30 con 0x7f77480c97c0 2024-05-14T09:41:35.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.386+0000 7f7742000640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f772c076320 0x7f772c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:35.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.387+0000 7f774de00640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f772c076320 0x7f772c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:35.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.389+0000 7f774de00640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f772c076320 0x7f772c078830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f773c034000 tx=0x7f773c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:35.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.414+0000 7f7742000640 1 -- 172.21.15.135:0/306220150 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f774401ae40 con 0x7f77480c97c0 2024-05-14T09:41:35.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.415+0000 7f7742000640 1 -- 172.21.15.135:0/306220150 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f774806a3d0 con 0x7f77480c97c0 2024-05-14T09:41:35.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.635+0000 7f7750800640 1 -- 172.21.15.135:0/306220150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7748076540 con 0x7f77480c97c0 2024-05-14T09:41:35.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.741+0000 7f7742000640 1 -- 172.21.15.135:0/306220150 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+18997 (secure 0 0 0) 0x7f7748076540 con 0x7f77480c97c0 2024-05-14T09:41:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:35.743 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":33,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:41:04.087625+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:40:40.770106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:40:43.375791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:40:51.210089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:41:35.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.745+0000 7f7750800640 1 -- 172.21.15.135:0/306220150 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f772c076320 msgr2=0x7f772c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:35.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.745+0000 7f7750800640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f772c076320 0x7f772c078830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f773c034000 tx=0x7f773c02e000 comp rx=0 tx=0).stop 2024-05-14T09:41:35.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.745+0000 7f7750800640 1 -- 172.21.15.135:0/306220150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77480c97c0 msgr2=0x7f77481557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:35.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.745+0000 7f7750800640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77480c97c0 0x7f77481557d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f774400c730 tx=0x7f774400cbf0 comp rx=0 tx=0).stop 2024-05-14T09:41:35.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.746+0000 7f7750800640 1 -- 172.21.15.135:0/306220150 shutdown_connections 2024-05-14T09:41:35.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.746+0000 7f7750800640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f772c076320 0x7f772c078830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:35.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.746+0000 7f7750800640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77480c97c0 0x7f77481557d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:35.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.746+0000 7f7750800640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7748074810 0x7f7748148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:35.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.746+0000 7f7750800640 1 --2- 172.21.15.135:0/306220150 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7748071fe0 0x7f77480cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:35.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.746+0000 7f7750800640 1 -- 172.21.15.135:0/306220150 >> 172.21.15.135:0/306220150 conn(0x7f7748073cf0 msgr2=0x7f774806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:35.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.746+0000 7f7750800640 1 -- 172.21.15.135:0/306220150 shutdown_connections 2024-05-14T09:41:35.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:35.746+0000 7f7750800640 1 -- 172.21.15.135:0/306220150 wait complete. 2024-05-14T09:41:35.776 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-14T09:41:35.776 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:41:36.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.041+0000 7fce10e00640 1 Processor -- start 2024-05-14T09:41:36.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.041+0000 7fce10e00640 1 -- start start 2024-05-14T09:41:36.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.043+0000 7fce10e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce0c074810 0x7fce0c154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:36.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.043+0000 7fce10e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce0c0c84d0 0x7fce0c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:36.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.043+0000 7fce10e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0c15b160 con 0x7fce0c071fe0 2024-05-14T09:41:36.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.044+0000 7fce10e00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fce0c15ac30 con 0x7fce0c0c84d0 2024-05-14T09:41:36.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.044+0000 7fce10e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fce0c15ae80 con 0x7fce0c074810 2024-05-14T09:41:36.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.045+0000 7fce0a800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce0c0c84d0 0x7fce0c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:36.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.045+0000 7fce0a800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fce0c0c84d0 0x7fce0c0c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55910/0 (socket says 172.21.15.135:55910) 2024-05-14T09:41:36.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.045+0000 7fce0a800640 1 -- 172.21.15.135:0/4280482695 learned_addr learned my addr 172.21.15.135:0/4280482695 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:36.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.046+0000 7fce03e00640 1 --2- 172.21.15.135:0/4280482695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce0c074810 0x7fce0c154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:36.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.048+0000 7fce0a800640 1 -- 172.21.15.135:0/4280482695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce0c074810 msgr2=0x7fce0c154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:36.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.048+0000 7fce0a800640 1 --2- 172.21.15.135:0/4280482695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce0c074810 0x7fce0c154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:36.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.048+0000 7fce0a800640 1 -- 172.21.15.135:0/4280482695 >> v1:172.21.15.196:6789/0 conn(0x7fce0c071fe0 legacy=0x7fce0c0c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:36.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.048+0000 7fce0a800640 1 -- 172.21.15.135:0/4280482695 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c0c8ce0 con 0x7fce0c0c84d0 2024-05-14T09:41:36.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.051+0000 7fce0a800640 1 --2- 172.21.15.135:0/4280482695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0c84d0 0x7fce0c0c6b90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fce04009e50 tx=0x7fce0402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a08be2adfd84bf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:36.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.056+0000 7fce09400640 1 -- 172.21.15.135:0/4280482695 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04036070 con 0x7fce0c0c84d0 2024-05-14T09:41:36.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.056+0000 7fce09400640 1 -- 172.21.15.135:0/4280482695 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce04031600 con 0x7fce0c0c84d0 2024-05-14T09:41:36.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.056+0000 7fce09400640 1 -- 172.21.15.135:0/4280482695 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce040319d0 con 0x7fce0c0c84d0 2024-05-14T09:41:36.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.057+0000 7fce10e00640 1 -- 172.21.15.135:0/4280482695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0c84d0 msgr2=0x7fce0c0c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:36.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.057+0000 7fce10e00640 1 --2- 172.21.15.135:0/4280482695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0c84d0 0x7fce0c0c6b90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fce04009e50 tx=0x7fce0402a730 comp rx=0 tx=0).stop 2024-05-14T09:41:36.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.057+0000 7fce10e00640 1 -- 172.21.15.135:0/4280482695 shutdown_connections 2024-05-14T09:41:36.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.057+0000 7fce10e00640 1 --2- 172.21.15.135:0/4280482695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0c84d0 0x7fce0c0c6b90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:36.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.057+0000 7fce10e00640 1 --2- 172.21.15.135:0/4280482695 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce0c074810 0x7fce0c154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:36.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.057+0000 7fce10e00640 1 -- 172.21.15.135:0/4280482695 >> 172.21.15.135:0/4280482695 conn(0x7fce0c073cf0 msgr2=0x7fce0c074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:36.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.057+0000 7fce10e00640 1 -- 172.21.15.135:0/4280482695 shutdown_connections 2024-05-14T09:41:36.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.057+0000 7fce10e00640 1 -- 172.21.15.135:0/4280482695 wait complete. 2024-05-14T09:41:36.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.061+0000 7fce10e00640 1 Processor -- start 2024-05-14T09:41:36.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.061+0000 7fce10e00640 1 -- start start 2024-05-14T09:41:36.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.062+0000 7fce10e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce0c071fe0 0x7fce0c15d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:36.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.062+0000 7fce10e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce0c074810 0x7fce0c14d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:36.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.062+0000 7fce10e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0c84d0 0x7fce0c1f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:36.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.062+0000 7fce10e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c0c88e0 con 0x7fce0c0c84d0 2024-05-14T09:41:36.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.062+0000 7fce10e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c0c92a0 con 0x7fce0c071fe0 2024-05-14T09:41:36.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.062+0000 7fce10e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fce0c06c6f0 con 0x7fce0c074810 2024-05-14T09:41:36.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.063+0000 7fce0a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0c84d0 0x7fce0c1f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:36.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.064+0000 7fce0a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0c84d0 0x7fce0c1f14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55922/0 (socket says 172.21.15.135:55922) 2024-05-14T09:41:36.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.064+0000 7fce0a800640 1 -- 172.21.15.135:0/3471411385 learned_addr learned my addr 172.21.15.135:0/3471411385 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:36.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.064+0000 7fce03e00640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce0c074810 0x7fce0c14d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:36.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.065+0000 7fce09e00640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce0c071fe0 0x7fce0c15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:36.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.068+0000 7fce0a800640 1 -- 172.21.15.135:0/3471411385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce0c074810 msgr2=0x7fce0c14d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:36.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.068+0000 7fce0a800640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce0c074810 0x7fce0c14d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:36.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.068+0000 7fce0a800640 1 -- 172.21.15.135:0/3471411385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce0c071fe0 msgr2=0x7fce0c15d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:36.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.068+0000 7fce0a800640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce0c071fe0 0x7fce0c15d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:36.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.069+0000 7fce0a800640 1 -- 172.21.15.135:0/3471411385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c15b410 con 0x7fce0c0c84d0 2024-05-14T09:41:36.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.072+0000 7fce0a800640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0c84d0 0x7fce0c1f14b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce04009e50 tx=0x7fce04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:36.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.076+0000 7fce02000640 1 -- 172.21.15.135:0/3471411385 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04041020 con 0x7fce0c0c84d0 2024-05-14T09:41:36.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.076+0000 7fce02000640 1 -- 172.21.15.135:0/3471411385 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce04008730 con 0x7fce0c0c84d0 2024-05-14T09:41:36.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.076+0000 7fce02000640 1 -- 172.21.15.135:0/3471411385 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04036040 con 0x7fce0c0c84d0 2024-05-14T09:41:36.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.076+0000 7fce10e00640 1 -- 172.21.15.135:0/3471411385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce0c15b6f0 con 0x7fce0c0c84d0 2024-05-14T09:41:36.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.076+0000 7fce10e00640 1 -- 172.21.15.135:0/3471411385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce0c15bcb0 con 0x7fce0c0c84d0 2024-05-14T09:41:36.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.077+0000 7fce10e00640 1 -- 172.21.15.135:0/3471411385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce0c069a90 con 0x7fce0c0c84d0 2024-05-14T09:41:36.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.412+0000 7fce02000640 1 -- 172.21.15.135:0/3471411385 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce04044020 con 0x7fce0c0c84d0 2024-05-14T09:41:36.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.416+0000 7fce02000640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fcde8076320 0x7fcde8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:36.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.417+0000 7fce09e00640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fcde8076320 0x7fcde8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:36.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.419+0000 7fce09e00640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fcde8076320 0x7fcde8078830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc001720 tx=0x7fcdfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:36.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.461+0000 7fce02000640 1 -- 172.21.15.135:0/3471411385 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fce0407db70 con 0x7fce0c0c84d0 2024-05-14T09:41:36.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.463+0000 7fce02000640 1 -- 172.21.15.135:0/3471411385 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce0404b030 con 0x7fce0c0c84d0 2024-05-14T09:41:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.687+0000 7fce10e00640 1 -- 172.21.15.135:0/3471411385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce0c0c7e80 con 0x7fce0c0c84d0 2024-05-14T09:41:36.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.784+0000 7fce02000640 1 -- 172.21.15.135:0/3471411385 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+18997 (secure 0 0 0) 0x7fce040818e0 con 0x7fce0c0c84d0 2024-05-14T09:41:36.785 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:36.785 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":33,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:41:04.087625+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:40:40.770106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:40:43.375791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:40:51.210089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:41:36.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.787+0000 7fce10e00640 1 -- 172.21.15.135:0/3471411385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fcde8076320 msgr2=0x7fcde8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:36.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.787+0000 7fce10e00640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fcde8076320 0x7fcde8078830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc001720 tx=0x7fcdfc009040 comp rx=0 tx=0).stop 2024-05-14T09:41:36.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.788+0000 7fce10e00640 1 -- 172.21.15.135:0/3471411385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0c84d0 msgr2=0x7fce0c1f14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:36.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.788+0000 7fce10e00640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0c84d0 0x7fce0c1f14b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce04009e50 tx=0x7fce04004a40 comp rx=0 tx=0).stop 2024-05-14T09:41:36.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.788+0000 7fce10e00640 1 -- 172.21.15.135:0/3471411385 shutdown_connections 2024-05-14T09:41:36.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.788+0000 7fce10e00640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fcde8076320 0x7fcde8078830 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:36.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.788+0000 7fce10e00640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce0c0c84d0 0x7fce0c1f14b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:36.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.788+0000 7fce10e00640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce0c074810 0x7fce0c14d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:36.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.788+0000 7fce10e00640 1 --2- 172.21.15.135:0/3471411385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce0c071fe0 0x7fce0c15d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:36.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.788+0000 7fce10e00640 1 -- 172.21.15.135:0/3471411385 >> 172.21.15.135:0/3471411385 conn(0x7fce0c073cf0 msgr2=0x7fce0c152910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:36.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.788+0000 7fce10e00640 1 -- 172.21.15.135:0/3471411385 shutdown_connections 2024-05-14T09:41:36.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:36.788+0000 7fce10e00640 1 -- 172.21.15.135:0/3471411385 wait complete. 2024-05-14T09:41:36.817 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-14T09:41:36.817 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-14T09:41:36.818 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-14T09:41:36.818 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-14T09:41:36.818 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-14T09:41:36.819 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-14T09:41:36.819 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-14T09:41:36.820 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-14T09:41:37.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.259+0000 7ff54da00640 1 Processor -- start 2024-05-14T09:41:37.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.260+0000 7ff54da00640 1 -- start start 2024-05-14T09:41:37.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.263+0000 7ff54da00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff548156940 0x7ff5480cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.263+0000 7ff54da00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5480cd660 0x7ff5480b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.264+0000 7ff54da00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54815c770 con 0x7ff548156530 2024-05-14T09:41:37.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.264+0000 7ff54da00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff54815ca50 con 0x7ff548156940 2024-05-14T09:41:37.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.264+0000 7ff54da00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff54815cd30 con 0x7ff5480cd660 2024-05-14T09:41:37.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.266+0000 7f7ab9800640 1 Processor -- start 2024-05-14T09:41:37.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.266+0000 7f7ab9800640 1 -- start start 2024-05-14T09:41:37.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.267+0000 7ff547400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5480cd660 0x7ff5480b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.268+0000 7ff547400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5480cd660 0x7ff5480b5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38488/0 (socket says 172.21.15.135:38488) 2024-05-14T09:41:37.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.268+0000 7ff547400640 1 -- 172.21.15.135:0/1674937633 learned_addr learned my addr 172.21.15.135:0/1674937633 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.269+0000 7f7ab9800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156530 0x7f7ab40b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.269+0000 7f7ab9800640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ab415c770 con 0x7f7ab4156940 2024-05-14T09:41:37.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.269+0000 7f7ab9800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ab415ca50 con 0x7f7ab40b5220 2024-05-14T09:41:37.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.269+0000 7f7ab9800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab415cd30 con 0x7f7ab4156530 2024-05-14T09:41:37.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.269+0000 7f486ea00640 1 Processor -- start 2024-05-14T09:41:37.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.269+0000 7f486ea00640 1 -- start start 2024-05-14T09:41:37.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.272+0000 7f7ab3400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f7ab40b5220 0x7f7ab40b5d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:44888/0 (socket says 172.21.15.135:44888) 2024-05-14T09:41:37.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.272+0000 7f7ab3400640 1 -- 172.21.15.135:0/904833543 learned_addr learned my addr 172.21.15.135:0/904833543 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:37.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.272+0000 7f486ea00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f48680747b0 0x7f48680c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.272+0000 7f486ea00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4868158940 0x7f4868158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.272+0000 7f486ea00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4868073870 con 0x7f48680ca690 2024-05-14T09:41:37.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.273+0000 7f486ea00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f486815b800 con 0x7f4868158940 2024-05-14T09:41:37.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.273+0000 7f486ea00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4868073b50 con 0x7f48680747b0 2024-05-14T09:41:37.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.276+0000 7ff547400640 1 -- 172.21.15.135:0/1674937633 >> v2:172.21.15.135:3300/0 conn(0x7ff548156940 msgr2=0x7ff5480cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.276+0000 7ff547400640 1 --2- 172.21.15.135:0/1674937633 >> v2:172.21.15.135:3300/0 conn(0x7ff548156940 0x7ff5480cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.277+0000 7ff547400640 1 -- 172.21.15.135:0/1674937633 >> v1:172.21.15.135:6789/0 conn(0x7ff548156530 legacy=0x7ff5480b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.277+0000 7ff547400640 1 -- 172.21.15.135:0/1674937633 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54815d010 con 0x7ff5480cd660 2024-05-14T09:41:37.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.279+0000 7fb772c00640 1 Processor -- start 2024-05-14T09:41:37.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.279+0000 7fb772c00640 1 -- start start 2024-05-14T09:41:37.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.279+0000 7fae16400640 1 Processor -- start 2024-05-14T09:41:37.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.280+0000 7f7ab2a00640 1 --2- 172.21.15.135:0/904833543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156530 0x7f7ab40b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.280+0000 7fae16400640 1 -- start start 2024-05-14T09:41:37.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.281+0000 7f4867400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f48680747b0 0x7f48680c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.281+0000 7f4867400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f48680747b0 0x7f48680c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:58810/0 (socket says 172.21.15.135:58810) 2024-05-14T09:41:37.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.281+0000 7f4867400640 1 -- 172.21.15.135:0/1350617821 learned_addr learned my addr 172.21.15.135:0/1350617821 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.282+0000 7f7ab1600640 1 -- 172.21.15.135:0/904833543 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3121898587 0 0) 0x7f7ab415ca50 con 0x7f7ab40b5220 2024-05-14T09:41:37.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.282+0000 7f7ab1600640 1 -- 172.21.15.135:0/904833543 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a98003520 con 0x7f7ab40b5220 2024-05-14T09:41:37.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.282+0000 7fb772c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb76c074860 0x7fb76c15f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.282+0000 7fb772c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb76c156780 0x7fb76c15fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.282+0000 7fb772c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76c0c88c0 con 0x7fb76c0c8310 2024-05-14T09:41:37.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.282+0000 7fb772c00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb76c15c480 con 0x7fb76c156780 2024-05-14T09:41:37.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.282+0000 7fb772c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb76c15c760 con 0x7fb76c074860 2024-05-14T09:41:37.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.283+0000 7fae16400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae100cb230 0x7fae100cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.283+0000 7fae16400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae1015a770 0x7fae1015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.283+0000 7fae16400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae100c5110 con 0x7fae100cad50 2024-05-14T09:41:37.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.283+0000 7fae16400640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fae100c4ee0 con 0x7fae100cb230 2024-05-14T09:41:37.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.283+0000 7fae16400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fae100c53d0 con 0x7fae1015a770 2024-05-14T09:41:37.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.284+0000 7f84d5200640 1 Processor -- start 2024-05-14T09:41:37.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.286+0000 7ff547400640 1 --2- 172.21.15.135:0/1674937633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5480cd660 0x7ff5480b5d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff540009e50 tx=0x7ff54002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13b4960e9afd218e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.284+0000 7f84d5200640 1 -- start start 2024-05-14T09:41:37.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.286+0000 7f84d5200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f84d006c6f0 0x7f84d00c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.286+0000 7f84d5200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d00c6910 0x7f84d0166e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.286+0000 7f84d5200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d00b5c80 con 0x7f84d00cdf50 2024-05-14T09:41:37.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.286+0000 7f84d5200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f84d00c74a0 con 0x7f84d006c6f0 2024-05-14T09:41:37.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.286+0000 7f84d5200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f84d00c7780 con 0x7f84d00c6910 2024-05-14T09:41:37.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.287+0000 7f4867400640 1 -- 172.21.15.135:0/1350617821 >> v2:172.21.15.135:3300/0 conn(0x7f4868158940 msgr2=0x7f4868158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.287+0000 7f4867400640 1 --2- 172.21.15.135:0/1350617821 >> v2:172.21.15.135:3300/0 conn(0x7f4868158940 0x7f4868158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.287+0000 7f4867400640 1 -- 172.21.15.135:0/1350617821 >> v1:172.21.15.135:6789/0 conn(0x7f48680ca690 legacy=0x7f4868152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.287+0000 7f4867400640 1 -- 172.21.15.135:0/1350617821 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4868073e30 con 0x7f48680747b0 2024-05-14T09:41:37.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.291+0000 7f4867400640 1 --2- 172.21.15.135:0/1350617821 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48680747b0 0x7f48680c7e80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f486806d7c0 tx=0x7f485802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=300cb96fe6929ef6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.292+0000 7f7ab2a00640 1 -- 172.21.15.135:0/904833543 >> v1:172.21.15.196:6789/0 conn(0x7f7ab40b5220 legacy=0x7f7ab40b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.292+0000 7f7ab2a00640 1 -- 172.21.15.135:0/904833543 >> v1:172.21.15.135:6789/0 conn(0x7f7ab4156940 legacy=0x7f7ab40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.292+0000 7f7ab2a00640 1 -- 172.21.15.135:0/904833543 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab415d010 con 0x7f7ab4156530 2024-05-14T09:41:37.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.296+0000 7fb770c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb76c156780 0x7fb76c15fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.297+0000 7fb770c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb76c156780 0x7fb76c15fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55946/0 (socket says 172.21.15.135:55946) 2024-05-14T09:41:37.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.297+0000 7fb770c00640 1 -- 172.21.15.135:0/2994304007 learned_addr learned my addr 172.21.15.135:0/2994304007 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.300+0000 7fae0fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae100cb230 0x7fae100cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.301+0000 7fae0fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae100cb230 0x7fae100cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55948/0 (socket says 172.21.15.135:55948) 2024-05-14T09:41:37.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.301+0000 7fae0fe00640 1 -- 172.21.15.135:0/4226093162 learned_addr learned my addr 172.21.15.135:0/4226093162 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.306+0000 7f7ab2a00640 1 --2- 172.21.15.135:0/904833543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156530 0x7f7ab40b4ce0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40097c0 tx=0x7f7aa402a1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72503e069af0fee1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.306+0000 7fbd25600640 1 Processor -- start 2024-05-14T09:41:37.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.306+0000 7fbd25600640 1 -- start start 2024-05-14T09:41:37.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.307+0000 7fae0fe00640 1 -- 172.21.15.135:0/4226093162 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae1015a770 msgr2=0x7fae1015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.307+0000 7fae0fe00640 1 --2- 172.21.15.135:0/4226093162 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae1015a770 0x7fae1015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.307+0000 7fae0fe00640 1 -- 172.21.15.135:0/4226093162 >> v1:172.21.15.196:6789/0 conn(0x7fae100cad50 legacy=0x7fae100c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.307+0000 7fae0fe00640 1 -- 172.21.15.135:0/4226093162 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae100c56b0 con 0x7fae100cb230 2024-05-14T09:41:37.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.309+0000 7fbd25600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd20165d60 0x7fbd20168180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.309+0000 7fbd25600640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd200c9db0 con 0x7fbd2006dc60 2024-05-14T09:41:37.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.309+0000 7fbd25600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd200b3200 con 0x7fbd20156800 2024-05-14T09:41:37.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.309+0000 7fbd25600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbd20156c10 con 0x7fbd20165d60 2024-05-14T09:41:37.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.310+0000 7fae0fe00640 1 --2- 172.21.15.135:0/4226093162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae100cb230 0x7fae100cb890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fae10072c40 tx=0x7fadfc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dabdcbe05a46f9a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.312+0000 7fbd1e000640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fbd2006dc60 0x7fbd2006e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:41410/0 (socket says 172.21.15.135:41410) 2024-05-14T09:41:37.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.312+0000 7fbd1e000640 1 -- 172.21.15.135:0/3945971560 learned_addr learned my addr 172.21.15.135:0/3945971560 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:37.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.313+0000 7f4866a00640 1 -- 172.21.15.135:0/1350617821 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858037070 con 0x7f48680747b0 2024-05-14T09:41:37.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.313+0000 7f4866a00640 1 -- 172.21.15.135:0/1350617821 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4858032440 con 0x7f48680747b0 2024-05-14T09:41:37.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.313+0000 7f4866a00640 1 -- 172.21.15.135:0/1350617821 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858032810 con 0x7f48680747b0 2024-05-14T09:41:37.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7fad01000640 1 Processor -- start 2024-05-14T09:41:37.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7fad01000640 1 -- start start 2024-05-14T09:41:37.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7f486ea00640 1 -- 172.21.15.135:0/1350617821 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48680747b0 msgr2=0x7f48680c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7f486ea00640 1 --2- 172.21.15.135:0/1350617821 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48680747b0 0x7f48680c7e80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f486806d7c0 tx=0x7f485802a1e0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7f486ea00640 1 -- 172.21.15.135:0/1350617821 shutdown_connections 2024-05-14T09:41:37.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7f486ea00640 1 --2- 172.21.15.135:0/1350617821 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48680747b0 0x7f48680c7e80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7f486ea00640 1 --2- 172.21.15.135:0/1350617821 >> v2:172.21.15.135:3300/0 conn(0x7f4868158940 0x7f4868158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7f486ea00640 1 -- 172.21.15.135:0/1350617821 >> 172.21.15.135:0/1350617821 conn(0x7f48680ce0e0 msgr2=0x7f48680c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7fb770c00640 1 -- 172.21.15.135:0/2994304007 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb76c074860 msgr2=0x7fb76c15f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7fb770c00640 1 --2- 172.21.15.135:0/2994304007 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb76c074860 0x7fb76c15f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7fb770c00640 1 -- 172.21.15.135:0/2994304007 >> v1:172.21.15.196:6789/0 conn(0x7fb76c0c8310 legacy=0x7fb76c0c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7fb770c00640 1 -- 172.21.15.135:0/2994304007 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c15ca40 con 0x7fb76c156780 2024-05-14T09:41:37.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7f486ea00640 1 -- 172.21.15.135:0/1350617821 shutdown_connections 2024-05-14T09:41:37.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.314+0000 7f486ea00640 1 -- 172.21.15.135:0/1350617821 wait complete. 2024-05-14T09:41:37.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.315+0000 7f84cde00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f84d006c6f0 0x7f84d00c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.316+0000 7fad01000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7facfc1532e0 0x7facfc15c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.316+0000 7fad01000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facfc0c5900 con 0x7facfc152ed0 2024-05-14T09:41:37.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.316+0000 7fad01000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facfc15d290 con 0x7facfc15cb50 2024-05-14T09:41:37.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.316+0000 7fad01000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7facfc15a510 con 0x7facfc1532e0 2024-05-14T09:41:37.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.317+0000 7f486ea00640 1 Processor -- start 2024-05-14T09:41:37.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.317+0000 7f84cde00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f84d006c6f0 0x7f84d00c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:58816/0 (socket says 172.21.15.135:58816) 2024-05-14T09:41:37.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.317+0000 7f84cde00640 1 -- 172.21.15.135:0/1808679869 learned_addr learned my addr 172.21.15.135:0/1808679869 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.318+0000 7f486ea00640 1 -- start start 2024-05-14T09:41:37.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.318+0000 7ff545600640 1 -- 172.21.15.135:0/1674937633 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540036070 con 0x7ff5480cd660 2024-05-14T09:41:37.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.318+0000 7ff545600640 1 -- 172.21.15.135:0/1674937633 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff540031600 con 0x7ff5480cd660 2024-05-14T09:41:37.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.319+0000 7ff545600640 1 -- 172.21.15.135:0/1674937633 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5400319d0 con 0x7ff5480cd660 2024-05-14T09:41:37.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7facf9e00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7facfc152ed0 0x7facfc0c60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:41416/0 (socket says 172.21.15.135:41416) 2024-05-14T09:41:37.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7facf9e00640 1 -- 172.21.15.135:0/3333970243 learned_addr learned my addr 172.21.15.135:0/3333970243 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:37.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7ff54da00640 1 -- 172.21.15.135:0/1674937633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5480cd660 msgr2=0x7ff5480b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7ff54da00640 1 --2- 172.21.15.135:0/1674937633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5480cd660 0x7ff5480b5d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff540009e50 tx=0x7ff54002a710 comp rx=0 tx=0).stop 2024-05-14T09:41:37.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7f486ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48680747b0 0x7f4868155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7f486ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48680ca690 0x7f4868153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7f486ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4868158940 0x7f4868138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7f486ea00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f48680c83c0 con 0x7f48680747b0 2024-05-14T09:41:37.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7f486ea00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4868158420 con 0x7f48680ca690 2024-05-14T09:41:37.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7f486ea00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f48680c86d0 con 0x7f4868158940 2024-05-14T09:41:37.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7fb770c00640 1 --2- 172.21.15.135:0/2994304007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76c156780 0x7fb76c15fea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb764009e50 tx=0x7fb76402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55458c2bbcd666c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7ff54da00640 1 -- 172.21.15.135:0/1674937633 shutdown_connections 2024-05-14T09:41:37.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7ff54da00640 1 --2- 172.21.15.135:0/1674937633 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5480cd660 0x7ff5480b5d40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7ff54da00640 1 --2- 172.21.15.135:0/1674937633 >> v2:172.21.15.135:3300/0 conn(0x7ff548156940 0x7ff5480cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.320+0000 7ff54da00640 1 -- 172.21.15.135:0/1674937633 >> 172.21.15.135:0/1674937633 conn(0x7ff5480ce1a0 msgr2=0x7ff5480ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.321+0000 7ff54da00640 1 -- 172.21.15.135:0/1674937633 shutdown_connections 2024-05-14T09:41:37.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.321+0000 7ff54da00640 1 -- 172.21.15.135:0/1674937633 wait complete. 2024-05-14T09:41:37.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.322+0000 7f84cde00640 1 -- 172.21.15.135:0/1808679869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d00c6910 msgr2=0x7f84d0166e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.322+0000 7f84cde00640 1 --2- 172.21.15.135:0/1808679869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d00c6910 0x7f84d0166e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.322+0000 7f84cde00640 1 -- 172.21.15.135:0/1808679869 >> v1:172.21.15.196:6789/0 conn(0x7f84d00cdf50 legacy=0x7f84d00cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.322+0000 7f84cde00640 1 -- 172.21.15.135:0/1808679869 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d00c7a60 con 0x7f84d006c6f0 2024-05-14T09:41:37.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.323+0000 7ff54da00640 1 Processor -- start 2024-05-14T09:41:37.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.323+0000 7ff54da00640 1 -- start start 2024-05-14T09:41:37.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.324+0000 7fbd1f400640 1 --2- 172.21.15.135:0/3945971560 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd20165d60 0x7fbd20168180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.325+0000 7ff54da00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5480cd660 0x7ff548158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.325+0000 7ff54da00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff548156530 0x7ff5481524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.325+0000 7ff54da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff548156940 0x7ff548157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.325+0000 7ff54da00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5480b4a60 con 0x7ff548156940 2024-05-14T09:41:37.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.325+0000 7ff54da00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff5480b5820 con 0x7ff5480cd660 2024-05-14T09:41:37.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.325+0000 7ff54da00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff54815c460 con 0x7ff548156530 2024-05-14T09:41:37.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.326+0000 7fbd1d600640 1 -- 172.21.15.135:0/3945971560 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034223027 0 0) 0x7fbd0c001110 con 0x7fbd2006dc60 2024-05-14T09:41:37.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.326+0000 7fbd1d600640 1 -- 172.21.15.135:0/3945971560 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd04003520 con 0x7fbd2006dc60 2024-05-14T09:41:37.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.329+0000 7fae0f400640 1 -- 172.21.15.135:0/4226093162 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc037070 con 0x7fae100cb230 2024-05-14T09:41:37.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.329+0000 7fae0f400640 1 -- 172.21.15.135:0/4226093162 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadfc032440 con 0x7fae100cb230 2024-05-14T09:41:37.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.329+0000 7fae0f400640 1 -- 172.21.15.135:0/4226093162 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc032810 con 0x7fae100cb230 2024-05-14T09:41:37.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.329+0000 7facf9400640 1 --2- 172.21.15.135:0/3333970243 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7facfc1532e0 0x7facfc15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.330+0000 7fae16400640 1 -- 172.21.15.135:0/4226093162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae100cb230 msgr2=0x7fae100cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.330+0000 7fae16400640 1 --2- 172.21.15.135:0/4226093162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae100cb230 0x7fae100cb890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fae10072c40 tx=0x7fadfc02a230 comp rx=0 tx=0).stop 2024-05-14T09:41:37.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.330+0000 7fae16400640 1 -- 172.21.15.135:0/4226093162 shutdown_connections 2024-05-14T09:41:37.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.330+0000 7fae16400640 1 --2- 172.21.15.135:0/4226093162 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae1015a770 0x7fae1015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.330+0000 7fae16400640 1 --2- 172.21.15.135:0/4226093162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae100cb230 0x7fae100cb890 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.330+0000 7fae16400640 1 -- 172.21.15.135:0/4226093162 >> 172.21.15.135:0/4226093162 conn(0x7fae100cf780 msgr2=0x7fae100cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.330+0000 7fae16400640 1 -- 172.21.15.135:0/4226093162 shutdown_connections 2024-05-14T09:41:37.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.330+0000 7fae16400640 1 -- 172.21.15.135:0/4226093162 wait complete. 2024-05-14T09:41:37.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.331+0000 7f84cde00640 1 --2- 172.21.15.135:0/1808679869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d006c6f0 0x7f84d00c8540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f84d00b5e50 tx=0x7f84c002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6afa909124a365d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.331+0000 7fb76aa00640 1 -- 172.21.15.135:0/2994304007 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764036070 con 0x7fb76c156780 2024-05-14T09:41:37.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.332+0000 7fb76aa00640 1 -- 172.21.15.135:0/2994304007 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb764031600 con 0x7fb76c156780 2024-05-14T09:41:37.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.332+0000 7fb76aa00640 1 -- 172.21.15.135:0/2994304007 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7640319d0 con 0x7fb76c156780 2024-05-14T09:41:37.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.332+0000 7fae16400640 1 Processor -- start 2024-05-14T09:41:37.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.332+0000 7facf9400640 1 -- 172.21.15.135:0/3333970243 >> v1:172.21.15.196:6789/0 conn(0x7facfc15cb50 legacy=0x7facfc1639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.332+0000 7fb772c00640 1 -- 172.21.15.135:0/2994304007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76c156780 msgr2=0x7fb76c15fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.332+0000 7fb772c00640 1 --2- 172.21.15.135:0/2994304007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76c156780 0x7fb76c15fea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb764009e50 tx=0x7fb76402a680 comp rx=0 tx=0).stop 2024-05-14T09:41:37.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.332+0000 7fae16400640 1 -- start start 2024-05-14T09:41:37.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.332+0000 7facf9400640 1 -- 172.21.15.135:0/3333970243 >> v1:172.21.15.135:6789/0 conn(0x7facfc152ed0 legacy=0x7facfc0c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.332+0000 7facf9400640 1 -- 172.21.15.135:0/3333970243 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc1536f0 con 0x7facfc1532e0 2024-05-14T09:41:37.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.333+0000 7fb772c00640 1 -- 172.21.15.135:0/2994304007 shutdown_connections 2024-05-14T09:41:37.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.333+0000 7fb772c00640 1 --2- 172.21.15.135:0/2994304007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76c156780 0x7fb76c15fea0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.333+0000 7fb772c00640 1 --2- 172.21.15.135:0/2994304007 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb76c074860 0x7fb76c15f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.333+0000 7fb772c00640 1 -- 172.21.15.135:0/2994304007 >> 172.21.15.135:0/2994304007 conn(0x7fb76c073d40 msgr2=0x7fb76c074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.333+0000 7fb772c00640 1 -- 172.21.15.135:0/2994304007 shutdown_connections 2024-05-14T09:41:37.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.333+0000 7f4867400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48680ca690 0x7f4868153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.333+0000 7fb772c00640 1 -- 172.21.15.135:0/2994304007 wait complete. 2024-05-14T09:41:37.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.334+0000 7fae16400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae100cad50 0x7fae101f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.334+0000 7fae16400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae100cb230 0x7fae1006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.334+0000 7fae16400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae1015a770 0x7fae101532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.334+0000 7fae16400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fae101547e0 con 0x7fae100cb230 2024-05-14T09:41:37.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.334+0000 7fae16400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fae1015b0c0 con 0x7fae1015a770 2024-05-14T09:41:37.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.334+0000 7fae16400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fae100c5990 con 0x7fae100cad50 2024-05-14T09:41:37.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.336+0000 7f4867e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48680747b0 0x7f4868155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.336+0000 7fb772c00640 1 Processor -- start 2024-05-14T09:41:37.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.336+0000 7fb772c00640 1 -- start start 2024-05-14T09:41:37.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.337+0000 7fb772c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb76c074860 0x7fb76c14e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.337+0000 7fb772c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb76c0c8310 0x7fb76c150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.337+0000 7fb772c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76c156780 0x7fb76c0716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.337+0000 7fb772c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c0c75a0 con 0x7fb76c156780 2024-05-14T09:41:37.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.337+0000 7fb772c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c0c9150 con 0x7fb76c0c8310 2024-05-14T09:41:37.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.337+0000 7fb772c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb76c0c7720 con 0x7fb76c074860 2024-05-14T09:41:37.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.338+0000 7f4867e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48680747b0 0x7f4868155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55960/0 (socket says 172.21.15.135:55960) 2024-05-14T09:41:37.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.338+0000 7f4867e00640 1 -- 172.21.15.135:0/2765632673 learned_addr learned my addr 172.21.15.135:0/2765632673 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.340+0000 7ff547400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff548156940 0x7ff548157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.340+0000 7ff547400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff548156940 0x7ff548157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55962/0 (socket says 172.21.15.135:55962) 2024-05-14T09:41:37.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.340+0000 7ff547400640 1 -- 172.21.15.135:0/3232975398 learned_addr learned my addr 172.21.15.135:0/3232975398 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.341+0000 7fbd1f400640 1 -- 172.21.15.135:0/3945971560 >> v1:172.21.15.196:6789/0 conn(0x7fbd20156800 legacy=0x7fbd2015cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.341+0000 7fbd1f400640 1 -- 172.21.15.135:0/3945971560 >> v1:172.21.15.135:6789/0 conn(0x7fbd2006dc60 legacy=0x7fbd2006e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.341+0000 7fbd1f400640 1 -- 172.21.15.135:0/3945971560 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd200b34a0 con 0x7fbd20165d60 2024-05-14T09:41:37.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.344+0000 7f4867e00640 1 -- 172.21.15.135:0/2765632673 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4868158940 msgr2=0x7f4868138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.344+0000 7f4867e00640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4868158940 0x7f4868138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.344+0000 7f4867e00640 1 -- 172.21.15.135:0/2765632673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48680ca690 msgr2=0x7f4868153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.344+0000 7f4867e00640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48680ca690 0x7f4868153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.344+0000 7f4867e00640 1 -- 172.21.15.135:0/2765632673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4868153280 con 0x7f48680747b0 2024-05-14T09:41:37.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.344+0000 7f4867400640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48680ca690 0x7f4868153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:41:37.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.347+0000 7f7ab1600640 1 -- 172.21.15.135:0/904833543 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4037070 con 0x7f7ab4156530 2024-05-14T09:41:37.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.348+0000 7f7ab1600640 1 -- 172.21.15.135:0/904833543 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4032440 con 0x7f7ab4156530 2024-05-14T09:41:37.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.348+0000 7f7ab1600640 1 -- 172.21.15.135:0/904833543 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4032810 con 0x7f7ab4156530 2024-05-14T09:41:37.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.348+0000 7fbd1f400640 1 --2- 172.21.15.135:0/3945971560 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd20165d60 0x7fbd20168180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd200b33d0 tx=0x7fbd1802a590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1914a0744e125a8e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.349+0000 7f7ab9800640 1 -- 172.21.15.135:0/904833543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156530 msgr2=0x7f7ab40b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.349+0000 7f7ab9800640 1 --2- 172.21.15.135:0/904833543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156530 0x7f7ab40b4ce0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40097c0 tx=0x7f7aa402a1f0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.349+0000 7f7ab9800640 1 -- 172.21.15.135:0/904833543 shutdown_connections 2024-05-14T09:41:37.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.349+0000 7fb770c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76c156780 0x7fb76c0716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.349+0000 7f7ab9800640 1 --2- 172.21.15.135:0/904833543 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156530 0x7f7ab40b4ce0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.349+0000 7f7ab9800640 1 -- 172.21.15.135:0/904833543 >> 172.21.15.135:0/904833543 conn(0x7f7ab40ce1a0 msgr2=0x7f7ab40ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.349+0000 7f7ab9800640 1 -- 172.21.15.135:0/904833543 shutdown_connections 2024-05-14T09:41:37.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.349+0000 7f7ab9800640 1 -- 172.21.15.135:0/904833543 wait complete. 2024-05-14T09:41:37.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.351+0000 7f84cca00640 1 -- 172.21.15.135:0/1808679869 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0037070 con 0x7f84d006c6f0 2024-05-14T09:41:37.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.351+0000 7f84cca00640 1 -- 172.21.15.135:0/1808679869 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c0032440 con 0x7f84d006c6f0 2024-05-14T09:41:37.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.351+0000 7f84cca00640 1 -- 172.21.15.135:0/1808679869 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0032810 con 0x7f84d006c6f0 2024-05-14T09:41:37.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.351+0000 7ff546a00640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5480cd660 0x7ff548158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.351+0000 7f7ab9800640 1 Processor -- start 2024-05-14T09:41:37.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.351+0000 7f7ab9800640 1 -- start start 2024-05-14T09:41:37.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.352+0000 7f84d5200640 1 -- 172.21.15.135:0/1808679869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d006c6f0 msgr2=0x7f84d00c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.352+0000 7f84d5200640 1 --2- 172.21.15.135:0/1808679869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d006c6f0 0x7f84d00c8540 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f84d00b5e50 tx=0x7f84c002a1c0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.352+0000 7f84d5200640 1 -- 172.21.15.135:0/1808679869 shutdown_connections 2024-05-14T09:41:37.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.352+0000 7f84d5200640 1 --2- 172.21.15.135:0/1808679869 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d00c6910 0x7f84d0166e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.352+0000 7f84d5200640 1 --2- 172.21.15.135:0/1808679869 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d006c6f0 0x7f84d00c8540 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.352+0000 7f84d5200640 1 -- 172.21.15.135:0/1808679869 >> 172.21.15.135:0/1808679869 conn(0x7f84d00ce3f0 msgr2=0x7f84d00ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.352+0000 7f84d5200640 1 -- 172.21.15.135:0/1808679869 shutdown_connections 2024-05-14T09:41:37.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.352+0000 7f84d5200640 1 -- 172.21.15.135:0/1808679869 wait complete. 2024-05-14T09:41:37.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.352+0000 7ff547400640 1 -- 172.21.15.135:0/3232975398 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff548156530 msgr2=0x7ff5481524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.352+0000 7ff547400640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff548156530 0x7ff5481524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.352+0000 7ff547400640 1 -- 172.21.15.135:0/3232975398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5480cd660 msgr2=0x7ff548158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.353+0000 7ff547400640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5480cd660 0x7ff548158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.353+0000 7ff547400640 1 -- 172.21.15.135:0/3232975398 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5481590a0 con 0x7ff548156940 2024-05-14T09:41:37.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.353+0000 7f4867e00640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48680747b0 0x7f4868155460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f486000ba80 tx=0x7f486000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.353+0000 7fb770c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76c156780 0x7fb76c0716b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55986/0 (socket says 172.21.15.135:55986) 2024-05-14T09:41:37.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.353+0000 7fb770c00640 1 -- 172.21.15.135:0/961865202 learned_addr learned my addr 172.21.15.135:0/961865202 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.353+0000 7f7ab9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ab40b5220 0x7f7ab415ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.353+0000 7f7ab9800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ab4156530 0x7f7ab415fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.353+0000 7f7ab9800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156940 0x7f7ab4154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.353+0000 7f7ab9800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab40b4a60 con 0x7f7ab40b5220 2024-05-14T09:41:37.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.353+0000 7f7ab9800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab40b5820 con 0x7f7ab4156530 2024-05-14T09:41:37.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.353+0000 7f7ab9800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab415c460 con 0x7f7ab4156940 2024-05-14T09:41:37.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.354+0000 7facf9400640 1 --2- 172.21.15.135:0/3333970243 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7facfc1532e0 0x7facfc15c610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7face80097d0 tx=0x7face802c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87bde7946a684535 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.355+0000 7f84d5200640 1 Processor -- start 2024-05-14T09:41:37.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.355+0000 7f84d5200640 1 -- start start 2024-05-14T09:41:37.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.356+0000 7f84d5200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d006c6f0 0x7f84d00d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.356+0000 7f84d5200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d00c6910 0x7f84d014a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.356+0000 7f84d5200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84d00cdf50 0x7f84d014c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.356+0000 7f84d5200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f84d00c8a80 con 0x7f84d00cdf50 2024-05-14T09:41:37.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.356+0000 7f84d5200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f84d00c8020 con 0x7f84d00c6910 2024-05-14T09:41:37.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.356+0000 7f84d5200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f84d00cd870 con 0x7f84d006c6f0 2024-05-14T09:41:37.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.359+0000 7ff547400640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff548156940 0x7ff548157b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff540009e50 tx=0x7ff540004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.359+0000 7fae15a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae1015a770 0x7fae101532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.359+0000 7fae15a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae1015a770 0x7fae101532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:58828/0 (socket says 172.21.15.135:58828) 2024-05-14T09:41:37.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.359+0000 7fae15a00640 1 -- 172.21.15.135:0/4220142355 learned_addr learned my addr 172.21.15.135:0/4220142355 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.362+0000 7fb770c00640 1 -- 172.21.15.135:0/961865202 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb76c074860 msgr2=0x7fb76c14e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.362+0000 7fb770c00640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb76c074860 0x7fb76c14e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.362+0000 7fb770c00640 1 -- 172.21.15.135:0/961865202 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb76c0c8310 msgr2=0x7fb76c150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.362+0000 7fb770c00640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb76c0c8310 0x7fb76c150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.362+0000 7fb770c00640 1 -- 172.21.15.135:0/961865202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c14edb0 con 0x7fb76c156780 2024-05-14T09:41:37.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.370+0000 7f485fe00640 1 -- 172.21.15.135:0/2765632673 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860019070 con 0x7f48680747b0 2024-05-14T09:41:37.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.370+0000 7f485fe00640 1 -- 172.21.15.135:0/2765632673 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486000cc90 con 0x7f48680747b0 2024-05-14T09:41:37.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.370+0000 7f485fe00640 1 -- 172.21.15.135:0/2765632673 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860014680 con 0x7f48680747b0 2024-05-14T09:41:37.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.370+0000 7f486ea00640 1 -- 172.21.15.135:0/2765632673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48681559a0 con 0x7f48680747b0 2024-05-14T09:41:37.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.370+0000 7f486ea00640 1 -- 172.21.15.135:0/2765632673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4868152cc0 con 0x7f48680747b0 2024-05-14T09:41:37.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.371+0000 7fae15a00640 1 -- 172.21.15.135:0/4220142355 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae100cad50 msgr2=0x7fae101f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.371+0000 7fae15a00640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fae100cad50 0x7fae101f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.371+0000 7fae15a00640 1 -- 172.21.15.135:0/4220142355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae100cb230 msgr2=0x7fae1006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.371+0000 7fae15a00640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae100cb230 0x7fae1006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.371+0000 7fae15a00640 1 -- 172.21.15.135:0/4220142355 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1006e9d0 con 0x7fae1015a770 2024-05-14T09:41:37.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.371+0000 7f486ea00640 1 -- 172.21.15.135:0/2765632673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4868069980 con 0x7f48680747b0 2024-05-14T09:41:37.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.372+0000 7fb770c00640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76c156780 0x7fb76c0716b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb764034040 tx=0x7fb764004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.382+0000 7fbd1d600640 1 -- 172.21.15.135:0/3945971560 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18007740 con 0x7fbd20165d60 2024-05-14T09:41:37.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.382+0000 7fbd1d600640 1 -- 172.21.15.135:0/3945971560 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd180078e0 con 0x7fbd20165d60 2024-05-14T09:41:37.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.382+0000 7fbd1d600640 1 -- 172.21.15.135:0/3945971560 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18007cb0 con 0x7fbd20165d60 2024-05-14T09:41:37.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.383+0000 7fbd25600640 1 -- 172.21.15.135:0/3945971560 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd20165d60 msgr2=0x7fbd20168180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.383+0000 7fbd25600640 1 --2- 172.21.15.135:0/3945971560 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd20165d60 0x7fbd20168180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbd200b33d0 tx=0x7fbd1802a590 comp rx=0 tx=0).stop 2024-05-14T09:41:37.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.383+0000 7fbd25600640 1 -- 172.21.15.135:0/3945971560 shutdown_connections 2024-05-14T09:41:37.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.383+0000 7fbd25600640 1 --2- 172.21.15.135:0/3945971560 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd20165d60 0x7fbd20168180 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.383+0000 7fbd25600640 1 -- 172.21.15.135:0/3945971560 >> 172.21.15.135:0/3945971560 conn(0x7fbd200cac60 msgr2=0x7fbd200cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.384+0000 7fbd25600640 1 -- 172.21.15.135:0/3945971560 shutdown_connections 2024-05-14T09:41:37.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.384+0000 7fbd25600640 1 -- 172.21.15.135:0/3945971560 wait complete. 2024-05-14T09:41:37.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.386+0000 7fae15a00640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae1015a770 0x7fae101532f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fae0800b9e0 tx=0x7fae0800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.386+0000 7fbd25600640 1 Processor -- start 2024-05-14T09:41:37.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.386+0000 7fbd25600640 1 -- start start 2024-05-14T09:41:37.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.387+0000 7facf8a00640 1 -- 172.21.15.135:0/3333970243 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8038070 con 0x7facfc1532e0 2024-05-14T09:41:37.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.387+0000 7facf8a00640 1 -- 172.21.15.135:0/3333970243 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face8031710 con 0x7facfc1532e0 2024-05-14T09:41:37.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.387+0000 7facf8a00640 1 -- 172.21.15.135:0/3333970243 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8031ae0 con 0x7facfc1532e0 2024-05-14T09:41:37.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fad01000640 1 -- 172.21.15.135:0/3333970243 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7facfc1532e0 msgr2=0x7facfc15c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fbd25600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd2006dc60 0x7fbd201548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fad01000640 1 --2- 172.21.15.135:0/3333970243 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7facfc1532e0 0x7facfc15c610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7face80097d0 tx=0x7face802c400 comp rx=0 tx=0).stop 2024-05-14T09:41:37.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fbd25600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd20156800 0x7fbd201f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fbd25600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd20165d60 0x7fbd201591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fbd25600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2015c630 con 0x7fbd20156800 2024-05-14T09:41:37.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fbd25600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbd200c30d0 con 0x7fbd2006dc60 2024-05-14T09:41:37.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fbd25600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbd200c4020 con 0x7fbd20165d60 2024-05-14T09:41:37.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fad01000640 1 -- 172.21.15.135:0/3333970243 shutdown_connections 2024-05-14T09:41:37.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fad01000640 1 --2- 172.21.15.135:0/3333970243 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7facfc1532e0 0x7facfc15c610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fad01000640 1 -- 172.21.15.135:0/3333970243 >> 172.21.15.135:0/3333970243 conn(0x7facfc073d40 msgr2=0x7facfc074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fad01000640 1 -- 172.21.15.135:0/3333970243 shutdown_connections 2024-05-14T09:41:37.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.388+0000 7fad01000640 1 -- 172.21.15.135:0/3333970243 wait complete. 2024-05-14T09:41:37.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.390+0000 7fad01000640 1 Processor -- start 2024-05-14T09:41:37.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.390+0000 7fad01000640 1 -- start start 2024-05-14T09:41:37.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.391+0000 7f7ab2000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ab4156530 0x7f7ab415fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.391+0000 7f84cd400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d00c6910 0x7f84d014a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.391+0000 7f7ab3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156940 0x7f7ab4154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.392+0000 7fad01000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facfc152ed0 0x7facfc1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.392+0000 7fad01000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7facfc1532e0 0x7facfc1f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.392+0000 7fad01000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7facfc15cb50 0x7facfc148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.392+0000 7fad01000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7facfc0c5c10 con 0x7facfc152ed0 2024-05-14T09:41:37.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.392+0000 7fad01000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7facfc06c6f0 con 0x7facfc15cb50 2024-05-14T09:41:37.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.392+0000 7fad01000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7facfc06cc20 con 0x7facfc1532e0 2024-05-14T09:41:37.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.392+0000 7f7ab3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156940 0x7f7ab4154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38594/0 (socket says 172.21.15.135:38594) 2024-05-14T09:41:37.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.392+0000 7f7ab3400640 1 -- 172.21.15.135:0/2079879287 learned_addr learned my addr 172.21.15.135:0/2079879287 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.394+0000 7f84cd400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d00c6910 0x7f84d014a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:58846/0 (socket says 172.21.15.135:58846) 2024-05-14T09:41:37.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.394+0000 7f84cd400640 1 -- 172.21.15.135:0/3451784188 learned_addr learned my addr 172.21.15.135:0/3451784188 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.399+0000 7f485fe00640 1 -- 172.21.15.135:0/2765632673 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f486001c070 con 0x7f48680747b0 2024-05-14T09:41:37.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.400+0000 7f485fe00640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4848076320 0x7f4848078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.400+0000 7f4867400640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4848076320 0x7f4848078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.401+0000 7f4867400640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4848076320 0x7f4848078830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4858034000 tx=0x7f485802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.403+0000 7fae0cc00640 1 -- 172.21.15.135:0/4220142355 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08019070 con 0x7fae1015a770 2024-05-14T09:41:37.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.403+0000 7fae0cc00640 1 -- 172.21.15.135:0/4220142355 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0800cb40 con 0x7fae1015a770 2024-05-14T09:41:37.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.403+0000 7fae0cc00640 1 -- 172.21.15.135:0/4220142355 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08014440 con 0x7fae1015a770 2024-05-14T09:41:37.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.403+0000 7fae16400640 1 -- 172.21.15.135:0/4220142355 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1014fcb0 con 0x7fae1015a770 2024-05-14T09:41:37.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.403+0000 7fae16400640 1 -- 172.21.15.135:0/4220142355 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae10150270 con 0x7fae1015a770 2024-05-14T09:41:37.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.404+0000 7fae16400640 1 -- 172.21.15.135:0/4220142355 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae10069980 con 0x7fae1015a770 2024-05-14T09:41:37.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.406+0000 7f485fe00640 1 -- 172.21.15.135:0/2765632673 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f486005d050 con 0x7f48680747b0 2024-05-14T09:41:37.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.406+0000 7f485fe00640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] conn(0x7f484807fe00 0x7f48480822f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.406+0000 7f485fe00640 1 -- 172.21.15.135:0/2765632673 --> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4860020e50 con 0x7f484807fe00 2024-05-14T09:41:37.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.406+0000 7f485fe00640 1 -- 172.21.15.135:0/2765632673 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f486005d410 con 0x7f48680747b0 2024-05-14T09:41:37.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.406+0000 7f7ab3400640 1 -- 172.21.15.135:0/2079879287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ab4156530 msgr2=0x7f7ab415fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.406+0000 7f7ab3400640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ab4156530 0x7f7ab415fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.406+0000 7f7ab3400640 1 -- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ab40b5220 msgr2=0x7f7ab415ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.406+0000 7f7ab3400640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ab40b5220 0x7f7ab415ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.406+0000 7f486ca00640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] conn(0x7f484807fe00 0x7f48480822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.406+0000 7f7ab3400640 1 -- 172.21.15.135:0/2079879287 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab415f130 con 0x7f7ab4156940 2024-05-14T09:41:37.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.407+0000 7f486ca00640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] conn(0x7f484807fe00 0x7f48480822f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.408+0000 7f485fe00640 1 -- 172.21.15.135:0/2765632673 <== osd.3 v2:172.21.15.135:6802/3064760126 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4860020e50 con 0x7f484807fe00 2024-05-14T09:41:37.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.410+0000 7ff53ea00640 1 -- 172.21.15.135:0/3232975398 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540041020 con 0x7ff548156940 2024-05-14T09:41:37.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.410+0000 7ff53ea00640 1 -- 172.21.15.135:0/3232975398 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff540037040 con 0x7ff548156940 2024-05-14T09:41:37.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.410+0000 7ff53ea00640 1 -- 172.21.15.135:0/3232975398 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540036070 con 0x7ff548156940 2024-05-14T09:41:37.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.410+0000 7ff54da00640 1 -- 172.21.15.135:0/3232975398 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff548153280 con 0x7ff548156940 2024-05-14T09:41:37.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.410+0000 7ff54da00640 1 -- 172.21.15.135:0/3232975398 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff548153840 con 0x7ff548156940 2024-05-14T09:41:37.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.411+0000 7ff54da00640 1 -- 172.21.15.135:0/3232975398 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff548069980 con 0x7ff548156940 2024-05-14T09:41:37.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.412+0000 7fb763e00640 1 -- 172.21.15.135:0/961865202 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764041020 con 0x7fb76c156780 2024-05-14T09:41:37.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.412+0000 7fb763e00640 1 -- 172.21.15.135:0/961865202 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb764007780 con 0x7fb76c156780 2024-05-14T09:41:37.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.412+0000 7fb763e00640 1 -- 172.21.15.135:0/961865202 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764036040 con 0x7fb76c156780 2024-05-14T09:41:37.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.413+0000 7fb772c00640 1 -- 172.21.15.135:0/961865202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76c151f00 con 0x7fb76c156780 2024-05-14T09:41:37.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.413+0000 7fb772c00640 1 -- 172.21.15.135:0/961865202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb76c14e070 con 0x7fb76c156780 2024-05-14T09:41:37.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.414+0000 7fb772c00640 1 -- 172.21.15.135:0/961865202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb76c1521e0 con 0x7fb76c156780 2024-05-14T09:41:37.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.415+0000 7f84cd400640 1 -- 172.21.15.135:0/3451784188 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d006c6f0 msgr2=0x7f84d00d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.415+0000 7f84cd400640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84d006c6f0 0x7f84d00d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.415+0000 7f84cd400640 1 -- 172.21.15.135:0/3451784188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84d00cdf50 msgr2=0x7f84d014c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.415+0000 7f84cd400640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84d00cdf50 0x7f84d014c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.415+0000 7f84cd400640 1 -- 172.21.15.135:0/3451784188 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d014a760 con 0x7f84d00c6910 2024-05-14T09:41:37.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.424+0000 7f7ab3400640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156940 0x7f7ab4154860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00cad0 tx=0x7f7aac00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.426+0000 7facf9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facfc152ed0 0x7facfc1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.428+0000 7facf9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facfc152ed0 0x7facfc1560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56018/0 (socket says 172.21.15.135:56018) 2024-05-14T09:41:37.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.428+0000 7facf9e00640 1 -- 172.21.15.135:0/2398817169 learned_addr learned my addr 172.21.15.135:0/2398817169 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.429+0000 7fbd1e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd20156800 0x7fbd201f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.432+0000 7f486ea00640 1 -- 172.21.15.135:0/2765632673 --> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4868155b70 con 0x7f484807fe00 2024-05-14T09:41:37.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.432+0000 7f485fe00640 1 -- 172.21.15.135:0/2765632673 <== osd.3 v2:172.21.15.135:6802/3064760126 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4868155b70 con 0x7f484807fe00 2024-05-14T09:41:37.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.433+0000 7f486ea00640 1 -- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] conn(0x7f484807fe00 msgr2=0x7f48480822f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.433+0000 7f486ea00640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] conn(0x7f484807fe00 0x7f48480822f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.433+0000 7fbd1e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd20156800 0x7fbd201f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56004/0 (socket says 172.21.15.135:56004) 2024-05-14T09:41:37.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.433+0000 7fbd1e000640 1 -- 172.21.15.135:0/1405698447 learned_addr learned my addr 172.21.15.135:0/1405698447 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.433+0000 7f486ea00640 1 -- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4848076320 msgr2=0x7f4848078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.433+0000 7f486ea00640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4848076320 0x7f4848078830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4858034000 tx=0x7f485802e000 comp rx=0 tx=0).stop 2024-05-14T09:41:37.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.433+0000 7f486ea00640 1 -- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48680747b0 msgr2=0x7f4868155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.433+0000 7f486ea00640 1 --2- 172.21.15.135:0/2765632673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48680747b0 0x7f4868155460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f486000ba80 tx=0x7f486000bf40 comp rx=0 tx=0).stop 2024-05-14T09:41:37.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.433+0000 7f486ca00640 1 -- 172.21.15.135:0/2765632673 reap_dead start 2024-05-14T09:41:37.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.433+0000 7f486ea00640 1 -- 172.21.15.135:0/2765632673 shutdown_connections 2024-05-14T09:41:37.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.433+0000 7f486ea00640 1 -- 172.21.15.135:0/2765632673 >> 172.21.15.135:0/2765632673 conn(0x7f48680ce0e0 msgr2=0x7f4868152110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.434+0000 7f486ea00640 1 -- 172.21.15.135:0/2765632673 shutdown_connections 2024-05-14T09:41:37.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.434+0000 7f486ea00640 1 -- 172.21.15.135:0/2765632673 wait complete. 2024-05-14T09:41:37.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.437+0000 7fbd1f400640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd20165d60 0x7fbd201591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.437+0000 7facf9400640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7facfc1532e0 0x7facfc1f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.437+0000 7facf9e00640 1 -- 172.21.15.135:0/2398817169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7facfc1532e0 msgr2=0x7facfc1f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.437+0000 7facf9e00640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7facfc1532e0 0x7facfc1f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.437+0000 7facf9e00640 1 -- 172.21.15.135:0/2398817169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7facfc15cb50 msgr2=0x7facfc148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.437+0000 7facf9e00640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7facfc15cb50 0x7facfc148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.438+0000 7facf9e00640 1 -- 172.21.15.135:0/2398817169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc156610 con 0x7facfc152ed0 2024-05-14T09:41:37.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.442+0000 7f7aaaa00640 1 -- 172.21.15.135:0/2079879287 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00ac30 con 0x7f7ab4156940 2024-05-14T09:41:37.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.442+0000 7f7aaaa00640 1 -- 172.21.15.135:0/2079879287 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac00add0 con 0x7f7ab4156940 2024-05-14T09:41:37.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.442+0000 7f7aaaa00640 1 -- 172.21.15.135:0/2079879287 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac012600 con 0x7f7ab4156940 2024-05-14T09:41:37.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.442+0000 7f7ab9800640 1 -- 172.21.15.135:0/2079879287 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab41f2980 con 0x7f7ab4156940 2024-05-14T09:41:37.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.442+0000 7f7ab9800640 1 -- 172.21.15.135:0/2079879287 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab415d6f0 con 0x7f7ab4156940 2024-05-14T09:41:37.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.443+0000 7f7ab9800640 1 -- 172.21.15.135:0/2079879287 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ab4069980 con 0x7f7ab4156940 2024-05-14T09:41:37.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.445+0000 7fbd1e000640 1 -- 172.21.15.135:0/1405698447 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd20165d60 msgr2=0x7fbd201591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.445+0000 7fbd1e000640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd20165d60 0x7fbd201591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.445+0000 7fbd1e000640 1 -- 172.21.15.135:0/1405698447 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd2006dc60 msgr2=0x7fbd201548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.445+0000 7fbd1e000640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd2006dc60 0x7fbd201548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.445+0000 7fbd1e000640 1 -- 172.21.15.135:0/1405698447 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd201f5e00 con 0x7fbd20156800 2024-05-14T09:41:37.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.446+0000 7facf9e00640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facfc152ed0 0x7facfc1560d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7facec00c400 tx=0x7facec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.456+0000 7f84cd400640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d00c6910 0x7f84d014a220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00b410 tx=0x7f84bc00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.458 INFO:teuthology.orchestra.run.smithi135.stdout:68719476759 2024-05-14T09:41:37.458 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-14T09:41:37.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.465+0000 7facf2000640 1 -- 172.21.15.135:0/2398817169 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec017070 con 0x7facfc152ed0 2024-05-14T09:41:37.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.465+0000 7facf2000640 1 -- 172.21.15.135:0/2398817169 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec005d00 con 0x7facfc152ed0 2024-05-14T09:41:37.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.465+0000 7facf2000640 1 -- 172.21.15.135:0/2398817169 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec007310 con 0x7facfc152ed0 2024-05-14T09:41:37.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.465+0000 7fad01000640 1 -- 172.21.15.135:0/2398817169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facfc1f4fb0 con 0x7facfc152ed0 2024-05-14T09:41:37.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.465+0000 7fad01000640 1 -- 172.21.15.135:0/2398817169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facfc150f00 con 0x7facfc152ed0 2024-05-14T09:41:37.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.466+0000 7fad01000640 1 -- 172.21.15.135:0/2398817169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7facfc0c6b60 con 0x7facfc152ed0 2024-05-14T09:41:37.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.482+0000 7fb763e00640 1 -- 172.21.15.135:0/961865202 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb764044020 con 0x7fb76c156780 2024-05-14T09:41:37.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.483+0000 7fb763e00640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb74c076350 0x7fb74c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.484+0000 7fb76be00640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb74c076350 0x7fb74c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.484+0000 7fb76be00640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb74c076350 0x7fb74c078860 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb76c159f60 tx=0x7fb75c006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.486+0000 7fbd1e000640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd20156800 0x7fbd201f26d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c730 tx=0x7fbd0c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.487+0000 7fb763e00640 1 -- 172.21.15.135:0/961865202 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fb764009510 con 0x7fb76c156780 2024-05-14T09:41:37.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.487+0000 7fb763e00640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] conn(0x7fb74c07fe30 0x7fb74c082320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.487+0000 7fb763e00640 1 -- 172.21.15.135:0/961865202 --> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb764047e50 con 0x7fb74c07fe30 2024-05-14T09:41:37.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.487+0000 7fb763e00640 1 -- 172.21.15.135:0/961865202 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb76407e480 con 0x7fb76c156780 2024-05-14T09:41:37.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.487+0000 7fb76b400640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] conn(0x7fb74c07fe30 0x7fb74c082320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.488+0000 7fb76b400640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] conn(0x7fb74c07fe30 0x7fb74c082320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.489+0000 7fb763e00640 1 -- 172.21.15.135:0/961865202 <== osd.1 v2:172.21.15.135:6818/2447766167 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb764047e50 con 0x7fb74c07fe30 2024-05-14T09:41:37.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.498+0000 7fae0cc00640 1 -- 172.21.15.135:0/4220142355 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fae0801c070 con 0x7fae1015a770 2024-05-14T09:41:37.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.499+0000 7fae0cc00640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fadf0076320 0x7fadf0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.500+0000 7fae15000640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fadf0076320 0x7fadf0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.500+0000 7fae15000640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fadf0076320 0x7fadf0078830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae04009650 tx=0x7fae04006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.507+0000 7fae0cc00640 1 -- 172.21.15.135:0/4220142355 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fae0805cef0 con 0x7fae1015a770 2024-05-14T09:41:37.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.507+0000 7fae0cc00640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] conn(0x7fadf007fd80 0x7fadf0082270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.507+0000 7fae0cc00640 1 -- 172.21.15.135:0/4220142355 --> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae08007e50 con 0x7fadf007fd80 2024-05-14T09:41:37.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.508+0000 7fae0fe00640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] conn(0x7fadf007fd80 0x7fadf0082270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.509+0000 7fae0fe00640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] conn(0x7fadf007fd80 0x7fadf0082270 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.511+0000 7fae0cc00640 1 -- 172.21.15.135:0/4220142355 <== osd.7 v2:172.21.15.196:6800/3759821371 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae08007e50 con 0x7fadf007fd80 2024-05-14T09:41:37.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.515+0000 7fae0cc00640 1 -- 172.21.15.135:0/4220142355 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fae0805d2b0 con 0x7fae1015a770 2024-05-14T09:41:37.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.517+0000 7f84c6000640 1 -- 172.21.15.135:0/3451784188 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc015020 con 0x7f84d00c6910 2024-05-14T09:41:37.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.517+0000 7f84d5200640 1 -- 172.21.15.135:0/3451784188 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d014bc70 con 0x7f84d00c6910 2024-05-14T09:41:37.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.517+0000 7f84d5200640 1 -- 172.21.15.135:0/3451784188 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d014fcd0 con 0x7f84d00c6910 2024-05-14T09:41:37.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.518+0000 7fb772c00640 1 -- 172.21.15.135:0/961865202 --> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb76c151cb0 con 0x7fb74c07fe30 2024-05-14T09:41:37.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.518+0000 7f84d5200640 1 -- 172.21.15.135:0/3451784188 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84d0069a60 con 0x7f84d00c6910 2024-05-14T09:41:37.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.518+0000 7fb763e00640 1 -- 172.21.15.135:0/961865202 <== osd.1 v2:172.21.15.135:6818/2447766167 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb76c151cb0 con 0x7fb74c07fe30 2024-05-14T09:41:37.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.519+0000 7fb772c00640 1 -- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] conn(0x7fb74c07fe30 msgr2=0x7fb74c082320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.519+0000 7fb772c00640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] conn(0x7fb74c07fe30 0x7fb74c082320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.519+0000 7fb772c00640 1 -- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb74c076350 msgr2=0x7fb74c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.519+0000 7fb772c00640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb74c076350 0x7fb74c078860 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb76c159f60 tx=0x7fb75c006bf0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.519+0000 7fb772c00640 1 -- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76c156780 msgr2=0x7fb76c0716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.519+0000 7fb772c00640 1 --2- 172.21.15.135:0/961865202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb76c156780 0x7fb76c0716b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb764034040 tx=0x7fb764004a40 comp rx=0 tx=0).stop 2024-05-14T09:41:37.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.519+0000 7fb770c00640 1 -- 172.21.15.135:0/961865202 reap_dead start 2024-05-14T09:41:37.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.520+0000 7fb772c00640 1 -- 172.21.15.135:0/961865202 shutdown_connections 2024-05-14T09:41:37.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.520+0000 7fb772c00640 1 -- 172.21.15.135:0/961865202 >> 172.21.15.135:0/961865202 conn(0x7fb76c073d40 msgr2=0x7fb76c153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.521+0000 7fb772c00640 1 -- 172.21.15.135:0/961865202 shutdown_connections 2024-05-14T09:41:37.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.521+0000 7fb772c00640 1 -- 172.21.15.135:0/961865202 wait complete. 2024-05-14T09:41:37.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.522+0000 7ff53ea00640 1 -- 172.21.15.135:0/3232975398 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff540044020 con 0x7ff548156940 2024-05-14T09:41:37.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.523+0000 7f84c6000640 1 -- 172.21.15.135:0/3451784188 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d0069a60 con 0x7f84d00c6910 2024-05-14T09:41:37.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.523+0000 7f84c6000640 1 -- 172.21.15.135:0/3451784188 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc011a30 con 0x7f84d00c6910 2024-05-14T09:41:37.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.523+0000 7ff53ea00640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff528076350 0x7ff528078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.524+0000 7ff546a00640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff528076350 0x7ff528078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.524+0000 7ff546a00640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff528076350 0x7ff528078860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff538001520 tx=0x7ff538009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.533+0000 7fae16400640 1 -- 172.21.15.135:0/4220142355 --> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae100cab30 con 0x7fadf007fd80 2024-05-14T09:41:37.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.534+0000 7fae0cc00640 1 -- 172.21.15.135:0/4220142355 <== osd.7 v2:172.21.15.196:6800/3759821371 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fae100cab30 con 0x7fadf007fd80 2024-05-14T09:41:37.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.535+0000 7f7aaaa00640 1 -- 172.21.15.135:0/2079879287 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7aac0127a0 con 0x7f7ab4156940 2024-05-14T09:41:37.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.535+0000 7fae16400640 1 -- 172.21.15.135:0/4220142355 >> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] conn(0x7fadf007fd80 msgr2=0x7fadf0082270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.535+0000 7fae16400640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] conn(0x7fadf007fd80 0x7fadf0082270 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.536+0000 7fae16400640 1 -- 172.21.15.135:0/4220142355 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fadf0076320 msgr2=0x7fadf0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.536+0000 7fae16400640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fadf0076320 0x7fadf0078830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae04009650 tx=0x7fae04006ba0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.536+0000 7fae16400640 1 -- 172.21.15.135:0/4220142355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae1015a770 msgr2=0x7fae101532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.536+0000 7fae16400640 1 --2- 172.21.15.135:0/4220142355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fae1015a770 0x7fae101532f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fae0800b9e0 tx=0x7fae0800bea0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.536+0000 7fae15a00640 1 -- 172.21.15.135:0/4220142355 reap_dead start 2024-05-14T09:41:37.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.536+0000 7fae16400640 1 -- 172.21.15.135:0/4220142355 shutdown_connections 2024-05-14T09:41:37.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.536+0000 7fae16400640 1 -- 172.21.15.135:0/4220142355 >> 172.21.15.135:0/4220142355 conn(0x7fae100cf780 msgr2=0x7fae100b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.536+0000 7fae16400640 1 -- 172.21.15.135:0/4220142355 shutdown_connections 2024-05-14T09:41:37.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.536+0000 7fae16400640 1 -- 172.21.15.135:0/4220142355 wait complete. 2024-05-14T09:41:37.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.536+0000 7f7aaaa00640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7a940762d0 0x7f7a940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.537+0000 7f7ab2a00640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7a940762d0 0x7f7a940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.538+0000 7f7ab2a00640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7a940762d0 0x7f7a940787e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4034000 tx=0x7f7aa402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.541+0000 7ff53ea00640 1 -- 172.21.15.135:0/3232975398 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7ff54007dc20 con 0x7ff548156940 2024-05-14T09:41:37.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.542+0000 7ff53ea00640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] conn(0x7ff52807fe30 0x7ff528082320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.542+0000 7ff53ea00640 1 -- 172.21.15.135:0/3232975398 --> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff540047e50 con 0x7ff52807fe30 2024-05-14T09:41:37.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.542+0000 7ff53ea00640 1 -- 172.21.15.135:0/3232975398 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff54007dfe0 con 0x7ff548156940 2024-05-14T09:41:37.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.542+0000 7ff546000640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] conn(0x7ff52807fe30 0x7ff528082320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.543+0000 7ff546000640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] conn(0x7ff52807fe30 0x7ff528082320 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.543+0000 7f7aaaa00640 1 -- 172.21.15.135:0/2079879287 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f7aac096b30 con 0x7f7ab4156940 2024-05-14T09:41:37.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.543+0000 7f7aaaa00640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] conn(0x7f7a9407fcb0 0x7f7a940821a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.544+0000 7f7aaaa00640 1 -- 172.21.15.135:0/2079879287 --> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7aac013e70 con 0x7f7a9407fcb0 2024-05-14T09:41:37.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.544+0000 7f7aaaa00640 1 -- 172.21.15.135:0/2079879287 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7aac05dda0 con 0x7f7ab4156940 2024-05-14T09:41:37.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.544+0000 7f7ab2000640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] conn(0x7f7a9407fcb0 0x7f7a940821a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.545+0000 7ff53ea00640 1 -- 172.21.15.135:0/3232975398 <== osd.0 v2:172.21.15.135:6810/2395598420 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff540047e50 con 0x7ff52807fe30 2024-05-14T09:41:37.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.545+0000 7f7ab2000640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] conn(0x7f7a9407fcb0 0x7f7a940821a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.546+0000 7f7aaaa00640 1 -- 172.21.15.135:0/2079879287 <== osd.2 v2:172.21.15.135:6826/3157168741 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7aac013e70 con 0x7f7a9407fcb0 2024-05-14T09:41:37.549 INFO:teuthology.orchestra.run.smithi135.stdout:60129542163 2024-05-14T09:41:37.549 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-14T09:41:37.562 INFO:teuthology.orchestra.run.smithi135.stdout:64424509460 2024-05-14T09:41:37.563 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-14T09:41:37.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.572+0000 7facf2000640 1 -- 172.21.15.135:0/2398817169 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7facec01a070 con 0x7facfc152ed0 2024-05-14T09:41:37.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.574+0000 7ff54da00640 1 -- 172.21.15.135:0/3232975398 --> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff54806d1a0 con 0x7ff52807fe30 2024-05-14T09:41:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.574+0000 7ff53ea00640 1 -- 172.21.15.135:0/3232975398 <== osd.0 v2:172.21.15.135:6810/2395598420 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff54806d1a0 con 0x7ff52807fe30 2024-05-14T09:41:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.573+0000 7facf2000640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7facdc076350 0x7facdc078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.574+0000 7facf9400640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7facdc076350 0x7facdc078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.575+0000 7facf9400640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7facdc076350 0x7facdc078860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7face8035000 tx=0x7face8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.575+0000 7ff54da00640 1 -- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] conn(0x7ff52807fe30 msgr2=0x7ff528082320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.575+0000 7ff54da00640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] conn(0x7ff52807fe30 0x7ff528082320 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.575+0000 7ff54da00640 1 -- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff528076350 msgr2=0x7ff528078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.575+0000 7ff54da00640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff528076350 0x7ff528078860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff538001520 tx=0x7ff538009040 comp rx=0 tx=0).stop 2024-05-14T09:41:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.575+0000 7ff54da00640 1 -- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff548156940 msgr2=0x7ff548157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.575+0000 7ff54da00640 1 --2- 172.21.15.135:0/3232975398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff548156940 0x7ff548157b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff540009e50 tx=0x7ff540004a40 comp rx=0 tx=0).stop 2024-05-14T09:41:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.575+0000 7ff547400640 1 -- 172.21.15.135:0/3232975398 reap_dead start 2024-05-14T09:41:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.575+0000 7ff54da00640 1 -- 172.21.15.135:0/3232975398 shutdown_connections 2024-05-14T09:41:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.575+0000 7ff54da00640 1 -- 172.21.15.135:0/3232975398 >> 172.21.15.135:0/3232975398 conn(0x7ff5480ce1a0 msgr2=0x7ff54808d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.576+0000 7ff54da00640 1 -- 172.21.15.135:0/3232975398 shutdown_connections 2024-05-14T09:41:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.576+0000 7ff54da00640 1 -- 172.21.15.135:0/3232975398 wait complete. 2024-05-14T09:41:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.577+0000 7f7ab9800640 1 -- 172.21.15.135:0/2079879287 --> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ab40ccf70 con 0x7f7a9407fcb0 2024-05-14T09:41:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.578+0000 7f7aaaa00640 1 -- 172.21.15.135:0/2079879287 <== osd.2 v2:172.21.15.135:6826/3157168741 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7ab40ccf70 con 0x7f7a9407fcb0 2024-05-14T09:41:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.579+0000 7f7ab9800640 1 -- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] conn(0x7f7a9407fcb0 msgr2=0x7f7a940821a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.579+0000 7f7ab9800640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] conn(0x7f7a9407fcb0 0x7f7a940821a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.579+0000 7f7ab9800640 1 -- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7a940762d0 msgr2=0x7f7a940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.579+0000 7f7ab9800640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7a940762d0 0x7f7a940787e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4034000 tx=0x7f7aa402c000 comp rx=0 tx=0).stop 2024-05-14T09:41:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.579+0000 7f7ab9800640 1 -- 172.21.15.135:0/2079879287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156940 msgr2=0x7f7ab4154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.579+0000 7f7ab9800640 1 --2- 172.21.15.135:0/2079879287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7ab4156940 0x7f7ab4154860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00cad0 tx=0x7f7aac00cf90 comp rx=0 tx=0).stop 2024-05-14T09:41:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.579+0000 7f7ab3400640 1 -- 172.21.15.135:0/2079879287 reap_dead start 2024-05-14T09:41:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.579+0000 7f7ab9800640 1 -- 172.21.15.135:0/2079879287 shutdown_connections 2024-05-14T09:41:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.579+0000 7f7ab9800640 1 -- 172.21.15.135:0/2079879287 >> 172.21.15.135:0/2079879287 conn(0x7f7ab40ce1a0 msgr2=0x7f7ab40cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.580+0000 7facf2000640 1 -- 172.21.15.135:0/2398817169 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7facec05c5e0 con 0x7facfc152ed0 2024-05-14T09:41:37.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.580+0000 7f7ab9800640 1 -- 172.21.15.135:0/2079879287 shutdown_connections 2024-05-14T09:41:37.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.580+0000 7facf2000640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] conn(0x7facdc07fdb0 0x7facdc0822a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.580+0000 7f7ab9800640 1 -- 172.21.15.135:0/2079879287 wait complete. 2024-05-14T09:41:37.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.581+0000 7facf2000640 1 -- 172.21.15.135:0/2398817169 --> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7facec01dec0 con 0x7facdc07fdb0 2024-05-14T09:41:37.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.581+0000 7facf2000640 1 -- 172.21.15.135:0/2398817169 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7facec05c9a0 con 0x7facfc152ed0 2024-05-14T09:41:37.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.581+0000 7facfa800640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] conn(0x7facdc07fdb0 0x7facdc0822a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.583+0000 7facfa800640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] conn(0x7facdc07fdb0 0x7facdc0822a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.583+0000 7fbd16a00640 1 -- 172.21.15.135:0/1405698447 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c017070 con 0x7fbd20156800 2024-05-14T09:41:37.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.583+0000 7fbd16a00640 1 -- 172.21.15.135:0/1405698447 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0c005ab0 con 0x7fbd20156800 2024-05-14T09:41:37.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.583+0000 7fbd16a00640 1 -- 172.21.15.135:0/1405698447 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c001d10 con 0x7fbd20156800 2024-05-14T09:41:37.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.584+0000 7fbd25600640 1 -- 172.21.15.135:0/1405698447 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd201f60e0 con 0x7fbd20156800 2024-05-14T09:41:37.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.584+0000 7fbd25600640 1 -- 172.21.15.135:0/1405698447 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd201f2d80 con 0x7fbd20156800 2024-05-14T09:41:37.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.586+0000 7fbd25600640 1 -- 172.21.15.135:0/1405698447 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd20069a60 con 0x7fbd20156800 2024-05-14T09:41:37.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.587+0000 7facf2000640 1 -- 172.21.15.135:0/2398817169 <== osd.5 v2:172.21.15.196:6808/1160661510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7facec01dec0 con 0x7facdc07fdb0 2024-05-14T09:41:37.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.606+0000 7f84c6000640 1 -- 172.21.15.135:0/3451784188 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84bc018020 con 0x7f84d00c6910 2024-05-14T09:41:37.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.608+0000 7f84c6000640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f84b00762d0 0x7f84b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.609+0000 7f84cde00640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f84b00762d0 0x7f84b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.610+0000 7f84cde00640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f84b00762d0 0x7f84b00787e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84c0034000 tx=0x7f84c002c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.611+0000 7fad01000640 1 -- 172.21.15.135:0/2398817169 --> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7facfc069a60 con 0x7facdc07fdb0 2024-05-14T09:41:37.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.615+0000 7f84c6000640 1 -- 172.21.15.135:0/3451784188 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f84bc096100 con 0x7f84d00c6910 2024-05-14T09:41:37.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.615+0000 7facf2000640 1 -- 172.21.15.135:0/2398817169 <== osd.5 v2:172.21.15.196:6808/1160661510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7facfc069a60 con 0x7facdc07fdb0 2024-05-14T09:41:37.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.615+0000 7f84c6000640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] conn(0x7f84b007fcb0 0x7f84b00821a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.615+0000 7f84c6000640 1 -- 172.21.15.135:0/3451784188 --> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84b0082870 con 0x7f84b007fcb0 2024-05-14T09:41:37.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.615+0000 7f84c6000640 1 -- 172.21.15.135:0/3451784188 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f84bc05d2f0 con 0x7f84d00c6910 2024-05-14T09:41:37.616 INFO:teuthology.orchestra.run.smithi135.stdout:68719476755 2024-05-14T09:41:37.617 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-14T09:41:37.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.616+0000 7f84ce800640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] conn(0x7f84b007fcb0 0x7f84b00821a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.618 INFO:teuthology.orchestra.run.smithi135.stdout:68719476755 2024-05-14T09:41:37.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.617+0000 7fad01000640 1 -- 172.21.15.135:0/2398817169 >> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] conn(0x7facdc07fdb0 msgr2=0x7facdc0822a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.617+0000 7fad01000640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] conn(0x7facdc07fdb0 0x7facdc0822a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.619 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-14T09:41:37.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.617+0000 7fad01000640 1 -- 172.21.15.135:0/2398817169 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7facdc076350 msgr2=0x7facdc078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.617+0000 7fad01000640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7facdc076350 0x7facdc078860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7face8035000 tx=0x7face8008030 comp rx=0 tx=0).stop 2024-05-14T09:41:37.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.617+0000 7fad01000640 1 -- 172.21.15.135:0/2398817169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facfc152ed0 msgr2=0x7facfc1560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.617+0000 7fad01000640 1 --2- 172.21.15.135:0/2398817169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facfc152ed0 0x7facfc1560d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7facec00c400 tx=0x7facec00c8c0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.617+0000 7f84ce800640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] conn(0x7f84b007fcb0 0x7f84b00821a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.617+0000 7facfa800640 1 -- 172.21.15.135:0/2398817169 reap_dead start 2024-05-14T09:41:37.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.618+0000 7fad01000640 1 -- 172.21.15.135:0/2398817169 shutdown_connections 2024-05-14T09:41:37.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.618+0000 7fad01000640 1 -- 172.21.15.135:0/2398817169 >> 172.21.15.135:0/2398817169 conn(0x7facfc073d40 msgr2=0x7facfc074580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.618+0000 7fad01000640 1 -- 172.21.15.135:0/2398817169 shutdown_connections 2024-05-14T09:41:37.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.618+0000 7fad01000640 1 -- 172.21.15.135:0/2398817169 wait complete. 2024-05-14T09:41:37.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.621+0000 7f84c6000640 1 -- 172.21.15.135:0/3451784188 <== osd.6 v2:172.21.15.196:6819/2170854383 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f84b0082870 con 0x7f84b007fcb0 2024-05-14T09:41:37.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.635+0000 7fbd16a00640 1 -- 172.21.15.135:0/1405698447 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd0c01a070 con 0x7fbd20156800 2024-05-14T09:41:37.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.638+0000 7fbd16a00640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbd00076320 0x7fbd00078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.639+0000 7fbd1ea00640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbd00076320 0x7fbd00078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.644+0000 7fbd1ea00640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbd00076320 0x7fbd00078830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009650 tx=0x7fbd10006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.649+0000 7fbd16a00640 1 -- 172.21.15.135:0/1405698447 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fbd0c05c430 con 0x7fbd20156800 2024-05-14T09:41:37.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.650+0000 7fbd16a00640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] conn(0x7fbd0007fe00 0x7fbd000822f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.650+0000 7fbd16a00640 1 -- 172.21.15.135:0/1405698447 --> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd0c01dec0 con 0x7fbd0007fe00 2024-05-14T09:41:37.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.650+0000 7fbd16a00640 1 -- 172.21.15.135:0/1405698447 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbd0c05c7f0 con 0x7fbd20156800 2024-05-14T09:41:37.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.653+0000 7f84d5200640 1 -- 172.21.15.135:0/3451784188 --> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f84d00b58c0 con 0x7f84b007fcb0 2024-05-14T09:41:37.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.654+0000 7fbd1f400640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] conn(0x7fbd0007fe00 0x7fbd000822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.655+0000 7f84c6000640 1 -- 172.21.15.135:0/3451784188 <== osd.6 v2:172.21.15.196:6819/2170854383 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f84d00b58c0 con 0x7f84b007fcb0 2024-05-14T09:41:37.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.656+0000 7f84d5200640 1 -- 172.21.15.135:0/3451784188 >> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] conn(0x7f84b007fcb0 msgr2=0x7f84b00821a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.656+0000 7f84d5200640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] conn(0x7f84b007fcb0 0x7f84b00821a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.657+0000 7fbd1f400640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] conn(0x7fbd0007fe00 0x7fbd000822f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.658+0000 7f84d5200640 1 -- 172.21.15.135:0/3451784188 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f84b00762d0 msgr2=0x7f84b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.658+0000 7f84d5200640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f84b00762d0 0x7f84b00787e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84c0034000 tx=0x7f84c002c000 comp rx=0 tx=0).stop 2024-05-14T09:41:37.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.658+0000 7f84d5200640 1 -- 172.21.15.135:0/3451784188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d00c6910 msgr2=0x7f84d014a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.658+0000 7f84d5200640 1 --2- 172.21.15.135:0/3451784188 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84d00c6910 0x7f84d014a220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00b410 tx=0x7f84bc00b8d0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.658+0000 7f84ce800640 1 -- 172.21.15.135:0/3451784188 reap_dead start 2024-05-14T09:41:37.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.658+0000 7f84d5200640 1 -- 172.21.15.135:0/3451784188 shutdown_connections 2024-05-14T09:41:37.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.658+0000 7f84d5200640 1 -- 172.21.15.135:0/3451784188 >> 172.21.15.135:0/3451784188 conn(0x7f84d00ce3f0 msgr2=0x7f84d014e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.658+0000 7f84d5200640 1 -- 172.21.15.135:0/3451784188 shutdown_connections 2024-05-14T09:41:37.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.659+0000 7f84d5200640 1 -- 172.21.15.135:0/3451784188 wait complete. 2024-05-14T09:41:37.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.659+0000 7fbd16a00640 1 -- 172.21.15.135:0/1405698447 <== osd.4 v2:172.21.15.196:6813/710239496 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd0c01dec0 con 0x7fbd0007fe00 2024-05-14T09:41:37.661 INFO:teuthology.orchestra.run.smithi135.stdout:60129542161 2024-05-14T09:41:37.661 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-14T09:41:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.687+0000 7fbd25600640 1 -- 172.21.15.135:0/1405698447 --> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd200ca390 con 0x7fbd0007fe00 2024-05-14T09:41:37.692 INFO:teuthology.orchestra.run.smithi135.stdout:68719476756 2024-05-14T09:41:37.692 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-14T09:41:37.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.692+0000 7fbd16a00640 1 -- 172.21.15.135:0/1405698447 <== osd.4 v2:172.21.15.196:6813/710239496 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbd200ca390 con 0x7fbd0007fe00 2024-05-14T09:41:37.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.692+0000 7fbd25600640 1 -- 172.21.15.135:0/1405698447 >> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] conn(0x7fbd0007fe00 msgr2=0x7fbd000822f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.692+0000 7fbd25600640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] conn(0x7fbd0007fe00 0x7fbd000822f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.693+0000 7fbd25600640 1 -- 172.21.15.135:0/1405698447 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbd00076320 msgr2=0x7fbd00078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.693+0000 7fbd25600640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbd00076320 0x7fbd00078830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009650 tx=0x7fbd10006ba0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.693+0000 7fbd25600640 1 -- 172.21.15.135:0/1405698447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd20156800 msgr2=0x7fbd201f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.693+0000 7fbd25600640 1 --2- 172.21.15.135:0/1405698447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd20156800 0x7fbd201f26d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c730 tx=0x7fbd0c00cbf0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.693+0000 7fbd1f400640 1 -- 172.21.15.135:0/1405698447 reap_dead start 2024-05-14T09:41:37.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.694+0000 7fbd25600640 1 -- 172.21.15.135:0/1405698447 shutdown_connections 2024-05-14T09:41:37.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.694+0000 7fbd25600640 1 -- 172.21.15.135:0/1405698447 >> 172.21.15.135:0/1405698447 conn(0x7fbd200cac60 msgr2=0x7fbd2006f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.694+0000 7fbd25600640 1 -- 172.21.15.135:0/1405698447 shutdown_connections 2024-05-14T09:41:37.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.694+0000 7fbd25600640 1 -- 172.21.15.135:0/1405698447 wait complete. 2024-05-14T09:41:37.742 INFO:teuthology.orchestra.run.smithi135.stdout:68719476758 2024-05-14T09:41:37.743 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-14T09:41:37.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.805+0000 7f4d13800640 1 Processor -- start 2024-05-14T09:41:37.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.806+0000 7f4d13800640 1 -- start start 2024-05-14T09:41:37.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.808+0000 7f4d13800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4d0c0c5450 0x7f4d0c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.809+0000 7f4d13800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4d0c159c30 0x7f4d0c1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.809+0000 7f4d13800640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c0c5220 con 0x7f4d0c071a40 2024-05-14T09:41:37.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.809+0000 7f4d13800640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0c15a040 con 0x7f4d0c159c30 2024-05-14T09:41:37.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.809+0000 7f4d13800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0c06dfd0 con 0x7f4d0c0c5450 2024-05-14T09:41:37.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.811+0000 7f4d0be00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4d0c159c30 0x7f4d0c1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.811+0000 7f4d0be00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4d0c159c30 0x7f4d0c1530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56020/0 (socket says 172.21.15.135:56020) 2024-05-14T09:41:37.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.811+0000 7f4d0be00640 1 -- 172.21.15.135:0/1775768499 learned_addr learned my addr 172.21.15.135:0/1775768499 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.813+0000 7f4d10e00640 1 --2- 172.21.15.135:0/1775768499 >> v2:172.21.15.196:3300/0 conn(0x7f4d0c0c5450 0x7f4d0c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.816+0000 7f4d0be00640 1 -- 172.21.15.135:0/1775768499 >> v2:172.21.15.196:3300/0 conn(0x7f4d0c0c5450 msgr2=0x7f4d0c15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.816+0000 7f4d0be00640 1 --2- 172.21.15.135:0/1775768499 >> v2:172.21.15.196:3300/0 conn(0x7f4d0c0c5450 0x7f4d0c15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.816+0000 7f4d0be00640 1 -- 172.21.15.135:0/1775768499 >> v1:172.21.15.135:6789/0 conn(0x7f4d0c071a40 legacy=0x7f4d0c15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:37.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.816+0000 7f4d0be00640 1 -- 172.21.15.135:0/1775768499 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c06dcf0 con 0x7f4d0c159c30 2024-05-14T09:41:37.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.821+0000 7f4d0be00640 1 --2- 172.21.15.135:0/1775768499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0c159c30 0x7f4d0c1530d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c073420 tx=0x7f4d0002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457a479627fbc139 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.829+0000 7f4d0b400640 1 -- 172.21.15.135:0/1775768499 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d00037070 con 0x7f4d0c159c30 2024-05-14T09:41:37.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.829+0000 7f4d0b400640 1 -- 172.21.15.135:0/1775768499 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d00032440 con 0x7f4d0c159c30 2024-05-14T09:41:37.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.829+0000 7f4d0b400640 1 -- 172.21.15.135:0/1775768499 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d00032850 con 0x7f4d0c159c30 2024-05-14T09:41:37.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.831+0000 7f4d13800640 1 -- 172.21.15.135:0/1775768499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0c159c30 msgr2=0x7f4d0c1530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.831+0000 7f4d13800640 1 --2- 172.21.15.135:0/1775768499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0c159c30 0x7f4d0c1530d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c073420 tx=0x7f4d0002a160 comp rx=0 tx=0).stop 2024-05-14T09:41:37.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.832+0000 7f4d13800640 1 -- 172.21.15.135:0/1775768499 shutdown_connections 2024-05-14T09:41:37.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.832+0000 7f4d13800640 1 --2- 172.21.15.135:0/1775768499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0c159c30 0x7f4d0c1530d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.832+0000 7f4d13800640 1 --2- 172.21.15.135:0/1775768499 >> v2:172.21.15.196:3300/0 conn(0x7f4d0c0c5450 0x7f4d0c15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.832+0000 7f4d13800640 1 -- 172.21.15.135:0/1775768499 >> 172.21.15.135:0/1775768499 conn(0x7f4d0c070f20 msgr2=0x7f4d0c071330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:37.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.832+0000 7f4d13800640 1 -- 172.21.15.135:0/1775768499 shutdown_connections 2024-05-14T09:41:37.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.833+0000 7f4d13800640 1 -- 172.21.15.135:0/1775768499 wait complete. 2024-05-14T09:41:37.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.837+0000 7f4d13800640 1 Processor -- start 2024-05-14T09:41:37.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.838+0000 7f4d13800640 1 -- start start 2024-05-14T09:41:37.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.841+0000 7f4d13800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d0c071a40 0x7f4d0c14a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.841+0000 7f4d13800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0c0c5450 0x7f4d0c13d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.842+0000 7f4d13800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d0c159c30 0x7f4d0c155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.842+0000 7f4d13800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c159710 con 0x7f4d0c0c5450 2024-05-14T09:41:37.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.842+0000 7f4d13800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c159430 con 0x7f4d0c159c30 2024-05-14T09:41:37.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.842+0000 7f4d13800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c0c4e70 con 0x7f4d0c071a40 2024-05-14T09:41:37.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.844+0000 7f4d10e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d0c071a40 0x7f4d0c14a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.844+0000 7f4d11800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d0c159c30 0x7f4d0c155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.844+0000 7f4d0be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0c0c5450 0x7f4d0c13d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.845+0000 7f4d11800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d0c159c30 0x7f4d0c155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:58864/0 (socket says 172.21.15.135:58864) 2024-05-14T09:41:37.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.845+0000 7f4d11800640 1 -- 172.21.15.135:0/3213936291 learned_addr learned my addr 172.21.15.135:0/3213936291 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:37.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.852+0000 7f4d11800640 1 -- 172.21.15.135:0/3213936291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d0c071a40 msgr2=0x7f4d0c14a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.852+0000 7f4d11800640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d0c071a40 0x7f4d0c14a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.852+0000 7f4d11800640 1 -- 172.21.15.135:0/3213936291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0c0c5450 msgr2=0x7f4d0c13d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:37.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.852+0000 7f4d11800640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0c0c5450 0x7f4d0c13d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:37.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.852+0000 7f4d11800640 1 -- 172.21.15.135:0/3213936291 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c14a550 con 0x7f4d0c159c30 2024-05-14T09:41:37.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.853+0000 7f4d0be00640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0c0c5450 0x7f4d0c13d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T09:41:37.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.861+0000 7f4d11800640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d0c159c30 0x7f4d0c155ed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400b9e0 tx=0x7f4d0400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:37.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.878+0000 7f4d08c00640 1 -- 172.21.15.135:0/3213936291 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04019070 con 0x7f4d0c159c30 2024-05-14T09:41:37.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.878+0000 7f4d08c00640 1 -- 172.21.15.135:0/3213936291 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0400cb20 con 0x7f4d0c159c30 2024-05-14T09:41:37.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.878+0000 7f4d08c00640 1 -- 172.21.15.135:0/3213936291 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04014440 con 0x7f4d0c159c30 2024-05-14T09:41:37.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.879+0000 7f4d13800640 1 -- 172.21.15.135:0/3213936291 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c0c6a50 con 0x7f4d0c159c30 2024-05-14T09:41:37.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.879+0000 7f4d13800640 1 -- 172.21.15.135:0/3213936291 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0c154c60 con 0x7f4d0c159c30 2024-05-14T09:41:37.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.881+0000 7f4d13800640 1 -- 172.21.15.135:0/3213936291 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0c069a60 con 0x7f4d0c159c30 2024-05-14T09:41:37.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.966+0000 7fc2e0a00640 1 Processor -- start 2024-05-14T09:41:37.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.966+0000 7fc2e0a00640 1 -- start start 2024-05-14T09:41:37.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.970+0000 7fc2e0a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc2d40495e0 0x7fc2d40073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.971+0000 7fc2e0a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc2d4050050 0x7fc2d40e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.971+0000 7fc2e0a00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d4050af0 con 0x7fc2d4007910 2024-05-14T09:41:37.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.971+0000 7fc2e0a00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d4050700 con 0x7fc2d40495e0 2024-05-14T09:41:37.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.969+0000 7f9eebc00640 1 Processor -- start 2024-05-14T09:41:37.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.969+0000 7f9eebc00640 1 -- start start 2024-05-14T09:41:37.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.971+0000 7fc2e0a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d4050db0 con 0x7fc2d4050050 2024-05-14T09:41:37.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.972+0000 7f9eebc00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9ee40c53a0 0x7f9ee40c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:37.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.973+0000 7f9eebc00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee40ca720 con 0x7f9ee40ca310 2024-05-14T09:41:37.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.973+0000 7f9eebc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee40c9200 con 0x7f9ee41609d0 2024-05-14T09:41:37.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.973+0000 7f9eebc00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f9ee4160de0 con 0x7f9ee40c53a0 2024-05-14T09:41:37.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.979+0000 7f9ee9c00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f9ee40ca310 0x7f9ee406df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:41456/0 (socket says 172.21.15.135:41456) 2024-05-14T09:41:37.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.979+0000 7f9ee9c00640 1 -- 172.21.15.135:0/3236636029 learned_addr learned my addr 172.21.15.135:0/3236636029 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:37.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.979+0000 7f9ee9200640 1 --2- 172.21.15.135:0/3236636029 >> v2:172.21.15.135:3300/0 conn(0x7f9ee40c53a0 0x7f9ee40c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.996+0000 7fc2da800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc2d40495e0 0x7fc2d40073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:37.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.997+0000 7fc2da800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc2d40495e0 0x7fc2d40073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56036/0 (socket says 172.21.15.135:56036) 2024-05-14T09:41:37.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:37.997+0000 7fc2da800640 1 -- 172.21.15.135:0/3380055800 learned_addr learned my addr 172.21.15.135:0/3380055800 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:38.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.007+0000 7f0b81800640 1 Processor -- start 2024-05-14T09:41:38.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.007+0000 7f9ee9200640 1 -- 172.21.15.135:0/3236636029 >> v1:172.21.15.196:6789/0 conn(0x7f9ee41609d0 legacy=0x7f9ee40cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.007+0000 7f0b81800640 1 -- start start 2024-05-14T09:41:38.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.007+0000 7f9ee9200640 1 -- 172.21.15.135:0/3236636029 >> v1:172.21.15.135:6789/0 conn(0x7f9ee40ca310 legacy=0x7f9ee406df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.007+0000 7f9ee9200640 1 -- 172.21.15.135:0/3236636029 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee40c94e0 con 0x7f9ee40c53a0 2024-05-14T09:41:38.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.010+0000 7f0b81800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 0x7f0b7c154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.010+0000 7f0b81800640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b7c071360 con 0x7f0b7c0b3820 2024-05-14T09:41:38.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.010+0000 7f0b81800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b7c15d850 con 0x7f0b7c0b2480 2024-05-14T09:41:38.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.010+0000 7f0b81800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7c15db10 con 0x7f0b7c0b1f30 2024-05-14T09:41:38.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.015+0000 7fc2da800640 1 -- 172.21.15.135:0/3380055800 >> v2:172.21.15.196:3300/0 conn(0x7fc2d4050050 msgr2=0x7fc2d40e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.015+0000 7fc2da800640 1 --2- 172.21.15.135:0/3380055800 >> v2:172.21.15.196:3300/0 conn(0x7fc2d4050050 0x7fc2d40e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.015+0000 7fc2da800640 1 -- 172.21.15.135:0/3380055800 >> v1:172.21.15.135:6789/0 conn(0x7fc2d4007910 legacy=0x7fc2d404f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.015+0000 7fc2da800640 1 -- 172.21.15.135:0/3380055800 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d40e35c0 con 0x7fc2d40495e0 2024-05-14T09:41:38.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.025+0000 7f9ee9200640 1 --2- 172.21.15.135:0/3236636029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ee40c53a0 0x7f9ee40c7cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00097c0 tx=0x7f9ed002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b12c93e9069d70c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.026+0000 7fc2da800640 1 --2- 172.21.15.135:0/3380055800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d40495e0 0x7fc2d40073d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40126d0 tx=0x7fc2cc02a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90f3d436ac49ebd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.027+0000 7f39f3200640 1 Processor -- start 2024-05-14T09:41:38.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.027+0000 7f39f3200640 1 -- start start 2024-05-14T09:41:38.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.030+0000 7f0b80e00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f0b7c0b3820 0x7f0b7c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:41466/0 (socket says 172.21.15.135:41466) 2024-05-14T09:41:38.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.030+0000 7f0b80e00640 1 -- 172.21.15.135:0/3312834406 learned_addr learned my addr 172.21.15.135:0/3312834406 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:38.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.030+0000 7f39f3200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec0c7670 0x7f39ec1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.030+0000 7f39f3200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f39ec0c5470 0x7f39ec0c5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.030+0000 7f39f3200640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39ec074d10 con 0x7f39ec15bf10 2024-05-14T09:41:38.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.030+0000 7f39f3200640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f39ec0c4be0 con 0x7f39ec0c5470 2024-05-14T09:41:38.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.030+0000 7f39f3200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f39ec06d120 con 0x7f39ec0c7670 2024-05-14T09:41:38.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.037+0000 7f0b7b400640 1 --2- 172.21.15.135:0/3312834406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 0x7f0b7c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.037+0000 7f9ee3400640 1 -- 172.21.15.135:0/3236636029 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0037070 con 0x7f9ee40c53a0 2024-05-14T09:41:38.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.039+0000 7f39ebe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec0c7670 0x7f39ec1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.043+0000 7f39ebe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec0c7670 0x7f39ec1529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38656/0 (socket says 172.21.15.135:38656) 2024-05-14T09:41:38.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.043+0000 7f39ebe00640 1 -- 172.21.15.135:0/3156037520 learned_addr learned my addr 172.21.15.135:0/3156037520 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:38.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.045+0000 7fc2d9400640 1 -- 172.21.15.135:0/3380055800 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc037070 con 0x7fc2d40495e0 2024-05-14T09:41:38.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.045+0000 7fc2d9400640 1 -- 172.21.15.135:0/3380055800 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc032640 con 0x7fc2d40495e0 2024-05-14T09:41:38.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.045+0000 7fc2d9400640 1 -- 172.21.15.135:0/3380055800 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc032a10 con 0x7fc2d40495e0 2024-05-14T09:41:38.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.045+0000 7f9ee3400640 1 -- 172.21.15.135:0/3236636029 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed0032440 con 0x7f9ee40c53a0 2024-05-14T09:41:38.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.045+0000 7f9ee3400640 1 -- 172.21.15.135:0/3236636029 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0032810 con 0x7f9ee40c53a0 2024-05-14T09:41:38.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.046+0000 7f39f1200640 1 --2- 172.21.15.135:0/3156037520 >> v2:172.21.15.135:3300/0 conn(0x7f39ec0c5470 0x7f39ec0c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.046+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3380055800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d40495e0 msgr2=0x7fc2d40073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.046+0000 7fc2e0a00640 1 --2- 172.21.15.135:0/3380055800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d40495e0 0x7fc2d40073d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40126d0 tx=0x7fc2cc02a330 comp rx=0 tx=0).stop 2024-05-14T09:41:38.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.046+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3380055800 shutdown_connections 2024-05-14T09:41:38.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.046+0000 7fc2e0a00640 1 --2- 172.21.15.135:0/3380055800 >> v2:172.21.15.196:3300/0 conn(0x7fc2d4050050 0x7fc2d40e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.046+0000 7fc2e0a00640 1 --2- 172.21.15.135:0/3380055800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d40495e0 0x7fc2d40073d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.046+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3380055800 >> 172.21.15.135:0/3380055800 conn(0x7fc2d400e380 msgr2=0x7fc2d400e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.047+0000 7f9eebc00640 1 -- 172.21.15.135:0/3236636029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ee40c53a0 msgr2=0x7f9ee40c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.047+0000 7f9eebc00640 1 --2- 172.21.15.135:0/3236636029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ee40c53a0 0x7f9ee40c7cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00097c0 tx=0x7f9ed002a250 comp rx=0 tx=0).stop 2024-05-14T09:41:38.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.047+0000 7f9eebc00640 1 -- 172.21.15.135:0/3236636029 shutdown_connections 2024-05-14T09:41:38.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.047+0000 7f9eebc00640 1 --2- 172.21.15.135:0/3236636029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ee40c53a0 0x7f9ee40c7cb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.047+0000 7f9eebc00640 1 -- 172.21.15.135:0/3236636029 >> 172.21.15.135:0/3236636029 conn(0x7f9ee4071a20 msgr2=0x7f9ee4071e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.047+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3380055800 shutdown_connections 2024-05-14T09:41:38.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.047+0000 7f9eebc00640 1 -- 172.21.15.135:0/3236636029 shutdown_connections 2024-05-14T09:41:38.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.047+0000 7f9eebc00640 1 -- 172.21.15.135:0/3236636029 wait complete. 2024-05-14T09:41:38.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.047+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3380055800 wait complete. 2024-05-14T09:41:38.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.049+0000 7f0b7b400640 1 -- 172.21.15.135:0/3312834406 >> v1:172.21.15.196:6789/0 conn(0x7f0b7c0b2480 legacy=0x7f0b7c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.049+0000 7f0b7b400640 1 -- 172.21.15.135:0/3312834406 >> v1:172.21.15.135:6789/0 conn(0x7f0b7c0b3820 legacy=0x7f0b7c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.049+0000 7f0b7b400640 1 -- 172.21.15.135:0/3312834406 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c15ddf0 con 0x7f0b7c0b1f30 2024-05-14T09:41:38.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.050+0000 7f9eebc00640 1 Processor -- start 2024-05-14T09:41:38.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.050+0000 7f9eebc00640 1 -- start start 2024-05-14T09:41:38.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.051+0000 7fc2e0a00640 1 Processor -- start 2024-05-14T09:41:38.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.051+0000 7fc2e0a00640 1 -- start start 2024-05-14T09:41:38.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.052+0000 7f9eebc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee40c53a0 0x7f9ee41fa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.052+0000 7f9eebc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee40ca310 0x7f9ee4153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.052+0000 7f9eebc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ee41609d0 0x7f9ee40705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.052+0000 7f9eebc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee40c9b10 con 0x7f9ee41609d0 2024-05-14T09:41:38.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.052+0000 7f9eebc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee40c9e80 con 0x7f9ee40ca310 2024-05-14T09:41:38.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.052+0000 7f9eebc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee40cdbf0 con 0x7f9ee40c53a0 2024-05-14T09:41:38.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.053+0000 7f39f1200640 1 -- 172.21.15.135:0/3156037520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec0c7670 msgr2=0x7f39ec1529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.053+0000 7f39f1200640 1 --2- 172.21.15.135:0/3156037520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec0c7670 0x7f39ec1529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.053+0000 7f39f1200640 1 -- 172.21.15.135:0/3156037520 >> v1:172.21.15.135:6789/0 conn(0x7f39ec15bf10 legacy=0x7f39ec15c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.053+0000 7f39f1200640 1 -- 172.21.15.135:0/3156037520 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec06d400 con 0x7f39ec0c5470 2024-05-14T09:41:38.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.054+0000 7fc2e0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d4007910 0x7fc2d417d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.054+0000 7fc2e0a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2d40495e0 0x7fc2d40d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.054+0000 7fc2e0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2d4050050 0x7fc2d417a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.054+0000 7fc2e0a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d40e38a0 con 0x7fc2d4007910 2024-05-14T09:41:38.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.054+0000 7fc2e0a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d404f420 con 0x7fc2d40495e0 2024-05-14T09:41:38.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.054+0000 7fc2e0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d400f1c0 con 0x7fc2d4050050 2024-05-14T09:41:38.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.060+0000 7f39f1200640 1 --2- 172.21.15.135:0/3156037520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec0c5470 0x7f39ec0c5880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009d90 tx=0x7f39e402a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f2c707ea0a1ba5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.061+0000 7fc2db200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2d4050050 0x7fc2d417a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.063+0000 7f0b7b400640 1 --2- 172.21.15.135:0/3312834406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 0x7f0b7c154540 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097d0 tx=0x7f0b6802a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0d6ca04e77964f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.063+0000 7fc2db200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2d4050050 0x7fc2d417a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38680/0 (socket says 172.21.15.135:38680) 2024-05-14T09:41:38.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.063+0000 7fc2db200640 1 -- 172.21.15.135:0/3188008726 learned_addr learned my addr 172.21.15.135:0/3188008726 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:38.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.063+0000 7fc2da800640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d4007910 0x7fc2d417d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.063+0000 7f9ee9c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ee41609d0 0x7f9ee40705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.064+0000 7f9ee9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee40c53a0 0x7f9ee41fa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.064+0000 7f9ee9200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee40c53a0 0x7f9ee41fa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38672/0 (socket says 172.21.15.135:38672) 2024-05-14T09:41:38.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.064+0000 7f9ee9200640 1 -- 172.21.15.135:0/2596177525 learned_addr learned my addr 172.21.15.135:0/2596177525 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:38.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.071+0000 7f18faa00640 1 Processor -- start 2024-05-14T09:41:38.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.071+0000 7f18faa00640 1 -- start start 2024-05-14T09:41:38.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.073+0000 7f18faa00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f18f4071480 0x7f18f4154690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.073+0000 7f18faa00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f18f40b5170 0x7f18f40702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.073+0000 7f18faa00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f415e3d0 con 0x7f18f40cbae0 2024-05-14T09:41:38.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.073+0000 7f18faa00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f18f40cb390 con 0x7f18f40b5170 2024-05-14T09:41:38.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.073+0000 7f18faa00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f18f40ca7f0 con 0x7f18f4071480 2024-05-14T09:41:38.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.073+0000 7fc2db200640 1 -- 172.21.15.135:0/3188008726 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2d40495e0 msgr2=0x7fc2d40d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.073+0000 7fc2db200640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2d40495e0 0x7fc2d40d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.073+0000 7fc2db200640 1 -- 172.21.15.135:0/3188008726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d4007910 msgr2=0x7fc2d417d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.073+0000 7fc2db200640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d4007910 0x7fc2d417d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.073+0000 7fc2db200640 1 -- 172.21.15.135:0/3188008726 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d417dca0 con 0x7fc2d4050050 2024-05-14T09:41:38.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.075+0000 7f9ee9c00640 1 -- 172.21.15.135:0/2596177525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee40c53a0 msgr2=0x7f9ee41fa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.075+0000 7f9ee9c00640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee40c53a0 0x7f9ee41fa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.075+0000 7f9ee9c00640 1 -- 172.21.15.135:0/2596177525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee40ca310 msgr2=0x7f9ee4153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.075+0000 7f9ee9c00640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee40ca310 0x7f9ee4153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.075+0000 7f9ee9c00640 1 -- 172.21.15.135:0/2596177525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee41fa870 con 0x7f9ee41609d0 2024-05-14T09:41:38.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.079+0000 7f39eaa00640 1 -- 172.21.15.135:0/3156037520 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4007740 con 0x7f39ec0c5470 2024-05-14T09:41:38.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.079+0000 7f39eaa00640 1 -- 172.21.15.135:0/3156037520 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e40078e0 con 0x7f39ec0c5470 2024-05-14T09:41:38.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.079+0000 7f39eaa00640 1 -- 172.21.15.135:0/3156037520 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4007cb0 con 0x7f39ec0c5470 2024-05-14T09:41:38.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.080+0000 7f39f3200640 1 -- 172.21.15.135:0/3156037520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec0c5470 msgr2=0x7f39ec0c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.080+0000 7f39f3200640 1 --2- 172.21.15.135:0/3156037520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec0c5470 0x7f39ec0c5880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009d90 tx=0x7f39e402a5b0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.080+0000 7f39f3200640 1 -- 172.21.15.135:0/3156037520 shutdown_connections 2024-05-14T09:41:38.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.080+0000 7f0edd800640 1 Processor -- start 2024-05-14T09:41:38.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.080+0000 7f39f3200640 1 --2- 172.21.15.135:0/3156037520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec0c5470 0x7f39ec0c5880 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.080+0000 7f39f3200640 1 --2- 172.21.15.135:0/3156037520 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec0c7670 0x7f39ec1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.080+0000 7f39f3200640 1 -- 172.21.15.135:0/3156037520 >> 172.21.15.135:0/3156037520 conn(0x7f39ec073d40 msgr2=0x7f39ec074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.080+0000 7f39f3200640 1 -- 172.21.15.135:0/3156037520 shutdown_connections 2024-05-14T09:41:38.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.080+0000 7f39f3200640 1 -- 172.21.15.135:0/3156037520 wait complete. 2024-05-14T09:41:38.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.081+0000 7f0edd800640 1 -- start start 2024-05-14T09:41:38.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.082+0000 7f0edd800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ed80b7240 0x7f0ed80ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.082+0000 7f0edd800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ed80ca9e0 0x7f0ed815f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.082+0000 7f0edd800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0ed815ff30 0x7f0ed8160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.082+0000 7f0edd800640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed80cadf0 con 0x7f0ed80ca9e0 2024-05-14T09:41:38.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.082+0000 7f0edd800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed80c90d0 con 0x7f0ed815ff30 2024-05-14T09:41:38.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.082+0000 7f0edd800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed80c93b0 con 0x7f0ed80b7240 2024-05-14T09:41:38.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.084+0000 7f39f3200640 1 Processor -- start 2024-05-14T09:41:38.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.084+0000 7f39f3200640 1 -- start start 2024-05-14T09:41:38.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.084+0000 7f9ee9c00640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ee41609d0 0x7f9ee40705c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4072bd0 tx=0x7f9edc00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.086+0000 7f39f3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec0c5470 0x7f39ec155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.086+0000 7f39f3200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39ec0c7670 0x7f39ec14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.087+0000 7f39f3200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec15bf10 0x7f39ec14f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.087+0000 7f39f3200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec06df20 con 0x7f39ec0c5470 2024-05-14T09:41:38.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.087+0000 7f39f3200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec152f30 con 0x7f39ec0c7670 2024-05-14T09:41:38.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.087+0000 7f39f3200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f39ec0721c0 con 0x7f39ec15bf10 2024-05-14T09:41:38.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.089+0000 7fc2db200640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2d4050050 0x7fc2d417a0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800b440 tx=0x7fc2c800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.090+0000 7f18f8a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f18f40b5170 0x7f18f40702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.090+0000 7f18f8a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f18f40b5170 0x7f18f40702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56068/0 (socket says 172.21.15.135:56068) 2024-05-14T09:41:38.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.090+0000 7f18f8a00640 1 -- 172.21.15.135:0/921738959 learned_addr learned my addr 172.21.15.135:0/921738959 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:38.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.091+0000 7f0ed6000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ed80ca9e0 0x7f0ed815f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.092+0000 7f0ed6000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0ed80ca9e0 0x7f0ed815f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56078/0 (socket says 172.21.15.135:56078) 2024-05-14T09:41:38.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.092+0000 7f0ed6000640 1 -- 172.21.15.135:0/2845457283 learned_addr learned my addr 172.21.15.135:0/2845457283 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:38.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.093+0000 7f0ed6a00640 1 --2- 172.21.15.135:0/2845457283 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ed80b7240 0x7f0ed80ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.093+0000 7f9ee0c00640 1 -- 172.21.15.135:0/2596177525 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc017070 con 0x7f9ee41609d0 2024-05-14T09:41:38.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.093+0000 7f9ee0c00640 1 -- 172.21.15.135:0/2596177525 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9edc00ab40 con 0x7f9ee41609d0 2024-05-14T09:41:38.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.093+0000 7f9eebc00640 1 -- 172.21.15.135:0/2596177525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee41541f0 con 0x7f9ee41609d0 2024-05-14T09:41:38.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.093+0000 7f9ee0c00640 1 -- 172.21.15.135:0/2596177525 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc012400 con 0x7f9ee41609d0 2024-05-14T09:41:38.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.093+0000 7f9eebc00640 1 -- 172.21.15.135:0/2596177525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee41571c0 con 0x7f9ee41609d0 2024-05-14T09:41:38.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.095+0000 7f9eebc00640 1 -- 172.21.15.135:0/2596177525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee415f540 con 0x7f9ee41609d0 2024-05-14T09:41:38.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.095+0000 7f18f8a00640 1 -- 172.21.15.135:0/921738959 >> v2:172.21.15.196:3300/0 conn(0x7f18f4071480 msgr2=0x7f18f4154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.095+0000 7f18f8a00640 1 --2- 172.21.15.135:0/921738959 >> v2:172.21.15.196:3300/0 conn(0x7f18f4071480 0x7f18f4154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.095+0000 7f18f8a00640 1 -- 172.21.15.135:0/921738959 >> v1:172.21.15.196:6789/0 conn(0x7f18f40cbae0 legacy=0x7f18f40cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.095+0000 7f18f8a00640 1 -- 172.21.15.135:0/921738959 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f415e640 con 0x7f18f40b5170 2024-05-14T09:41:38.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.100+0000 7f0ed6a00640 1 -- 172.21.15.135:0/2845457283 >> v2:172.21.15.196:3300/0 conn(0x7f0ed815ff30 msgr2=0x7f0ed8160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.100+0000 7f0ed6a00640 1 --2- 172.21.15.135:0/2845457283 >> v2:172.21.15.196:3300/0 conn(0x7f0ed815ff30 0x7f0ed8160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.100+0000 7f0ed6a00640 1 -- 172.21.15.135:0/2845457283 >> v2:172.21.15.135:3300/0 conn(0x7f0ed80ca9e0 msgr2=0x7f0ed815f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.100+0000 7f0ed6a00640 1 --2- 172.21.15.135:0/2845457283 >> v2:172.21.15.135:3300/0 conn(0x7f0ed80ca9e0 0x7f0ed815f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.100+0000 7f0ed6a00640 1 -- 172.21.15.135:0/2845457283 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed80c9690 con 0x7f0ed80b7240 2024-05-14T09:41:38.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.108+0000 7fc2d2a00640 1 -- 172.21.15.135:0/3188008726 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8015020 con 0x7fc2d4050050 2024-05-14T09:41:38.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.108+0000 7fc2d2a00640 1 -- 172.21.15.135:0/3188008726 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c8011850 con 0x7fc2d4050050 2024-05-14T09:41:38.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.108+0000 7fc2d2a00640 1 -- 172.21.15.135:0/3188008726 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8011c40 con 0x7fc2d4050050 2024-05-14T09:41:38.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.109+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3188008726 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d4179b70 con 0x7fc2d4050050 2024-05-14T09:41:38.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.109+0000 7f0ed6a00640 1 --2- 172.21.15.135:0/2845457283 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ed80b7240 0x7f0ed80ca4a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ed806e760 tx=0x7f0ec802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bf8a9ce94c7ca3f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.109+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3188008726 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d4052a30 con 0x7fc2d4050050 2024-05-14T09:41:38.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.110+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3188008726 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d40542b0 con 0x7fc2d4050050 2024-05-14T09:41:38.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.110+0000 7f0b7aa00640 1 -- 172.21.15.135:0/3312834406 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68037070 con 0x7f0b7c0b1f30 2024-05-14T09:41:38.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.110+0000 7f0b7aa00640 1 -- 172.21.15.135:0/3312834406 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b68032440 con 0x7f0b7c0b1f30 2024-05-14T09:41:38.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.110+0000 7f0b7aa00640 1 -- 172.21.15.135:0/3312834406 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68032810 con 0x7f0b7c0b1f30 2024-05-14T09:41:38.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.111+0000 7f0b81800640 1 -- 172.21.15.135:0/3312834406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 msgr2=0x7f0b7c154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.111+0000 7f0b81800640 1 --2- 172.21.15.135:0/3312834406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 0x7f0b7c154540 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097d0 tx=0x7f0b6802a160 comp rx=0 tx=0).stop 2024-05-14T09:41:38.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.111+0000 7f0b81800640 1 -- 172.21.15.135:0/3312834406 shutdown_connections 2024-05-14T09:41:38.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.111+0000 7f0b81800640 1 --2- 172.21.15.135:0/3312834406 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 0x7f0b7c154540 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.111+0000 7f0b81800640 1 -- 172.21.15.135:0/3312834406 >> 172.21.15.135:0/3312834406 conn(0x7f0b7c0cf550 msgr2=0x7f0b7c0cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.112+0000 7f0b81800640 1 -- 172.21.15.135:0/3312834406 shutdown_connections 2024-05-14T09:41:38.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.112+0000 7f0b81800640 1 -- 172.21.15.135:0/3312834406 wait complete. 2024-05-14T09:41:38.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.114+0000 7f0b81800640 1 Processor -- start 2024-05-14T09:41:38.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.114+0000 7f0b81800640 1 -- start start 2024-05-14T09:41:38.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.115+0000 7f0b81800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 0x7f0b7c0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.115+0000 7f0b81800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b7c0b2480 0x7f0b7c1f1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.115+0000 7f0b81800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7c0b3820 0x7f0b7c154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.115+0000 7f0b81800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c15e690 con 0x7f0b7c0b3820 2024-05-14T09:41:38.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.115+0000 7f0b81800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c15e3b0 con 0x7f0b7c0b2480 2024-05-14T09:41:38.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.115+0000 7f0b81800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7c0709b0 con 0x7f0b7c0b1f30 2024-05-14T09:41:38.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.116+0000 7f05b1200640 1 Processor -- start 2024-05-14T09:41:38.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.117+0000 7f05b1200640 1 -- start start 2024-05-14T09:41:38.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.118+0000 7f05b1200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f05ac156800 0x7f05ac15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.118+0000 7f05b1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05ac15d090 0x7f05ac06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.118+0000 7f05b1200640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ac0c9db0 con 0x7f05ac06e1a0 2024-05-14T09:41:38.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.118+0000 7f05b1200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f05ac156c10 con 0x7f05ac156800 2024-05-14T09:41:38.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.118+0000 7f05b1200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f05ac0b3200 con 0x7f05ac15d090 2024-05-14T09:41:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.119+0000 7f39f1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec15bf10 0x7f39ec14f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.120+0000 7f0ed5600640 1 -- 172.21.15.135:0/2845457283 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8037070 con 0x7f0ed80b7240 2024-05-14T09:41:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.120+0000 7f0ed5600640 1 -- 172.21.15.135:0/2845457283 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec8032440 con 0x7f0ed80b7240 2024-05-14T09:41:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.120+0000 7f0ed5600640 1 -- 172.21.15.135:0/2845457283 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec802ae60 con 0x7f0ed80b7240 2024-05-14T09:41:38.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.121+0000 7f0edd800640 1 -- 172.21.15.135:0/2845457283 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ed80b7240 msgr2=0x7f0ed80ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.121+0000 7f0edd800640 1 --2- 172.21.15.135:0/2845457283 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ed80b7240 0x7f0ed80ca4a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ed806e760 tx=0x7f0ec802a110 comp rx=0 tx=0).stop 2024-05-14T09:41:38.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.121+0000 7f0edd800640 1 -- 172.21.15.135:0/2845457283 shutdown_connections 2024-05-14T09:41:38.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.121+0000 7f0edd800640 1 --2- 172.21.15.135:0/2845457283 >> v2:172.21.15.196:3300/0 conn(0x7f0ed815ff30 0x7f0ed8160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.121+0000 7f0edd800640 1 --2- 172.21.15.135:0/2845457283 >> v2:172.21.15.135:3300/0 conn(0x7f0ed80ca9e0 0x7f0ed815f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.121+0000 7f0edd800640 1 --2- 172.21.15.135:0/2845457283 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ed80b7240 0x7f0ed80ca4a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.121+0000 7f0edd800640 1 -- 172.21.15.135:0/2845457283 >> 172.21.15.135:0/2845457283 conn(0x7f0ed80ce940 msgr2=0x7f0ed808cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.121+0000 7f0edd800640 1 -- 172.21.15.135:0/2845457283 shutdown_connections 2024-05-14T09:41:38.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.121+0000 7f0edd800640 1 -- 172.21.15.135:0/2845457283 wait complete. 2024-05-14T09:41:38.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.123+0000 7f0edd800640 1 Processor -- start 2024-05-14T09:41:38.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.124+0000 7f0edd800640 1 -- start start 2024-05-14T09:41:38.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.124+0000 7f39f1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec15bf10 0x7f39ec14f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38700/0 (socket says 172.21.15.135:38700) 2024-05-14T09:41:38.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.124+0000 7f39f1200640 1 -- 172.21.15.135:0/197460612 learned_addr learned my addr 172.21.15.135:0/197460612 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:38.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.124+0000 7f05a9400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05ac15d090 0x7f05ac06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.125+0000 7f0edd800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed80b7240 0x7f0ed81f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.125+0000 7f0edd800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ed80ca9e0 0x7f0ed8140950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.125+0000 7f0edd800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ed815ff30 0x7f0ed814ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.125+0000 7f0edd800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed80b7650 con 0x7f0ed80b7240 2024-05-14T09:41:38.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.125+0000 7f0edd800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed80c9f80 con 0x7f0ed80ca9e0 2024-05-14T09:41:38.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.125+0000 7f0edd800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed80c8c90 con 0x7f0ed815ff30 2024-05-14T09:41:38.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.127+0000 7f05a9400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05ac15d090 0x7f05ac06dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38704/0 (socket says 172.21.15.135:38704) 2024-05-14T09:41:38.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.127+0000 7f05a9400640 1 -- 172.21.15.135:0/712359205 learned_addr learned my addr 172.21.15.135:0/712359205 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:38.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.142+0000 7f0b7be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 0x7f0b7c0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.143+0000 7f0b7be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 0x7f0b7c0c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38702/0 (socket says 172.21.15.135:38702) 2024-05-14T09:41:38.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.143+0000 7f0b7be00640 1 -- 172.21.15.135:0/2985736034 learned_addr learned my addr 172.21.15.135:0/2985736034 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:38.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.286+0000 7f4d08c00640 1 -- 172.21.15.135:0/3213936291 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4d0401c070 con 0x7f4d0c159c30 2024-05-14T09:41:38.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.289+0000 7f4d08c00640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4cec076320 0x7f4cec078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.289+0000 7f4d10e00640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4cec076320 0x7f4cec078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.290+0000 7f4d10e00640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4cec076320 0x7f4cec078830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009aa0 tx=0x7f4cf8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.292+0000 7f4d08c00640 1 -- 172.21.15.135:0/3213936291 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f4d0405cec0 con 0x7f4d0c159c30 2024-05-14T09:41:38.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.310+0000 7f4d08c00640 1 -- 172.21.15.135:0/3213936291 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4d04023080 con 0x7f4d0c159c30 2024-05-14T09:41:38.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.388+0000 7f39eb400640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39ec0c7670 0x7f39ec14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.394+0000 7f0b7b400640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b7c0b2480 0x7f0b7c1f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.402+0000 7f39eb400640 1 -- 172.21.15.135:0/197460612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec15bf10 msgr2=0x7f39ec14f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.402+0000 7f39eb400640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec15bf10 0x7f39ec14f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.403+0000 7f39eb400640 1 -- 172.21.15.135:0/197460612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec0c5470 msgr2=0x7f39ec155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.403+0000 7f39eb400640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec0c5470 0x7f39ec155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.403+0000 7f39eb400640 1 -- 172.21.15.135:0/197460612 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec14fbb0 con 0x7f39ec0c7670 2024-05-14T09:41:38.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.406+0000 7f39eb400640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39ec0c7670 0x7f39ec14ebc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39d800b410 tx=0x7f39d800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.411+0000 7f05a9e00640 1 --2- 172.21.15.135:0/712359205 >> v2:172.21.15.196:3300/0 conn(0x7f05ac156800 0x7f05ac15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.421+0000 7f0b7b400640 1 -- 172.21.15.135:0/2985736034 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 msgr2=0x7f0b7c0c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.421+0000 7f0b7b400640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 0x7f0b7c0c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.421+0000 7f0b7b400640 1 -- 172.21.15.135:0/2985736034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7c0b3820 msgr2=0x7f0b7c154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.421+0000 7f0b7b400640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7c0b3820 0x7f0b7c154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.421+0000 7f0b7b400640 1 -- 172.21.15.135:0/2985736034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c1f1e90 con 0x7f0b7c0b2480 2024-05-14T09:41:38.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.429+0000 7f9ee0c00640 1 -- 172.21.15.135:0/2596177525 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9edc01a070 con 0x7f9ee41609d0 2024-05-14T09:41:38.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.430+0000 7f0b7b400640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b7c0b2480 0x7f0b7c1f1950 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b68031000 tx=0x7f0b680046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.431+0000 7f9ee0c00640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9ec4076320 0x7f9ec4078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.431+0000 7f9ee9200640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9ec4076320 0x7f9ec4078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.432+0000 7f0ed6000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ed80ca9e0 0x7f0ed8140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.432+0000 7f0ed6000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ed80ca9e0 0x7f0ed8140950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:58920/0 (socket says 172.21.15.135:58920) 2024-05-14T09:41:38.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.432+0000 7f0ed6000640 1 -- 172.21.15.135:0/2198451355 learned_addr learned my addr 172.21.15.135:0/2198451355 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:38.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.433+0000 7f9ee9200640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9ec4076320 0x7f9ec4078830 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ed002a290 tx=0x7f9ed002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.441+0000 7f0ed6000640 1 -- 172.21.15.135:0/2198451355 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ed815ff30 msgr2=0x7f0ed814ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.441+0000 7f0ed6000640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ed815ff30 0x7f0ed814ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.442+0000 7f0ed6000640 1 -- 172.21.15.135:0/2198451355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed80b7240 msgr2=0x7f0ed81f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.442+0000 7f0ed6000640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed80b7240 0x7f0ed81f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.442+0000 7f0ed6000640 1 -- 172.21.15.135:0/2198451355 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed81f65d0 con 0x7f0ed80ca9e0 2024-05-14T09:41:38.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.447+0000 7f39e3e00640 1 -- 172.21.15.135:0/197460612 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8015020 con 0x7f39ec0c7670 2024-05-14T09:41:38.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.447+0000 7f39e3e00640 1 -- 172.21.15.135:0/197460612 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d8011830 con 0x7f39ec0c7670 2024-05-14T09:41:38.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.447+0000 7f39f3200640 1 -- 172.21.15.135:0/197460612 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ec14d710 con 0x7f39ec0c7670 2024-05-14T09:41:38.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.447+0000 7f39e3e00640 1 -- 172.21.15.135:0/197460612 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8011c60 con 0x7f39ec0c7670 2024-05-14T09:41:38.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.447+0000 7f39f3200640 1 -- 172.21.15.135:0/197460612 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ec14dcd0 con 0x7f39ec0c7670 2024-05-14T09:41:38.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.449+0000 7f39f3200640 1 -- 172.21.15.135:0/197460612 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ec0704c0 con 0x7f39ec0c7670 2024-05-14T09:41:38.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.453+0000 7f0ed6000640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ed80ca9e0 0x7f0ed8140950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400e840 tx=0x7f0ec400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.459+0000 7f9ee0c00640 1 -- 172.21.15.135:0/2596177525 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f9edc05c900 con 0x7f9ee41609d0 2024-05-14T09:41:38.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.460+0000 7f9ee0c00640 1 -- 172.21.15.135:0/2596177525 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9ee415f540 con 0x7f9ee41609d0 2024-05-14T09:41:38.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.462+0000 7f0b73e00640 1 -- 172.21.15.135:0/2985736034 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68042020 con 0x7f0b7c0b2480 2024-05-14T09:41:38.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.462+0000 7f0b73e00640 1 -- 172.21.15.135:0/2985736034 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b68030930 con 0x7f0b7c0b2480 2024-05-14T09:41:38.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.462+0000 7f0b73e00640 1 -- 172.21.15.135:0/2985736034 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68037040 con 0x7f0b7c0b2480 2024-05-14T09:41:38.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.462+0000 7f0b81800640 1 -- 172.21.15.135:0/2985736034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7c1eedd0 con 0x7f0b7c0b2480 2024-05-14T09:41:38.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.463+0000 7f18f8a00640 1 --2- 172.21.15.135:0/921738959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18f40b5170 0x7f18f40702a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18f4071410 tx=0x7f18ec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef67d2acd4d534b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.463+0000 7f0b81800640 1 -- 172.21.15.135:0/2985736034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7c159f20 con 0x7f0b7c0b2480 2024-05-14T09:41:38.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.464+0000 7f0b81800640 1 -- 172.21.15.135:0/2985736034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7c0c2e20 con 0x7f0b7c0b2480 2024-05-14T09:41:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.469+0000 7f05a9e00640 1 -- 172.21.15.135:0/712359205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05ac15d090 msgr2=0x7f05ac06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.469+0000 7f05a9e00640 1 --2- 172.21.15.135:0/712359205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05ac15d090 0x7f05ac06dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.469+0000 7f05a9e00640 1 -- 172.21.15.135:0/712359205 >> v1:172.21.15.135:6789/0 conn(0x7f05ac06e1a0 legacy=0x7f05ac0c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.469+0000 7f05a9e00640 1 -- 172.21.15.135:0/712359205 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac0b34a0 con 0x7f05ac156800 2024-05-14T09:41:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.471+0000 7f0ecea00640 1 -- 172.21.15.135:0/2198451355 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4017070 con 0x7f0ed80ca9e0 2024-05-14T09:41:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.471+0000 7f0ecea00640 1 -- 172.21.15.135:0/2198451355 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec400c8e0 con 0x7f0ed80ca9e0 2024-05-14T09:41:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.471+0000 7f0ecea00640 1 -- 172.21.15.135:0/2198451355 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400ccd0 con 0x7f0ed80ca9e0 2024-05-14T09:41:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.471+0000 7f0edd800640 1 -- 172.21.15.135:0/2198451355 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed80d1210 con 0x7f0ed80ca9e0 2024-05-14T09:41:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.471+0000 7f0edd800640 1 -- 172.21.15.135:0/2198451355 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed81520e0 con 0x7f0ed80ca9e0 2024-05-14T09:41:38.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.472+0000 7f0edd800640 1 -- 172.21.15.135:0/2198451355 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed80d1500 con 0x7f0ed80ca9e0 2024-05-14T09:41:38.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.499+0000 7f18f2a00640 1 -- 172.21.15.135:0/921738959 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec036070 con 0x7f18f40b5170 2024-05-14T09:41:38.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.499+0000 7f18f2a00640 1 -- 172.21.15.135:0/921738959 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ec031600 con 0x7f18f40b5170 2024-05-14T09:41:38.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.499+0000 7f18f2a00640 1 -- 172.21.15.135:0/921738959 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0319d0 con 0x7f18f40b5170 2024-05-14T09:41:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.500+0000 7f18faa00640 1 -- 172.21.15.135:0/921738959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18f40b5170 msgr2=0x7f18f40702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.500+0000 7f18faa00640 1 --2- 172.21.15.135:0/921738959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18f40b5170 0x7f18f40702a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18f4071410 tx=0x7f18ec02a6a0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.500+0000 7f18faa00640 1 -- 172.21.15.135:0/921738959 shutdown_connections 2024-05-14T09:41:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.500+0000 7f18faa00640 1 --2- 172.21.15.135:0/921738959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18f40b5170 0x7f18f40702a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.500+0000 7f18faa00640 1 --2- 172.21.15.135:0/921738959 >> v2:172.21.15.196:3300/0 conn(0x7f18f4071480 0x7f18f4154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.500+0000 7f18faa00640 1 -- 172.21.15.135:0/921738959 >> 172.21.15.135:0/921738959 conn(0x7f18f40cf6a0 msgr2=0x7f18f40cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.500+0000 7f18faa00640 1 -- 172.21.15.135:0/921738959 shutdown_connections 2024-05-14T09:41:38.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.500+0000 7f18faa00640 1 -- 172.21.15.135:0/921738959 wait complete. 2024-05-14T09:41:38.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.502+0000 7f18faa00640 1 Processor -- start 2024-05-14T09:41:38.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.503+0000 7f18faa00640 1 -- start start 2024-05-14T09:41:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.504+0000 7f18faa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f18f4071480 0x7f18f40c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.504+0000 7f18faa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18f40b5170 0x7f18f40c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.504+0000 7f18faa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18f40cbae0 0x7f18f4151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.505+0000 7f18faa00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f18f40cb620 con 0x7f18f40cbae0 2024-05-14T09:41:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.505+0000 7f18faa00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f18f40ca480 con 0x7f18f40b5170 2024-05-14T09:41:38.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.505+0000 7f18faa00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f18f41582e0 con 0x7f18f4071480 2024-05-14T09:41:38.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.507+0000 7f18f8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18f40cbae0 0x7f18f4151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.507+0000 7f18f8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18f40cbae0 0x7f18f4151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56116/0 (socket says 172.21.15.135:56116) 2024-05-14T09:41:38.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.508+0000 7f18f8a00640 1 -- 172.21.15.135:0/2779835179 learned_addr learned my addr 172.21.15.135:0/2779835179 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:38.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.514+0000 7f18f8a00640 1 -- 172.21.15.135:0/2779835179 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f18f4071480 msgr2=0x7f18f40c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.514+0000 7f18f8a00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f18f4071480 0x7f18f40c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.514+0000 7f18f8a00640 1 -- 172.21.15.135:0/2779835179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18f40b5170 msgr2=0x7f18f40c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.514+0000 7f18f8a00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18f40b5170 0x7f18f40c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.514+0000 7f18f8a00640 1 -- 172.21.15.135:0/2779835179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f40c42f0 con 0x7f18f40cbae0 2024-05-14T09:41:38.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.518+0000 7f18f8a00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18f40cbae0 0x7f18f4151c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009f10 tx=0x7f18ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.522+0000 7fc2d2a00640 1 -- 172.21.15.135:0/3188008726 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc2c8018020 con 0x7fc2d4050050 2024-05-14T09:41:38.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.523+0000 7f18ebe00640 1 -- 172.21.15.135:0/2779835179 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec041020 con 0x7f18f40cbae0 2024-05-14T09:41:38.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.523+0000 7f18ebe00640 1 -- 172.21.15.135:0/2779835179 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ec008740 con 0x7f18f40cbae0 2024-05-14T09:41:38.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.523+0000 7f18ebe00640 1 -- 172.21.15.135:0/2779835179 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec036040 con 0x7f18f40cbae0 2024-05-14T09:41:38.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.523+0000 7f18faa00640 1 -- 172.21.15.135:0/2779835179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f41f5c90 con 0x7f18f40cbae0 2024-05-14T09:41:38.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.523+0000 7fc2d2a00640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc2bc076320 0x7fc2bc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.523+0000 7f18faa00640 1 -- 172.21.15.135:0/2779835179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f41f5f70 con 0x7f18f40cbae0 2024-05-14T09:41:38.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.524+0000 7fc2da800640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc2bc076320 0x7fc2bc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.525+0000 7f18faa00640 1 -- 172.21.15.135:0/2779835179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f4069a60 con 0x7f18f40cbae0 2024-05-14T09:41:38.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.525+0000 7fc2da800640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc2bc076320 0x7fc2bc078830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc034000 tx=0x7fc2cc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.528+0000 7f05a9e00640 1 --2- 172.21.15.135:0/712359205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05ac156800 0x7f05ac15cb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f059c0097a0 tx=0x7f059c02a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ace43994c37260f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.532+0000 7fc2d2a00640 1 -- 172.21.15.135:0/3188008726 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fc2c8011de0 con 0x7fc2d4050050 2024-05-14T09:41:38.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.549+0000 7f4d13800640 1 -- 172.21.15.135:0/3213936291 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4d0c149810 con 0x7f4d0c159c30 2024-05-14T09:41:38.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.550+0000 7f18ebe00640 1 -- 172.21.15.135:0/2779835179 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f18ec044020 con 0x7f18f40cbae0 2024-05-14T09:41:38.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.552+0000 7f18ebe00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f18d4076300 0x7f18d4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:38.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.552+0000 7f18f3e00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f18d4076300 0x7f18d4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:38.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.553+0000 7f18f3e00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f18d4076300 0x7f18d4078810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009670 tx=0x7f18e4006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:38.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.556+0000 7f18ebe00640 1 -- 172.21.15.135:0/2779835179 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f18ec07ddb0 con 0x7f18f40cbae0 2024-05-14T09:41:38.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.560+0000 7fc2d2a00640 1 -- 172.21.15.135:0/3188008726 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc2c801f020 con 0x7fc2d4050050 2024-05-14T09:41:38.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.677+0000 7f9eebc00640 1 -- 172.21.15.135:0/2596177525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9ee4069a60 con 0x7f9ee41609d0 2024-05-14T09:41:38.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.816+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3188008726 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc2d417d0e0 con 0x7fc2d4050050 2024-05-14T09:41:38.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.841+0000 7fc2d2a00640 1 -- 172.21.15.135:0/3188008726 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc2c80612a0 con 0x7fc2d4050050 2024-05-14T09:41:38.842 INFO:teuthology.orchestra.run.smithi135.stdout:60129542162 2024-05-14T09:41:38.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3188008726 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc2bc076320 msgr2=0x7fc2bc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc2bc076320 0x7fc2bc078830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc034000 tx=0x7fc2cc02e000 comp rx=0 tx=0).stop 2024-05-14T09:41:38.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3188008726 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2d4050050 msgr2=0x7fc2d417a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2d4050050 0x7fc2d417a0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800b440 tx=0x7fc2c800b900 comp rx=0 tx=0).stop 2024-05-14T09:41:38.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3188008726 shutdown_connections 2024-05-14T09:41:38.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc2bc076320 0x7fc2bc078830 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc2d40495e0 0x7fc2d40d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc2d4050050 0x7fc2d417a0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 --2- 172.21.15.135:0/3188008726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2d4007910 0x7fc2d417d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3188008726 >> 172.21.15.135:0/3188008726 conn(0x7fc2d400e380 msgr2=0x7fc2d40d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3188008726 shutdown_connections 2024-05-14T09:41:38.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.844+0000 7fc2e0a00640 1 -- 172.21.15.135:0/3188008726 wait complete. 2024-05-14T09:41:38.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542163 got 60129542162 for osd.1 2024-05-14T09:41:38.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.887+0000 7f18ebe00640 1 -- 172.21.15.135:0/2779835179 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f18ec04b070 con 0x7f18f40cbae0 2024-05-14T09:41:38.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.923+0000 7f9ee0c00640 1 -- 172.21.15.135:0/2596177525 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9edc022080 con 0x7f9ee41609d0 2024-05-14T09:41:38.924 INFO:teuthology.orchestra.run.smithi135.stdout:64424509459 2024-05-14T09:41:38.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 -- 172.21.15.135:0/2596177525 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9ec4076320 msgr2=0x7f9ec4078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9ec4076320 0x7f9ec4078830 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ed002a290 tx=0x7f9ed002e000 comp rx=0 tx=0).stop 2024-05-14T09:41:38.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 -- 172.21.15.135:0/2596177525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ee41609d0 msgr2=0x7f9ee40705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:38.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ee41609d0 0x7f9ee40705c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4072bd0 tx=0x7f9edc00ce80 comp rx=0 tx=0).stop 2024-05-14T09:41:38.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 -- 172.21.15.135:0/2596177525 shutdown_connections 2024-05-14T09:41:38.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9ec4076320 0x7f9ec4078830 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee40ca310 0x7f9ee4153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ee41609d0 0x7f9ee40705c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 --2- 172.21.15.135:0/2596177525 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee40c53a0 0x7f9ee41fa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:38.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 -- 172.21.15.135:0/2596177525 >> 172.21.15.135:0/2596177525 conn(0x7f9ee4071a20 msgr2=0x7f9ee4160f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:38.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 -- 172.21.15.135:0/2596177525 shutdown_connections 2024-05-14T09:41:38.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:38.926+0000 7f9eebc00640 1 -- 172.21.15.135:0/2596177525 wait complete. 2024-05-14T09:41:38.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509460 got 64424509459 for osd.7 2024-05-14T09:41:39.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.103+0000 7f18faa00640 1 -- 172.21.15.135:0/2779835179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f18f40cb8c0 con 0x7f18f40cbae0 2024-05-14T09:41:39.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.112+0000 7f18ebe00640 1 -- 172.21.15.135:0/2779835179 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f18ec082220 con 0x7f18f40cbae0 2024-05-14T09:41:39.112 INFO:teuthology.orchestra.run.smithi135.stdout:68719476755 2024-05-14T09:41:39.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 -- 172.21.15.135:0/2779835179 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f18d4076300 msgr2=0x7f18d4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f18d4076300 0x7f18d4078810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009670 tx=0x7f18e4006bf0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 -- 172.21.15.135:0/2779835179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18f40cbae0 msgr2=0x7f18f4151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18f40cbae0 0x7f18f4151c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009f10 tx=0x7f18ec004a40 comp rx=0 tx=0).stop 2024-05-14T09:41:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 -- 172.21.15.135:0/2779835179 shutdown_connections 2024-05-14T09:41:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f18d4076300 0x7f18d4078810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18f40b5170 0x7f18f40c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18f40cbae0 0x7f18f4151c90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 --2- 172.21.15.135:0/2779835179 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f18f4071480 0x7f18f40c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 -- 172.21.15.135:0/2779835179 >> 172.21.15.135:0/2779835179 conn(0x7f18f40cf6a0 msgr2=0x7f18f40ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 -- 172.21.15.135:0/2779835179 shutdown_connections 2024-05-14T09:41:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.115+0000 7f18faa00640 1 -- 172.21.15.135:0/2779835179 wait complete. 2024-05-14T09:41:39.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476756 got 68719476755 for osd.6 2024-05-14T09:41:39.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.459+0000 7f39e3e00640 1 -- 172.21.15.135:0/197460612 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f39d8018020 con 0x7f39ec0c7670 2024-05-14T09:41:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.463+0000 7f39e3e00640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f39cc076320 0x7f39cc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.463+0000 7f39e3e00640 1 -- 172.21.15.135:0/197460612 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f39d8097d80 con 0x7f39ec0c7670 2024-05-14T09:41:39.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.464+0000 7f39ebe00640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f39cc076320 0x7f39cc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:39.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.466+0000 7f39ebe00640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f39cc076320 0x7f39cc078830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f39dc006f40 tx=0x7f39dc006e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:39.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.466+0000 7f0b73e00640 1 -- 172.21.15.135:0/2985736034 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0b68045020 con 0x7f0b7c0b2480 2024-05-14T09:41:39.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.469+0000 7f0b73e00640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b5c076300 0x7f0b5c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:39.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.470+0000 7f0b7be00640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b5c076300 0x7f0b5c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.472+0000 7f0b7be00640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b5c076300 0x7f0b5c078810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c006fd0 tx=0x7f0b6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.476+0000 7f0b73e00640 1 -- 172.21.15.135:0/2985736034 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f0b68030d20 con 0x7f0b7c0b2480 2024-05-14T09:41:39.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.496+0000 7f0b73e00640 1 -- 172.21.15.135:0/2985736034 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0b7c0c2e20 con 0x7f0b7c0b2480 2024-05-14T09:41:39.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.526+0000 7f05a8a00640 1 -- 172.21.15.135:0/712359205 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c037070 con 0x7f05ac156800 2024-05-14T09:41:39.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.526+0000 7f05a8a00640 1 -- 172.21.15.135:0/712359205 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c02ada0 con 0x7f05ac156800 2024-05-14T09:41:39.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.526+0000 7f05a8a00640 1 -- 172.21.15.135:0/712359205 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c032660 con 0x7f05ac156800 2024-05-14T09:41:39.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.527+0000 7f39e3e00640 1 -- 172.21.15.135:0/197460612 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f39ec0704c0 con 0x7f39ec0c7670 2024-05-14T09:41:39.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.528+0000 7f05b1200640 1 -- 172.21.15.135:0/712359205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05ac156800 msgr2=0x7f05ac15cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.528+0000 7f05b1200640 1 --2- 172.21.15.135:0/712359205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05ac156800 0x7f05ac15cb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f059c0097a0 tx=0x7f059c02a050 comp rx=0 tx=0).stop 2024-05-14T09:41:39.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.528+0000 7f05b1200640 1 -- 172.21.15.135:0/712359205 shutdown_connections 2024-05-14T09:41:39.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.528+0000 7f05b1200640 1 --2- 172.21.15.135:0/712359205 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05ac15d090 0x7f05ac06dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.528+0000 7f05b1200640 1 --2- 172.21.15.135:0/712359205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05ac156800 0x7f05ac15cb50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.528+0000 7f05b1200640 1 -- 172.21.15.135:0/712359205 >> 172.21.15.135:0/712359205 conn(0x7f05ac0cac60 msgr2=0x7f05ac0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:39.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.528+0000 7f05b1200640 1 -- 172.21.15.135:0/712359205 shutdown_connections 2024-05-14T09:41:39.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.528+0000 7f05b1200640 1 -- 172.21.15.135:0/712359205 wait complete. 2024-05-14T09:41:39.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.533+0000 7f05b1200640 1 Processor -- start 2024-05-14T09:41:39.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.533+0000 7f05b1200640 1 -- start start 2024-05-14T09:41:39.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.536+0000 7f05b1200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05ac06e1a0 0x7f05ac1508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:39.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.536+0000 7f05b1200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05ac156800 0x7f05ac15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:39.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.536+0000 7f05b1200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac15d090 0x7f05ac153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:39.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.536+0000 7f05b1200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac15c630 con 0x7f05ac15d090 2024-05-14T09:41:39.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.536+0000 7f05b1200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac0c30d0 con 0x7f05ac156800 2024-05-14T09:41:39.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.536+0000 7f05b1200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f05ac0c4020 con 0x7f05ac06e1a0 2024-05-14T09:41:39.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.537+0000 7f05aa800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac15d090 0x7f05ac153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:39.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.538+0000 7f05aa800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac15d090 0x7f05ac153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56122/0 (socket says 172.21.15.135:56122) 2024-05-14T09:41:39.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.538+0000 7f05aa800640 1 -- 172.21.15.135:0/2220816384 learned_addr learned my addr 172.21.15.135:0/2220816384 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:39.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.538+0000 7f05a9e00640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05ac06e1a0 0x7f05ac1508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:39.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.543+0000 7f05aa800640 1 -- 172.21.15.135:0/2220816384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05ac06e1a0 msgr2=0x7f05ac1508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.543+0000 7f05aa800640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05ac06e1a0 0x7f05ac1508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.543+0000 7f05aa800640 1 -- 172.21.15.135:0/2220816384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05ac156800 msgr2=0x7f05ac15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.543+0000 7f05aa800640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05ac156800 0x7f05ac15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.543+0000 7f05aa800640 1 -- 172.21.15.135:0/2220816384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac150de0 con 0x7f05ac15d090 2024-05-14T09:41:39.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.547+0000 7f05aa800640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac15d090 0x7f05ac153b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f05a400b930 tx=0x7f05a400bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:39.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.553+0000 7f05a2000640 1 -- 172.21.15.135:0/2220816384 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4019070 con 0x7f05ac15d090 2024-05-14T09:41:39.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.553+0000 7f05a2000640 1 -- 172.21.15.135:0/2220816384 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a400cb00 con 0x7f05ac15d090 2024-05-14T09:41:39.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.553+0000 7f05b1200640 1 -- 172.21.15.135:0/2220816384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ac1f28d0 con 0x7f05ac15d090 2024-05-14T09:41:39.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.553+0000 7f05a2000640 1 -- 172.21.15.135:0/2220816384 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4014440 con 0x7f05ac15d090 2024-05-14T09:41:39.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.554+0000 7f05b1200640 1 -- 172.21.15.135:0/2220816384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ac1f2b90 con 0x7f05ac15d090 2024-05-14T09:41:39.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.555+0000 7f05b1200640 1 -- 172.21.15.135:0/2220816384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ac0c3b00 con 0x7f05ac15d090 2024-05-14T09:41:39.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.563+0000 7f0ecea00640 1 -- 172.21.15.135:0/2198451355 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ec401a070 con 0x7f0ed80ca9e0 2024-05-14T09:41:39.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.564+0000 7f0ecea00640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0eb8076320 0x7f0eb8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:39.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.564+0000 7f0ed6a00640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0eb8076320 0x7f0eb8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:39.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.565+0000 7f0ed6a00640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0eb8076320 0x7f0eb8078830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8034000 tx=0x7f0ec802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:39.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.576+0000 7f0ecea00640 1 -- 172.21.15.135:0/2198451355 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f0ec405d1b0 con 0x7f0ed80ca9e0 2024-05-14T09:41:39.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.592+0000 7f0ecea00640 1 -- 172.21.15.135:0/2198451355 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ec4061620 con 0x7f0ed80ca9e0 2024-05-14T09:41:39.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.594+0000 7f05a2000640 1 -- 172.21.15.135:0/2220816384 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f05a4003970 con 0x7f05ac15d090 2024-05-14T09:41:39.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.596+0000 7f05a2000640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f058c076350 0x7f058c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:39.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.596+0000 7f05a9e00640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f058c076350 0x7f058c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:39.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.597+0000 7f05a9e00640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f058c076350 0x7f058c078860 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f059c034000 tx=0x7f059c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:39.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.600+0000 7f05a2000640 1 -- 172.21.15.135:0/2220816384 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f05a405cbd0 con 0x7f05ac15d090 2024-05-14T09:41:39.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.714+0000 7f4d08c00640 1 -- 172.21.15.135:0/3213936291 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d0c149810 con 0x7f4d0c159c30 2024-05-14T09:41:39.714 INFO:teuthology.orchestra.run.smithi135.stdout:68719476757 2024-05-14T09:41:39.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.717+0000 7f4d13800640 1 -- 172.21.15.135:0/3213936291 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4cec076320 msgr2=0x7f4cec078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.717+0000 7f4d13800640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4cec076320 0x7f4cec078830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009aa0 tx=0x7f4cf8009190 comp rx=0 tx=0).stop 2024-05-14T09:41:39.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.717+0000 7f4d13800640 1 -- 172.21.15.135:0/3213936291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d0c159c30 msgr2=0x7f4d0c155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.717+0000 7f4d13800640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d0c159c30 0x7f4d0c155ed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400b9e0 tx=0x7f4d0400bea0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.717+0000 7f4d13800640 1 -- 172.21.15.135:0/3213936291 shutdown_connections 2024-05-14T09:41:39.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.717+0000 7f4d13800640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4cec076320 0x7f4cec078830 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.718+0000 7f4d13800640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d0c159c30 0x7f4d0c155ed0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.718+0000 7f4d13800640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d0c0c5450 0x7f4d0c13d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.718+0000 7f4d13800640 1 --2- 172.21.15.135:0/3213936291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d0c071a40 0x7f4d0c14a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.718+0000 7f4d13800640 1 -- 172.21.15.135:0/3213936291 >> 172.21.15.135:0/3213936291 conn(0x7f4d0c070f20 msgr2=0x7f4d0c157a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:39.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.718+0000 7f4d13800640 1 -- 172.21.15.135:0/3213936291 shutdown_connections 2024-05-14T09:41:39.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.718+0000 7f4d13800640 1 -- 172.21.15.135:0/3213936291 wait complete. 2024-05-14T09:41:39.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476757 for osd.3 2024-05-14T09:41:39.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.758+0000 7f0b81800640 1 -- 172.21.15.135:0/2985736034 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0b7c069980 con 0x7f0b7c0b2480 2024-05-14T09:41:39.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.765+0000 7f39f3200640 1 -- 172.21.15.135:0/197460612 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f39ec152cf0 con 0x7f39ec0c7670 2024-05-14T09:41:39.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.783+0000 7f0b73e00640 1 -- 172.21.15.135:0/2985736034 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b6804c030 con 0x7f0b7c0b2480 2024-05-14T09:41:39.783 INFO:teuthology.orchestra.run.smithi135.stdout:68719476754 2024-05-14T09:41:39.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 -- 172.21.15.135:0/2985736034 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b5c076300 msgr2=0x7f0b5c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b5c076300 0x7f0b5c078810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c006fd0 tx=0x7f0b6c008040 comp rx=0 tx=0).stop 2024-05-14T09:41:39.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 -- 172.21.15.135:0/2985736034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b7c0b2480 msgr2=0x7f0b7c1f1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b7c0b2480 0x7f0b7c1f1950 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b68031000 tx=0x7f0b680046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 -- 172.21.15.135:0/2985736034 shutdown_connections 2024-05-14T09:41:39.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0b5c076300 0x7f0b5c078810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b7c0b2480 0x7f0b7c1f1950 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7c0b3820 0x7f0b7c154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 --2- 172.21.15.135:0/2985736034 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0b7c0b1f30 0x7f0b7c0c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 -- 172.21.15.135:0/2985736034 >> 172.21.15.135:0/2985736034 conn(0x7f0b7c0cf550 msgr2=0x7f0b7c0b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:39.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 -- 172.21.15.135:0/2985736034 shutdown_connections 2024-05-14T09:41:39.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.785+0000 7f0b81800640 1 -- 172.21.15.135:0/2985736034 wait complete. 2024-05-14T09:41:39.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.787+0000 7f39e3e00640 1 -- 172.21.15.135:0/197460612 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f39ec152cf0 con 0x7f39ec0c7670 2024-05-14T09:41:39.787 INFO:teuthology.orchestra.run.smithi135.stdout:68719476754 2024-05-14T09:41:39.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 -- 172.21.15.135:0/197460612 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f39cc076320 msgr2=0x7f39cc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f39cc076320 0x7f39cc078830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f39dc006f40 tx=0x7f39dc006e90 comp rx=0 tx=0).stop 2024-05-14T09:41:39.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 -- 172.21.15.135:0/197460612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39ec0c7670 msgr2=0x7f39ec14ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39ec0c7670 0x7f39ec14ebc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39d800b410 tx=0x7f39d800b8d0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 -- 172.21.15.135:0/197460612 shutdown_connections 2024-05-14T09:41:39.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f39cc076320 0x7f39cc078830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39ec0c7670 0x7f39ec14ebc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39ec15bf10 0x7f39ec14f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 --2- 172.21.15.135:0/197460612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec0c5470 0x7f39ec155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 -- 172.21.15.135:0/197460612 >> 172.21.15.135:0/197460612 conn(0x7f39ec073d40 msgr2=0x7f39ec150270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:39.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 -- 172.21.15.135:0/197460612 shutdown_connections 2024-05-14T09:41:39.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.790+0000 7f39f3200640 1 -- 172.21.15.135:0/197460612 wait complete. 2024-05-14T09:41:39.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476755 got 68719476754 for osd.0 2024-05-14T09:41:39.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476755 got 68719476754 for osd.2 2024-05-14T09:41:39.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.825+0000 7f0edd800640 1 -- 172.21.15.135:0/2198451355 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0ed8069a60 con 0x7f0ed80ca9e0 2024-05-14T09:41:39.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.845+0000 7f0ecea00640 1 -- 172.21.15.135:0/2198451355 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ec4060f20 con 0x7f0ed80ca9e0 2024-05-14T09:41:39.845 INFO:teuthology.orchestra.run.smithi135.stdout:60129542160 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.847+0000 7f0edd800640 1 -- 172.21.15.135:0/2198451355 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0eb8076320 msgr2=0x7f0eb8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.847+0000 7f0edd800640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0eb8076320 0x7f0eb8078830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8034000 tx=0x7f0ec802c000 comp rx=0 tx=0).stop 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.847+0000 7f0edd800640 1 -- 172.21.15.135:0/2198451355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ed80ca9e0 msgr2=0x7f0ed8140950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.847+0000 7f0edd800640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ed80ca9e0 0x7f0ed8140950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400e840 tx=0x7f0ec400ed00 comp rx=0 tx=0).stop 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.847+0000 7f0edd800640 1 -- 172.21.15.135:0/2198451355 shutdown_connections 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.847+0000 7f0edd800640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0eb8076320 0x7f0eb8078830 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.847+0000 7f0edd800640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0ed80ca9e0 0x7f0ed8140950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.847+0000 7f0edd800640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0ed815ff30 0x7f0ed814ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.847+0000 7f0edd800640 1 --2- 172.21.15.135:0/2198451355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ed80b7240 0x7f0ed81f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.847+0000 7f0edd800640 1 -- 172.21.15.135:0/2198451355 >> 172.21.15.135:0/2198451355 conn(0x7f0ed80ce940 msgr2=0x7f0ed806ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.847+0000 7f0edd800640 1 -- 172.21.15.135:0/2198451355 shutdown_connections 2024-05-14T09:41:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.848+0000 7f0edd800640 1 -- 172.21.15.135:0/2198451355 wait complete. 2024-05-14T09:41:39.869 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-14T09:41:39.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542161 got 60129542160 for osd.5 2024-05-14T09:41:39.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:39.921+0000 7f05a2000640 1 -- 172.21.15.135:0/2220816384 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f05ac0c3b00 con 0x7f05ac15d090 2024-05-14T09:41:39.952 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-14T09:41:40.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.126+0000 7f93f1400640 1 Processor -- start 2024-05-14T09:41:40.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.126+0000 7f93f1400640 1 -- start start 2024-05-14T09:41:40.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.128+0000 7f93f1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 0x7f93ec15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.129+0000 7f93f1400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f93ec06e370 0x7f93ec166d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.129+0000 7f93f1400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93ec0c9db0 con 0x7f93ec15d090 2024-05-14T09:41:40.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.129+0000 7f93f1400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f93ec156c10 con 0x7f93ec06e370 2024-05-14T09:41:40.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.129+0000 7f93f1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec0b3200 con 0x7f93ec156800 2024-05-14T09:41:40.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.137+0000 7f05b1200640 1 -- 172.21.15.135:0/2220816384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f05ac069a60 con 0x7f05ac15d090 2024-05-14T09:41:40.140 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-14T09:41:40.145 INFO:teuthology.orchestra.run.smithi135.stdout:68719476758 2024-05-14T09:41:40.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.144+0000 7f05a2000640 1 -- 172.21.15.135:0/2220816384 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f05a4022070 con 0x7f05ac15d090 2024-05-14T09:41:40.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 -- 172.21.15.135:0/2220816384 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f058c076350 msgr2=0x7f058c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f058c076350 0x7f058c078860 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f059c034000 tx=0x7f059c02e000 comp rx=0 tx=0).stop 2024-05-14T09:41:40.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 -- 172.21.15.135:0/2220816384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac15d090 msgr2=0x7f05ac153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac15d090 0x7f05ac153b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f05a400b930 tx=0x7f05a400bdf0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 -- 172.21.15.135:0/2220816384 shutdown_connections 2024-05-14T09:41:40.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f058c076350 0x7f058c078860 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05ac156800 0x7f05ac15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05ac15d090 0x7f05ac153b80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 --2- 172.21.15.135:0/2220816384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f05ac06e1a0 0x7f05ac1508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 -- 172.21.15.135:0/2220816384 >> 172.21.15.135:0/2220816384 conn(0x7f05ac0cac60 msgr2=0x7f05ac0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:40.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 -- 172.21.15.135:0/2220816384 shutdown_connections 2024-05-14T09:41:40.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.147+0000 7f05b1200640 1 -- 172.21.15.135:0/2220816384 wait complete. 2024-05-14T09:41:40.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.151+0000 7f93ea800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 0x7f93ec15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.153+0000 7f93ea800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 0x7f93ec15cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38748/0 (socket says 172.21.15.135:38748) 2024-05-14T09:41:40.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.153+0000 7f93ea800640 1 -- 172.21.15.135:0/55442624 learned_addr learned my addr 172.21.15.135:0/55442624 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:40.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.159+0000 7f93ea800640 1 -- 172.21.15.135:0/55442624 >> v2:172.21.15.196:3300/0 conn(0x7f93ec06e370 msgr2=0x7f93ec166d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:40.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.159+0000 7f93ea800640 1 --2- 172.21.15.135:0/55442624 >> v2:172.21.15.196:3300/0 conn(0x7f93ec06e370 0x7f93ec166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.159+0000 7f93ea800640 1 -- 172.21.15.135:0/55442624 >> v1:172.21.15.196:6789/0 conn(0x7f93ec15d090 legacy=0x7f93ec06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:40.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.159+0000 7f93ea800640 1 -- 172.21.15.135:0/55442624 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec0b34a0 con 0x7f93ec156800 2024-05-14T09:41:40.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.165+0000 7f93ea800640 1 --2- 172.21.15.135:0/55442624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 0x7f93ec15cb50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009870 tx=0x7f93dc02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dc2b9b33f52f5c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:40.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476758 got 68719476758 for osd.4 2024-05-14T09:41:40.172 DEBUG:teuthology.parallel:result is None 2024-05-14T09:41:40.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.174+0000 7f93e9e00640 1 -- 172.21.15.135:0/55442624 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc037070 con 0x7f93ec156800 2024-05-14T09:41:40.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.174+0000 7f93e9e00640 1 -- 172.21.15.135:0/55442624 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93dc032440 con 0x7f93ec156800 2024-05-14T09:41:40.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.174+0000 7f93e9e00640 1 -- 172.21.15.135:0/55442624 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc032810 con 0x7f93ec156800 2024-05-14T09:41:40.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.175+0000 7f93f1400640 1 -- 172.21.15.135:0/55442624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 msgr2=0x7f93ec15cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.175+0000 7f93f1400640 1 --2- 172.21.15.135:0/55442624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 0x7f93ec15cb50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009870 tx=0x7f93dc02a130 comp rx=0 tx=0).stop 2024-05-14T09:41:40.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.175+0000 7f93f1400640 1 -- 172.21.15.135:0/55442624 shutdown_connections 2024-05-14T09:41:40.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.175+0000 7f93f1400640 1 --2- 172.21.15.135:0/55442624 >> v2:172.21.15.196:3300/0 conn(0x7f93ec06e370 0x7f93ec166d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.175+0000 7f93f1400640 1 --2- 172.21.15.135:0/55442624 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 0x7f93ec15cb50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.175+0000 7f93f1400640 1 -- 172.21.15.135:0/55442624 >> 172.21.15.135:0/55442624 conn(0x7f93ec0cac60 msgr2=0x7f93ec0cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:40.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.175+0000 7f93f1400640 1 -- 172.21.15.135:0/55442624 shutdown_connections 2024-05-14T09:41:40.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.175+0000 7f93f1400640 1 -- 172.21.15.135:0/55442624 wait complete. 2024-05-14T09:41:40.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.177+0000 7f93f1400640 1 Processor -- start 2024-05-14T09:41:40.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.178+0000 7f93f1400640 1 -- start start 2024-05-14T09:41:40.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.179+0000 7f93f1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93ec06e370 0x7f93ec1464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.179+0000 7f93f1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 0x7f93ec15b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.179+0000 7f93f1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93ec15d090 0x7f93ec1f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.179+0000 7f93f1400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec15c630 con 0x7f93ec15d090 2024-05-14T09:41:40.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.179+0000 7f93f1400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec0c30d0 con 0x7f93ec06e370 2024-05-14T09:41:40.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.179+0000 7f93f1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec0c4020 con 0x7f93ec156800 2024-05-14T09:41:40.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.180+0000 7f93e3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 0x7f93ec15b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.180+0000 7f93eb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93ec15d090 0x7f93ec1f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.181+0000 7f93eb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93ec15d090 0x7f93ec1f5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56126/0 (socket says 172.21.15.135:56126) 2024-05-14T09:41:40.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.181+0000 7f93eb200640 1 -- 172.21.15.135:0/557588639 learned_addr learned my addr 172.21.15.135:0/557588639 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:40.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.185+0000 7f93eb200640 1 -- 172.21.15.135:0/557588639 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 msgr2=0x7f93ec15b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.185+0000 7f93eb200640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 0x7f93ec15b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.185+0000 7f93eb200640 1 -- 172.21.15.135:0/557588639 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93ec06e370 msgr2=0x7f93ec1464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.185+0000 7f93eb200640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93ec06e370 0x7f93ec1464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.185+0000 7f93eb200640 1 -- 172.21.15.135:0/557588639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec1f6020 con 0x7f93ec15d090 2024-05-14T09:41:40.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.188+0000 7f93eb200640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93ec15d090 0x7f93ec1f5ae0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f93e400b9a0 tx=0x7f93e400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.202+0000 7fc528800640 1 Processor -- start 2024-05-14T09:41:40.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.202+0000 7fc528800640 1 -- start start 2024-05-14T09:41:40.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.203+0000 7fc528800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc5200b54e0 0x7fc5200cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.204+0000 7fc528800640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5200b6f20 con 0x7fc52015a2f0 2024-05-14T09:41:40.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.204+0000 7fc528800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc52006cb00 con 0x7fc52006c6f0 2024-05-14T09:41:40.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.204+0000 7fc528800640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc5200b7230 con 0x7fc5200b54e0 2024-05-14T09:41:40.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.205+0000 7fc526800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fc52006c6f0 0x7fc5200b6810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:44960/0 (socket says 172.21.15.135:44960) 2024-05-14T09:41:40.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.205+0000 7fc526800640 1 -- 172.21.15.135:0/800450381 learned_addr learned my addr 172.21.15.135:0/800450381 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:40.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.248+0000 7f93e2a00640 1 -- 172.21.15.135:0/557588639 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4019070 con 0x7f93ec15d090 2024-05-14T09:41:40.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.248+0000 7f93e2a00640 1 -- 172.21.15.135:0/557588639 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e400cbc0 con 0x7f93ec15d090 2024-05-14T09:41:40.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.248+0000 7f93e2a00640 1 -- 172.21.15.135:0/557588639 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e4014440 con 0x7f93ec15d090 2024-05-14T09:41:40.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.248+0000 7f93f1400640 1 -- 172.21.15.135:0/557588639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ec1f2860 con 0x7f93ec15d090 2024-05-14T09:41:40.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.248+0000 7f93f1400640 1 -- 172.21.15.135:0/557588639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ec1f2e20 con 0x7f93ec15d090 2024-05-14T09:41:40.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.250+0000 7f93f1400640 1 -- 172.21.15.135:0/557588639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93ec069a60 con 0x7f93ec15d090 2024-05-14T09:41:40.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.258+0000 7fc525400640 1 --2- 172.21.15.135:0/800450381 >> v2:172.21.15.135:3300/0 conn(0x7fc5200b54e0 0x7fc5200cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.352+0000 7fc525400640 1 -- 172.21.15.135:0/800450381 >> v1:172.21.15.196:6789/0 conn(0x7fc52006c6f0 legacy=0x7fc5200b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.352+0000 7fc525400640 1 -- 172.21.15.135:0/800450381 >> v1:172.21.15.135:6789/0 conn(0x7fc52015a2f0 legacy=0x7fc5200b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:40.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.352+0000 7fc525400640 1 -- 172.21.15.135:0/800450381 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52015d560 con 0x7fc5200b54e0 2024-05-14T09:41:40.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.399+0000 7f4bedc00640 1 Processor -- start 2024-05-14T09:41:40.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.399+0000 7f4bedc00640 1 -- start start 2024-05-14T09:41:40.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.401+0000 7f4bedc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be806f710 0x7f4be80c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.401+0000 7f4bedc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4be80c42e0 0x7f4be81596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.402+0000 7f4bedc00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be80c46f0 con 0x7f4be8153340 2024-05-14T09:41:40.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.402+0000 7f4bedc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f4be80caac0 con 0x7f4be80c42e0 2024-05-14T09:41:40.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.402+0000 7f4bedc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4be80cad60 con 0x7f4be806f710 2024-05-14T09:41:40.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.403+0000 7f4be6000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be806f710 0x7f4be80c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.404+0000 7f4be6000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be806f710 0x7f4be80c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38766/0 (socket says 172.21.15.135:38766) 2024-05-14T09:41:40.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.404+0000 7f4be6000640 1 -- 172.21.15.135:0/224380810 learned_addr learned my addr 172.21.15.135:0/224380810 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:40.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.412+0000 7f4be6000640 1 -- 172.21.15.135:0/224380810 >> v2:172.21.15.196:3300/0 conn(0x7f4be80c42e0 msgr2=0x7f4be81596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:40.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.412+0000 7f4be6000640 1 --2- 172.21.15.135:0/224380810 >> v2:172.21.15.196:3300/0 conn(0x7f4be80c42e0 0x7f4be81596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.412+0000 7f4be6000640 1 -- 172.21.15.135:0/224380810 >> v1:172.21.15.135:6789/0 conn(0x7f4be8153340 legacy=0x7f4be80c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:40.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.412+0000 7f4be6000640 1 -- 172.21.15.135:0/224380810 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be8070020 con 0x7f4be806f710 2024-05-14T09:41:40.414 INFO:tasks.ceph.mds.f.smithi196.stderr:2024-05-14T09:41:40.394+0000 13865640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-14T09:41:40.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.418+0000 7f4be6000640 1 --2- 172.21.15.135:0/224380810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be806f710 0x7f4be80c3da0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009870 tx=0x7f4bd402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b54205fd2e3cf9e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:40.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.423+0000 7f4be5600640 1 -- 172.21.15.135:0/224380810 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4037070 con 0x7f4be806f710 2024-05-14T09:41:40.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.430+0000 7f4be5600640 1 -- 172.21.15.135:0/224380810 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd4032440 con 0x7f4be806f710 2024-05-14T09:41:40.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.430+0000 7f4be5600640 1 -- 172.21.15.135:0/224380810 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4032810 con 0x7f4be806f710 2024-05-14T09:41:40.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.432+0000 7f4bedc00640 1 -- 172.21.15.135:0/224380810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be806f710 msgr2=0x7f4be80c3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.432+0000 7f4bedc00640 1 --2- 172.21.15.135:0/224380810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be806f710 0x7f4be80c3da0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009870 tx=0x7f4bd402a250 comp rx=0 tx=0).stop 2024-05-14T09:41:40.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.432+0000 7f4bedc00640 1 -- 172.21.15.135:0/224380810 shutdown_connections 2024-05-14T09:41:40.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.432+0000 7f4bedc00640 1 --2- 172.21.15.135:0/224380810 >> v2:172.21.15.196:3300/0 conn(0x7f4be80c42e0 0x7f4be81596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.432+0000 7f4bedc00640 1 --2- 172.21.15.135:0/224380810 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be806f710 0x7f4be80c3da0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.432+0000 7f4bedc00640 1 -- 172.21.15.135:0/224380810 >> 172.21.15.135:0/224380810 conn(0x7f4be80ce590 msgr2=0x7f4be80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:40.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.432+0000 7f4bedc00640 1 -- 172.21.15.135:0/224380810 shutdown_connections 2024-05-14T09:41:40.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.432+0000 7f4bedc00640 1 -- 172.21.15.135:0/224380810 wait complete. 2024-05-14T09:41:40.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.435+0000 7f4bedc00640 1 Processor -- start 2024-05-14T09:41:40.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.435+0000 7f4bedc00640 1 -- start start 2024-05-14T09:41:40.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.436+0000 7f4bedc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4be806f710 0x7f4be814e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.436+0000 7f4bedc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be80c42e0 0x7f4be815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.436+0000 7f4bedc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be8153340 0x7f4be80cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.436+0000 7f4bedc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4be80708c0 con 0x7f4be8153340 2024-05-14T09:41:40.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.436+0000 7f4bedc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4be80705e0 con 0x7f4be806f710 2024-05-14T09:41:40.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.436+0000 7f4bedc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4be8159110 con 0x7f4be80c42e0 2024-05-14T09:41:40.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.438+0000 7f4be6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4be806f710 0x7f4be814e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.439+0000 7f4be6a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4be806f710 0x7f4be814e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:58982/0 (socket says 172.21.15.135:58982) 2024-05-14T09:41:40.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.439+0000 7f4be6a00640 1 -- 172.21.15.135:0/3556142790 learned_addr learned my addr 172.21.15.135:0/3556142790 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:40.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.440+0000 7f4be6000640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be80c42e0 0x7f4be815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.450+0000 7f4be6000640 1 -- 172.21.15.135:0/3556142790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4be806f710 msgr2=0x7f4be814e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.450+0000 7f4be6000640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4be806f710 0x7f4be814e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.450+0000 7f4be6000640 1 -- 172.21.15.135:0/3556142790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be8153340 msgr2=0x7f4be80cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.450+0000 7f4be6000640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be8153340 0x7f4be80cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.450+0000 7f4be6000640 1 -- 172.21.15.135:0/3556142790 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be80c65a0 con 0x7f4be80c42e0 2024-05-14T09:41:40.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.455+0000 7f4be6000640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be80c42e0 0x7f4be815baa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4031000 tx=0x7f4bd40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:40.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.463+0000 7f4bdea00640 1 -- 172.21.15.135:0/3556142790 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4041070 con 0x7f4be80c42e0 2024-05-14T09:41:40.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.463+0000 7f4bdea00640 1 -- 172.21.15.135:0/3556142790 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd403c930 con 0x7f4be80c42e0 2024-05-14T09:41:40.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.463+0000 7f4bdea00640 1 -- 172.21.15.135:0/3556142790 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4037040 con 0x7f4be80c42e0 2024-05-14T09:41:40.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.463+0000 7f4bedc00640 1 -- 172.21.15.135:0/3556142790 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be80c5ed0 con 0x7f4be80c42e0 2024-05-14T09:41:40.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.463+0000 7f4bedc00640 1 -- 172.21.15.135:0/3556142790 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be814dea0 con 0x7f4be80c42e0 2024-05-14T09:41:40.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.465+0000 7f4bedc00640 1 -- 172.21.15.135:0/3556142790 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be806f1d0 con 0x7f4be80c42e0 2024-05-14T09:41:40.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.531+0000 7f4bdea00640 1 -- 172.21.15.135:0/3556142790 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4bd4044070 con 0x7f4be80c42e0 2024-05-14T09:41:40.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.534+0000 7f4bdea00640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4bc8076350 0x7f4bc8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.534+0000 7f4be6a00640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4bc8076350 0x7f4bc8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.536+0000 7f4bdea00640 1 -- 172.21.15.135:0/3556142790 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f4bd4032440 con 0x7f4be80c42e0 2024-05-14T09:41:40.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.536+0000 7f4be6a00640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4bc8076350 0x7f4bc8078860 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80099a0 tx=0x7f4bd80090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:40.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.722+0000 7fc525400640 1 --2- 172.21.15.135:0/800450381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5200b54e0 0x7fc5200cd840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc5100097a0 tx=0x7fc51002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae59cf225b18df8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:40.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.747+0000 7f93e2a00640 1 -- 172.21.15.135:0/557588639 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f93e401c070 con 0x7f93ec15d090 2024-05-14T09:41:40.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.749+0000 7f93e2a00640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f93c8076320 0x7f93c8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.750+0000 7f93ea800640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f93c8076320 0x7f93c8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.752+0000 7f93ea800640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f93c8076320 0x7f93c8078830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f93dc034000 tx=0x7f93dc02c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:40.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-14T09:41:40.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.778+0000 7f93e2a00640 1 -- 172.21.15.135:0/557588639 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f93e405ccc0 con 0x7f93ec15d090 2024-05-14T09:41:40.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.778+0000 7f93e2a00640 1 -- 172.21.15.135:0/557588639 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f93e4023020 con 0x7f93ec15d090 2024-05-14T09:41:40.811 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-14T09:41:40.819 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-14T09:41:40.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.826+0000 7fc524a00640 1 -- 172.21.15.135:0/800450381 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc510037070 con 0x7fc5200b54e0 2024-05-14T09:41:40.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.826+0000 7fc524a00640 1 -- 172.21.15.135:0/800450381 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc51002ae50 con 0x7fc5200b54e0 2024-05-14T09:41:40.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.826+0000 7fc524a00640 1 -- 172.21.15.135:0/800450381 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc510032660 con 0x7fc5200b54e0 2024-05-14T09:41:40.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.828+0000 7fc528800640 1 -- 172.21.15.135:0/800450381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5200b54e0 msgr2=0x7fc5200cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.828+0000 7fc528800640 1 --2- 172.21.15.135:0/800450381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5200b54e0 0x7fc5200cd840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc5100097a0 tx=0x7fc51002a100 comp rx=0 tx=0).stop 2024-05-14T09:41:40.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.828+0000 7fc528800640 1 -- 172.21.15.135:0/800450381 shutdown_connections 2024-05-14T09:41:40.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.828+0000 7fc528800640 1 --2- 172.21.15.135:0/800450381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5200b54e0 0x7fc5200cd840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.828+0000 7fc528800640 1 -- 172.21.15.135:0/800450381 >> 172.21.15.135:0/800450381 conn(0x7fc5200cec00 msgr2=0x7fc52008cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:40.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.828+0000 7fc528800640 1 -- 172.21.15.135:0/800450381 shutdown_connections 2024-05-14T09:41:40.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.828+0000 7fc528800640 1 -- 172.21.15.135:0/800450381 wait complete. 2024-05-14T09:41:40.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.831+0000 7fc528800640 1 Processor -- start 2024-05-14T09:41:40.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.832+0000 7fc528800640 1 -- start start 2024-05-14T09:41:40.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.834+0000 7fc528800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc52006c6f0 0x7fc520154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.834+0000 7fc528800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5200b54e0 0x7fc520158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.835+0000 7fc528800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc52015a2f0 0x7fc520155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.835+0000 7fc528800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc5200b4590 con 0x7fc5200b54e0 2024-05-14T09:41:40.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.835+0000 7fc528800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc5200b52e0 con 0x7fc52015a2f0 2024-05-14T09:41:40.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.835+0000 7fc528800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc5200ce040 con 0x7fc52006c6f0 2024-05-14T09:41:40.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.836+0000 7fc525400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5200b54e0 0x7fc520158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.836+0000 7fc525400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5200b54e0 0x7fc520158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56152/0 (socket says 172.21.15.135:56152) 2024-05-14T09:41:40.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.836+0000 7fc525400640 1 -- 172.21.15.135:0/983907418 learned_addr learned my addr 172.21.15.135:0/983907418 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:40.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.837+0000 7fc526800640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc52015a2f0 0x7fc520155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.847+0000 7fc525400640 1 -- 172.21.15.135:0/983907418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc52006c6f0 msgr2=0x7fc520154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.847+0000 7fc525400640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc52006c6f0 0x7fc520154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.847+0000 7fc525400640 1 -- 172.21.15.135:0/983907418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc52015a2f0 msgr2=0x7fc520155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:40.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.847+0000 7fc525400640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc52015a2f0 0x7fc520155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:40.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.847+0000 7fc525400640 1 -- 172.21.15.135:0/983907418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc520154560 con 0x7fc5200b54e0 2024-05-14T09:41:40.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.852+0000 7fc525400640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5200b54e0 0x7fc520158740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc5100098c0 tx=0x7fc5100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:40.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.858+0000 7fc51a000640 1 -- 172.21.15.135:0/983907418 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc510042070 con 0x7fc5200b54e0 2024-05-14T09:41:40.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.859+0000 7fc51a000640 1 -- 172.21.15.135:0/983907418 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc51003d850 con 0x7fc5200b54e0 2024-05-14T09:41:40.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.859+0000 7fc51a000640 1 -- 172.21.15.135:0/983907418 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc510037040 con 0x7fc5200b54e0 2024-05-14T09:41:40.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.859+0000 7fc528800640 1 -- 172.21.15.135:0/983907418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5200c96c0 con 0x7fc5200b54e0 2024-05-14T09:41:40.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.859+0000 7fc528800640 1 -- 172.21.15.135:0/983907418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5200c9c80 con 0x7fc5200b54e0 2024-05-14T09:41:40.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.861+0000 7fc528800640 1 -- 172.21.15.135:0/983907418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc520069a60 con 0x7fc5200b54e0 2024-05-14T09:41:40.875 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-14T09:41:40.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.878+0000 7f4bdea00640 1 -- 172.21.15.135:0/3556142790 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4be80c46f0 con 0x7f4be80c42e0 2024-05-14T09:41:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.907+0000 7fc51a000640 1 -- 172.21.15.135:0/983907418 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc510045070 con 0x7fc5200b54e0 2024-05-14T09:41:40.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.910+0000 7fc51a000640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc504076320 0x7fc504078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:40.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.912+0000 7fc525e00640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc504076320 0x7fc504078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:40.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.914+0000 7fc525e00640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc504076320 0x7fc504078830 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc514006fd0 tx=0x7fc514006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:40.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:40.914+0000 7fc51a000640 1 -- 172.21.15.135:0/983907418 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fc51007d8e0 con 0x7fc5200b54e0 2024-05-14T09:41:41.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.061+0000 7f93f1400640 1 -- 172.21.15.135:0/557588639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f93ec149cc0 con 0x7f93ec15d090 2024-05-14T09:41:41.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.097+0000 7f9d5ce00640 1 Processor -- start 2024-05-14T09:41:41.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.097+0000 7f9d5ce00640 1 -- start start 2024-05-14T09:41:41.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.099+0000 7f9d5ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 0x7f9d5815f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.099+0000 7f9d5ce00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d580c88c0 con 0x7f9d58156780 2024-05-14T09:41:41.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.099+0000 7f9d5ce00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5815c480 con 0x7f9d580c8310 2024-05-14T09:41:41.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.099+0000 7f9d5ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5815c760 con 0x7f9d58074860 2024-05-14T09:41:41.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.100+0000 7f9d55e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 0x7f9d5815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.101+0000 7f9d55400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9d580c8310 0x7f9d580c6e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:44962/0 (socket says 172.21.15.135:44962) 2024-05-14T09:41:41.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.101+0000 7f9d55400640 1 -- 172.21.15.135:0/3353990894 learned_addr learned my addr 172.21.15.135:0/3353990894 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:41.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.105+0000 7f9d55e00640 1 -- 172.21.15.135:0/3353990894 >> v1:172.21.15.196:6789/0 conn(0x7f9d580c8310 legacy=0x7f9d580c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.105+0000 7f9d55e00640 1 -- 172.21.15.135:0/3353990894 >> v1:172.21.15.135:6789/0 conn(0x7f9d58156780 legacy=0x7f9d58166cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.105+0000 7f9d55e00640 1 -- 172.21.15.135:0/3353990894 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5815ca40 con 0x7f9d58074860 2024-05-14T09:41:41.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.110+0000 7f9d55e00640 1 --2- 172.21.15.135:0/3353990894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 0x7f9d5815f960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9d480097d0 tx=0x7f9d4802a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39944313832f1c7f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:41.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.118+0000 7f9d54a00640 1 -- 172.21.15.135:0/3353990894 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48037070 con 0x7f9d58074860 2024-05-14T09:41:41.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.118+0000 7f9d54a00640 1 -- 172.21.15.135:0/3353990894 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d48032440 con 0x7f9d58074860 2024-05-14T09:41:41.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.118+0000 7f9d54a00640 1 -- 172.21.15.135:0/3353990894 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48032810 con 0x7f9d58074860 2024-05-14T09:41:41.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.119+0000 7f9d5ce00640 1 -- 172.21.15.135:0/3353990894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 msgr2=0x7f9d5815f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.119+0000 7f9d5ce00640 1 --2- 172.21.15.135:0/3353990894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 0x7f9d5815f960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9d480097d0 tx=0x7f9d4802a160 comp rx=0 tx=0).stop 2024-05-14T09:41:41.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.119+0000 7f9d5ce00640 1 -- 172.21.15.135:0/3353990894 shutdown_connections 2024-05-14T09:41:41.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.119+0000 7f9d5ce00640 1 --2- 172.21.15.135:0/3353990894 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 0x7f9d5815f960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.119+0000 7f9d5ce00640 1 -- 172.21.15.135:0/3353990894 >> 172.21.15.135:0/3353990894 conn(0x7f9d58073d40 msgr2=0x7f9d58074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:41.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.119+0000 7f9d5ce00640 1 -- 172.21.15.135:0/3353990894 shutdown_connections 2024-05-14T09:41:41.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.119+0000 7f9d5ce00640 1 -- 172.21.15.135:0/3353990894 wait complete. 2024-05-14T09:41:41.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.123+0000 7f9d5ce00640 1 Processor -- start 2024-05-14T09:41:41.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.124+0000 7f9d5ce00640 1 -- start start 2024-05-14T09:41:41.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.126+0000 7f9d5ce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 0x7f9d581543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.126+0000 7f9d5ce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d580c8310 0x7f9d58151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.126+0000 7f9d5ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d58156780 0x7f9d58146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.126+0000 7f9d5ce00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5815fea0 con 0x7f9d58156780 2024-05-14T09:41:41.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.126+0000 7f9d5ce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9d580c9150 con 0x7f9d580c8310 2024-05-14T09:41:41.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.126+0000 7f9d5ce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f9d58160020 con 0x7f9d58074860 2024-05-14T09:41:41.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.127+0000 7f9d55e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 0x7f9d581543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.128+0000 7f9d55e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 0x7f9d581543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38808/0 (socket says 172.21.15.135:38808) 2024-05-14T09:41:41.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.128+0000 7f9d55e00640 1 -- 172.21.15.135:0/1644967552 learned_addr learned my addr 172.21.15.135:0/1644967552 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:41.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.128+0000 7f9d55400640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d580c8310 0x7f9d58151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.135+0000 7f9d55e00640 1 -- 172.21.15.135:0/1644967552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d580c8310 msgr2=0x7f9d58151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.135+0000 7f9d55e00640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d580c8310 0x7f9d58151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.135+0000 7f9d55e00640 1 -- 172.21.15.135:0/1644967552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d58156780 msgr2=0x7f9d58146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.135+0000 7f9d55e00640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d58156780 0x7f9d58146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.135+0000 7f9d55e00640 1 -- 172.21.15.135:0/1644967552 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d58154910 con 0x7f9d58074860 2024-05-14T09:41:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.140+0000 7f9d55e00640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 0x7f9d581543d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9d480098f0 tx=0x7f9d480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:41.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.148+0000 7f9d4e000640 1 -- 172.21.15.135:0/1644967552 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48040020 con 0x7f9d58074860 2024-05-14T09:41:41.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.148+0000 7f9d4e000640 1 -- 172.21.15.135:0/1644967552 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d48038040 con 0x7f9d58074860 2024-05-14T09:41:41.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.148+0000 7f9d4e000640 1 -- 172.21.15.135:0/1644967552 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48037070 con 0x7f9d58074860 2024-05-14T09:41:41.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.148+0000 7f9d5ce00640 1 -- 172.21.15.135:0/1644967552 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d581f2f30 con 0x7f9d58074860 2024-05-14T09:41:41.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.149+0000 7f9d5ce00640 1 -- 172.21.15.135:0/1644967552 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d581f34f0 con 0x7f9d58074860 2024-05-14T09:41:41.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.150+0000 7f9d5ce00640 1 -- 172.21.15.135:0/1644967552 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d58069a60 con 0x7f9d58074860 2024-05-14T09:41:41.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.171+0000 7f35d7c00640 1 Processor -- start 2024-05-14T09:41:41.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.172+0000 7f35d7c00640 1 -- start start 2024-05-14T09:41:41.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.175+0000 7f35d7c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35d00cae00 0x7f35d00ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.175+0000 7f35d7c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f35d015e3d0 0x7f35d00ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.175+0000 7f35d7c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35d00c5ad0 con 0x7f35d00cb210 2024-05-14T09:41:41.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.175+0000 7f35d7c00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f35d015a4e0 con 0x7f35d015e3d0 2024-05-14T09:41:41.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.175+0000 7f35d7c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f35d015a7c0 con 0x7f35d00cae00 2024-05-14T09:41:41.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.176+0000 7f35cfe00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f35d00cb210 0x7f35d015dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:44970/0 (socket says 172.21.15.135:44970) 2024-05-14T09:41:41.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.176+0000 7f35cfe00640 1 -- 172.21.15.135:0/222814159 learned_addr learned my addr 172.21.15.135:0/222814159 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:41.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.186+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986668017 0 0) 0x7f35d00c5ad0 con 0x7f35d00cb210 2024-05-14T09:41:41.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.186+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35b8003520 con 0x7f35d00cb210 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.198+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 190942935 0 0) 0x7f35b8003520 con 0x7f35d00cb210 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.198+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35d00cae00 msgr2=0x7f35d00ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.198+0000 7f35cf400640 1 --2- 172.21.15.135:0/222814159 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35d00cae00 0x7f35d00ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.198+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 >> v2:172.21.15.135:3300/0 conn(0x7f35d015e3d0 msgr2=0x7f35d00ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.198+0000 7f35cf400640 1 --2- 172.21.15.135:0/222814159 >> v2:172.21.15.135:3300/0 conn(0x7f35d015e3d0 0x7f35d00ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.198+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d015aaa0 con 0x7f35d00cb210 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.198+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f35bc0016f0 con 0x7f35d00cb210 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.198+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 >> v1:172.21.15.196:6789/0 conn(0x7f35d00cb210 legacy=0x7f35d015dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.198+0000 7f35cf400640 1 --2- 172.21.15.135:0/222814159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b8003a50 0x7f35b8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.199+0000 7f35cf400640 1 --2- 172.21.15.135:0/222814159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35b8004800 0x7f35b8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.199+0000 7f35cf400640 1 --2- 172.21.15.135:0/222814159 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35d00cae00 0x7f35b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.199+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35d015a4e0 con 0x7f35b8003a50 2024-05-14T09:41:41.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.199+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f35d015a7c0 con 0x7f35b8004800 2024-05-14T09:41:41.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.199+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f35b800bf00 con 0x7f35d00cae00 2024-05-14T09:41:41.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.208+0000 7f35cfe00640 1 --2- 172.21.15.135:0/222814159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35b8004800 0x7f35b8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.217+0000 7f35cfe00640 1 -- 172.21.15.135:0/222814159 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35d00cae00 msgr2=0x7f35b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.217+0000 7f35cfe00640 1 --2- 172.21.15.135:0/222814159 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35d00cae00 0x7f35b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.217+0000 7f35cfe00640 1 -- 172.21.15.135:0/222814159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b8003a50 msgr2=0x7f35b8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.217+0000 7f35cfe00640 1 --2- 172.21.15.135:0/222814159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b8003a50 0x7f35b8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.217+0000 7f35cfe00640 1 -- 172.21.15.135:0/222814159 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b8003520 con 0x7f35b8004800 2024-05-14T09:41:41.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.220+0000 7f84e4000640 1 Processor -- start 2024-05-14T09:41:41.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.220+0000 7f84e4000640 1 -- start start 2024-05-14T09:41:41.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.222+0000 7f35cfe00640 1 --2- 172.21.15.135:0/222814159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35b8004800 0x7f35b8004c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c160 tx=0x7f35b8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b02a8e943345b4ac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:41.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.222+0000 7f84e4000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f84dc071f70 0x7f84dc0c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.222+0000 7f84e4000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84dc074ce0 con 0x7f84dc15ab20 2024-05-14T09:41:41.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.222+0000 7f84e4000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84dc074a00 con 0x7f84dc0c71b0 2024-05-14T09:41:41.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.222+0000 7f84e4000640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f84dc06cde0 con 0x7f84dc071f70 2024-05-14T09:41:41.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.226+0000 7f9d4e000640 1 -- 172.21.15.135:0/1644967552 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9d48043020 con 0x7f9d58074860 2024-05-14T09:41:41.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.227+0000 7f9d4e000640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9d38076320 0x7f9d38078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.227+0000 7f9d55400640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9d38076320 0x7f9d38078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.228+0000 7f9d55400640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9d38076320 0x7f9d38078830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9d44000f60 tx=0x7f9d44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:41.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.236+0000 7f0f1b200640 1 Processor -- start 2024-05-14T09:41:41.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.236+0000 7f0f1b200640 1 -- start start 2024-05-14T09:41:41.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.237+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc007ca0 con 0x7f35b8004800 2024-05-14T09:41:41.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.237+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc005ad0 con 0x7f35b8004800 2024-05-14T09:41:41.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.237+0000 7f35cf400640 1 -- 172.21.15.135:0/222814159 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc007070 con 0x7f35b8004800 2024-05-14T09:41:41.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.238+0000 7f0f1b200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0f1c0b11c0 0x7f0f1c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.238+0000 7f0f1b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f1c06fa40 0x7f0f1c0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.238+0000 7f0f1b200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c0c3b60 con 0x7f0f1c160600 2024-05-14T09:41:41.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.238+0000 7f0f1b200640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f0f1c0b3c70 con 0x7f0f1c0b11c0 2024-05-14T09:41:41.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.238+0000 7f0f1b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0f1c0b19e0 con 0x7f0f1c06fa40 2024-05-14T09:41:41.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.239+0000 7f84e2000640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f84dc0c71b0 0x7f84dc06d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:44972/0 (socket says 172.21.15.135:44972) 2024-05-14T09:41:41.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.239+0000 7f84e2000640 1 -- 172.21.15.135:0/3216527049 learned_addr learned my addr 172.21.15.135:0/3216527049 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:41.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.239+0000 7f35d7c00640 1 -- 172.21.15.135:0/222814159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35b8004800 msgr2=0x7f35b8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.239+0000 7f35d7c00640 1 --2- 172.21.15.135:0/222814159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35b8004800 0x7f35b8004c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c160 tx=0x7f35b8005830 comp rx=0 tx=0).stop 2024-05-14T09:41:41.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.239+0000 7f35d5c00640 1 -- 172.21.15.135:0/222814159 reap_dead start 2024-05-14T09:41:41.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.239+0000 7f35d7c00640 1 -- 172.21.15.135:0/222814159 shutdown_connections 2024-05-14T09:41:41.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.239+0000 7f35d7c00640 1 -- 172.21.15.135:0/222814159 >> 172.21.15.135:0/222814159 conn(0x7f35d0073700 msgr2=0x7f35d0073b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:41.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.239+0000 7f35d7c00640 1 -- 172.21.15.135:0/222814159 shutdown_connections 2024-05-14T09:41:41.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.239+0000 7f35d7c00640 1 -- 172.21.15.135:0/222814159 wait complete. 2024-05-14T09:41:41.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.243+0000 7f35d7c00640 1 Processor -- start 2024-05-14T09:41:41.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.243+0000 7f35d7c00640 1 -- start start 2024-05-14T09:41:41.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.244+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650013275 0 0) 0x7f84dc074a00 con 0x7f84dc0c71b0 2024-05-14T09:41:41.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.244+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84c4003520 con 0x7f84dc0c71b0 2024-05-14T09:41:41.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.245+0000 7f0f19400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0f1c160600 0x7f0f1c0b3560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:44980/0 (socket says 172.21.15.135:44980) 2024-05-14T09:41:41.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.245+0000 7f0f19400640 1 -- 172.21.15.135:0/2288275744 learned_addr learned my addr 172.21.15.135:0/2288275744 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:41.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.246+0000 7f35d7c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35d00cede0 0x7f35d01f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.246+0000 7f35d7c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35d014f040 0x7f35d00cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.246+0000 7f35d7c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35d014f450 0x7f35d00cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.246+0000 7f35d7c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35d015d7a0 con 0x7f35d00cede0 2024-05-14T09:41:41.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.246+0000 7f35d7c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f35d015b060 con 0x7f35d014f040 2024-05-14T09:41:41.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.246+0000 7f35d7c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f35d015a1b0 con 0x7f35d014f450 2024-05-14T09:41:41.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.254+0000 7f4bedc00640 1 -- 172.21.15.135:0/3556142790 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4be8076290 con 0x7f4be80c42e0 2024-05-14T09:41:41.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1542146367 0 0) 0x7f84c4003520 con 0x7f84dc0c71b0 2024-05-14T09:41:41.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 >> v2:172.21.15.135:3300/0 conn(0x7f84dc071f70 msgr2=0x7f84dc0c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 --2- 172.21.15.135:0/3216527049 >> v2:172.21.15.135:3300/0 conn(0x7f84dc071f70 0x7f84dc0c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 >> v1:172.21.15.135:6789/0 conn(0x7f84dc15ab20 legacy=0x7f84dc153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84dc06c790 con 0x7f84dc0c71b0 2024-05-14T09:41:41.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f84d4001a70 con 0x7f84dc0c71b0 2024-05-14T09:41:41.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 >> v1:172.21.15.196:6789/0 conn(0x7f84dc0c71b0 legacy=0x7f84dc06d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 --2- 172.21.15.135:0/3216527049 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84c4003a50 0x7f84c4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 --2- 172.21.15.135:0/3216527049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c4004800 0x7f84c4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 --2- 172.21.15.135:0/3216527049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84c40053f0 0x7f84c400bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc06cde0 con 0x7f84c4004800 2024-05-14T09:41:41.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f84c400c390 con 0x7f84c4003a50 2024-05-14T09:41:41.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.262+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f84c400c590 con 0x7f84c40053f0 2024-05-14T09:41:41.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.264+0000 7f35cfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35d014f040 0x7f35d00cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.264+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238435065 0 0) 0x7f0f08001110 con 0x7f0f1c160600 2024-05-14T09:41:41.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.264+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f00003520 con 0x7f0f1c160600 2024-05-14T09:41:41.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.265+0000 7f35cfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35d014f040 0x7f35d00cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:59000/0 (socket says 172.21.15.135:59000) 2024-05-14T09:41:41.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.265+0000 7f35cfe00640 1 -- 172.21.15.135:0/3533050926 learned_addr learned my addr 172.21.15.135:0/3533050926 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:41.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1519375188 0 0) 0x7f0f00003520 con 0x7f0f1c160600 2024-05-14T09:41:41.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f1c06fa40 msgr2=0x7f0f1c0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 --2- 172.21.15.135:0/2288275744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f1c06fa40 0x7f0f1c0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 >> v2:172.21.15.135:3300/0 conn(0x7f0f1c0b11c0 msgr2=0x7f0f1c15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 --2- 172.21.15.135:0/2288275744 >> v2:172.21.15.135:3300/0 conn(0x7f0f1c0b11c0 0x7f0f1c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c0b1cc0 con 0x7f0f1c160600 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f0f080018c0 con 0x7f0f1c160600 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 >> v1:172.21.15.196:6789/0 conn(0x7f0f1c160600 legacy=0x7f0f1c0b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 --2- 172.21.15.135:0/2288275744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f1c06fa40 0x7f0f00003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 --2- 172.21.15.135:0/2288275744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f000041d0 0x7f0f00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 --2- 172.21.15.135:0/2288275744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 0x7f0f0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c0b3c70 con 0x7f0f00004ef0 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c0b19e0 con 0x7f0f000041d0 2024-05-14T09:41:41.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.274+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0f0000bf00 con 0x7f0f1c06fa40 2024-05-14T09:41:41.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.286+0000 7f93e2a00640 1 -- 172.21.15.135:0/557588639 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f93e4060a30 con 0x7f93ec15d090 2024-05-14T09:41:41.287 INFO:teuthology.orchestra.run.smithi135.stdout:60129542164 2024-05-14T09:41:41.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.287+0000 7f35cfe00640 1 -- 172.21.15.135:0/3533050926 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35d014f450 msgr2=0x7f35d00cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.287+0000 7f35cfe00640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35d014f450 0x7f35d00cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.287+0000 7f35cfe00640 1 -- 172.21.15.135:0/3533050926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35d00cede0 msgr2=0x7f35d01f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.287+0000 7f35cfe00640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35d00cede0 0x7f35d01f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.288+0000 7f35cfe00640 1 -- 172.21.15.135:0/3533050926 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d0070ba0 con 0x7f35d014f040 2024-05-14T09:41:41.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 -- 172.21.15.135:0/557588639 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f93c8076320 msgr2=0x7f93c8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f93c8076320 0x7f93c8078830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f93dc034000 tx=0x7f93dc02c000 comp rx=0 tx=0).stop 2024-05-14T09:41:41.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 -- 172.21.15.135:0/557588639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93ec15d090 msgr2=0x7f93ec1f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93ec15d090 0x7f93ec1f5ae0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f93e400b9a0 tx=0x7f93e400be60 comp rx=0 tx=0).stop 2024-05-14T09:41:41.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 -- 172.21.15.135:0/557588639 shutdown_connections 2024-05-14T09:41:41.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f93c8076320 0x7f93c8078830 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93ec15d090 0x7f93ec1f5ae0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93ec156800 0x7f93ec15b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 --2- 172.21.15.135:0/557588639 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93ec06e370 0x7f93ec1464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 -- 172.21.15.135:0/557588639 >> 172.21.15.135:0/557588639 conn(0x7f93ec0cac60 msgr2=0x7f93ec0cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:41.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 -- 172.21.15.135:0/557588639 shutdown_connections 2024-05-14T09:41:41.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.290+0000 7f93f1400640 1 -- 172.21.15.135:0/557588639 wait complete. 2024-05-14T09:41:41.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.302+0000 7f35cfe00640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35d014f040 0x7f35d00cd4c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c280 tx=0x7f35d00b2a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:41.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.312+0000 7f0f19400640 1 --2- 172.21.15.135:0/2288275744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f000041d0 0x7f0f00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.312+0000 7f84e1600640 1 --2- 172.21.15.135:0/3216527049 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84c4003a50 0x7f84c4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542163 got 60129542164 for osd.1 2024-05-14T09:41:41.313 DEBUG:teuthology.parallel:result is None 2024-05-14T09:41:41.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.322+0000 7f35ccc00640 1 -- 172.21.15.135:0/3533050926 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc041020 con 0x7f35d014f040 2024-05-14T09:41:41.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.322+0000 7f35ccc00640 1 -- 172.21.15.135:0/3533050926 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc038040 con 0x7f35d014f040 2024-05-14T09:41:41.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.322+0000 7f35ccc00640 1 -- 172.21.15.135:0/3533050926 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc007290 con 0x7f35d014f040 2024-05-14T09:41:41.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.322+0000 7f35d7c00640 1 -- 172.21.15.135:0/3533050926 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d0070e80 con 0x7f35d014f040 2024-05-14T09:41:41.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.322+0000 7f35d7c00640 1 -- 172.21.15.135:0/3533050926 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d01e49e0 con 0x7f35d014f040 2024-05-14T09:41:41.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.323+0000 7f35d7c00640 1 -- 172.21.15.135:0/3533050926 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d0069a60 con 0x7f35d014f040 2024-05-14T09:41:41.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.324+0000 7fc51a000640 1 -- 172.21.15.135:0/983907418 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc510081650 con 0x7fc5200b54e0 2024-05-14T09:41:41.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.328+0000 7f84e1600640 1 -- 172.21.15.135:0/3216527049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84c40053f0 msgr2=0x7f84c400bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.328+0000 7f84e1600640 1 --2- 172.21.15.135:0/3216527049 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84c40053f0 0x7f84c400bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.328+0000 7f84e1600640 1 -- 172.21.15.135:0/3216527049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c4004800 msgr2=0x7f84c4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.328+0000 7f84e1600640 1 --2- 172.21.15.135:0/3216527049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c4004800 0x7f84c4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.328+0000 7f84e1600640 1 -- 172.21.15.135:0/3216527049 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c4003520 con 0x7f84c4003a50 2024-05-14T09:41:41.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.328+0000 7f84e2000640 1 -- 172.21.15.135:0/3216527049 reap_dead start 2024-05-14T09:41:41.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.358+0000 7f0f1a800640 1 --2- 172.21.15.135:0/2288275744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 0x7f0f0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.367+0000 7f0f1a800640 1 -- 172.21.15.135:0/2288275744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f1c06fa40 msgr2=0x7f0f00003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.367+0000 7f0f1a800640 1 --2- 172.21.15.135:0/2288275744 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f1c06fa40 0x7f0f00003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.367+0000 7f0f1a800640 1 -- 172.21.15.135:0/2288275744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f000041d0 msgr2=0x7f0f00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:41.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.367+0000 7f0f1a800640 1 --2- 172.21.15.135:0/2288275744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f000041d0 0x7f0f00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.367+0000 7f0f1a800640 1 -- 172.21.15.135:0/2288275744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f00003520 con 0x7f0f00004ef0 2024-05-14T09:41:41.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.373+0000 7f0f1a800640 1 --2- 172.21.15.135:0/2288275744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 0x7f0f0000b9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c0716f0 tx=0x7f0f00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e581b3a5b693c60 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:41.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.380+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14034020 con 0x7f0f00004ef0 2024-05-14T09:41:41.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.380+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1402c040 con 0x7f0f00004ef0 2024-05-14T09:41:41.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.380+0000 7f0f18a00640 1 -- 172.21.15.135:0/2288275744 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14009a10 con 0x7f0f00004ef0 2024-05-14T09:41:41.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.381+0000 7f0f1b200640 1 -- 172.21.15.135:0/2288275744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 msgr2=0x7f0f0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.381+0000 7f0f1b200640 1 --2- 172.21.15.135:0/2288275744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 0x7f0f0000b9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c0716f0 tx=0x7f0f00005830 comp rx=0 tx=0).stop 2024-05-14T09:41:41.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.381+0000 7f0f1a800640 1 -- 172.21.15.135:0/2288275744 reap_dead start 2024-05-14T09:41:41.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.382+0000 7f0f1b200640 1 -- 172.21.15.135:0/2288275744 shutdown_connections 2024-05-14T09:41:41.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.382+0000 7f0f1b200640 1 -- 172.21.15.135:0/2288275744 >> 172.21.15.135:0/2288275744 conn(0x7f0f1c0ce870 msgr2=0x7f0f1c0cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:41.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.382+0000 7f0f1b200640 1 -- 172.21.15.135:0/2288275744 shutdown_connections 2024-05-14T09:41:41.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.382+0000 7f0f1b200640 1 -- 172.21.15.135:0/2288275744 wait complete. 2024-05-14T09:41:41.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.387+0000 7f0f1b200640 1 Processor -- start 2024-05-14T09:41:41.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.388+0000 7f0f1b200640 1 -- start start 2024-05-14T09:41:41.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.391+0000 7f0f1b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 0x7f0f1c156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.391+0000 7f0f1b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f1c1e6c20 0x7f0f1c1f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.391+0000 7f0f1b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f1c1e59d0 0x7f0f1c155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.391+0000 7f0f1b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c15c9c0 con 0x7f0f00004ef0 2024-05-14T09:41:41.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.391+0000 7f0f1b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c15fe00 con 0x7f0f1c1e6c20 2024-05-14T09:41:41.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.391+0000 7f0f1b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0f1c0b1fa0 con 0x7f0f1c1e59d0 2024-05-14T09:41:41.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.392+0000 7f0f19e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 0x7f0f1c156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.392+0000 7f0f19e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 0x7f0f1c156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56226/0 (socket says 172.21.15.135:56226) 2024-05-14T09:41:41.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.392+0000 7f0f19e00640 1 -- 172.21.15.135:0/1131642532 learned_addr learned my addr 172.21.15.135:0/1131642532 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:41.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.398+0000 7f0f19e00640 1 -- 172.21.15.135:0/1131642532 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f1c1e59d0 msgr2=0x7f0f1c155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.398+0000 7f0f19e00640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f1c1e59d0 0x7f0f1c155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.399+0000 7f0f19e00640 1 -- 172.21.15.135:0/1131642532 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f1c1e6c20 msgr2=0x7f0f1c1f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.399+0000 7f0f19e00640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f1c1e6c20 0x7f0f1c1f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.399+0000 7f0f19e00640 1 -- 172.21.15.135:0/1131642532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c1f5ec0 con 0x7f0f00004ef0 2024-05-14T09:41:41.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.402+0000 7f0f19e00640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 0x7f0f1c156df0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00b450 tx=0x7f0f0c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:41.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.407+0000 7f0f12000640 1 -- 172.21.15.135:0/1131642532 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c015020 con 0x7f0f00004ef0 2024-05-14T09:41:41.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.407+0000 7f0f12000640 1 -- 172.21.15.135:0/1131642532 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0c011830 con 0x7f0f00004ef0 2024-05-14T09:41:41.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.407+0000 7f0f12000640 1 -- 172.21.15.135:0/1131642532 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c011c00 con 0x7f0f00004ef0 2024-05-14T09:41:41.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.407+0000 7f0f1b200640 1 -- 172.21.15.135:0/1131642532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1c159bc0 con 0x7f0f00004ef0 2024-05-14T09:41:41.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.407+0000 7f0f1b200640 1 -- 172.21.15.135:0/1131642532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1c1e81b0 con 0x7f0f00004ef0 2024-05-14T09:41:41.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.408+0000 7f0f1b200640 1 -- 172.21.15.135:0/1131642532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1c069980 con 0x7f0f00004ef0 2024-05-14T09:41:41.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.432+0000 7f0f12000640 1 -- 172.21.15.135:0/1131642532 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f0c018020 con 0x7f0f00004ef0 2024-05-14T09:41:41.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.433+0000 7f0f12000640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0efc076350 0x7f0efc078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.434+0000 7f0f19400640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0efc076350 0x7f0efc078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.434+0000 7f0f19400640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0efc076350 0x7f0efc078860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0f08001330 tx=0x7f0f08001da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:41.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.436+0000 7f0f12000640 1 -- 172.21.15.135:0/1131642532 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f0f0c011da0 con 0x7f0f00004ef0 2024-05-14T09:41:41.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.543+0000 7fc528800640 1 -- 172.21.15.135:0/983907418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc5200cde20 con 0x7fc5200b54e0 2024-05-14T09:41:41.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.551+0000 7f9d4e000640 1 -- 172.21.15.135:0/1644967552 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f9d4807d6a0 con 0x7f9d58074860 2024-05-14T09:41:41.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.578+0000 7f9d4e000640 1 -- 172.21.15.135:0/1644967552 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9d4804a070 con 0x7f9d58074860 2024-05-14T09:41:41.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.589+0000 7f4bdea00640 1 -- 172.21.15.135:0/3556142790 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4bd4081620 con 0x7f4be80c42e0 2024-05-14T09:41:41.589 INFO:teuthology.orchestra.run.smithi135.stdout:68719476756 2024-05-14T09:41:41.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.591+0000 7f4bedc00640 1 -- 172.21.15.135:0/3556142790 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4bc8076350 msgr2=0x7f4bc8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.591+0000 7f4bedc00640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4bc8076350 0x7f4bc8078860 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80099a0 tx=0x7f4bd80090e0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.591+0000 7f4bedc00640 1 -- 172.21.15.135:0/3556142790 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be80c42e0 msgr2=0x7f4be815baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.591+0000 7f4bedc00640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be80c42e0 0x7f4be815baa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4031000 tx=0x7f4bd40046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.592+0000 7f4bedc00640 1 -- 172.21.15.135:0/3556142790 shutdown_connections 2024-05-14T09:41:41.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.592+0000 7f4bedc00640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4bc8076350 0x7f4bc8078860 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.592+0000 7f4bedc00640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4be8153340 0x7f4be80cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.592+0000 7f4bedc00640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4be80c42e0 0x7f4be815baa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.592+0000 7f4bedc00640 1 --2- 172.21.15.135:0/3556142790 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4be806f710 0x7f4be814e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.592+0000 7f4bedc00640 1 -- 172.21.15.135:0/3556142790 >> 172.21.15.135:0/3556142790 conn(0x7f4be80ce590 msgr2=0x7f4be8158870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:41.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.592+0000 7f4bedc00640 1 -- 172.21.15.135:0/3556142790 shutdown_connections 2024-05-14T09:41:41.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.592+0000 7f4bedc00640 1 -- 172.21.15.135:0/3556142790 wait complete. 2024-05-14T09:41:41.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476756 got 68719476756 for osd.6 2024-05-14T09:41:41.615 DEBUG:teuthology.parallel:result is None 2024-05-14T09:41:41.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.659+0000 7f35ccc00640 1 -- 172.21.15.135:0/3533050926 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35bc044020 con 0x7f35d014f040 2024-05-14T09:41:41.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.663+0000 7f35ccc00640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f35b0076350 0x7f35b0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.664+0000 7f35ccc00640 1 -- 172.21.15.135:0/3533050926 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f35bc0b8490 con 0x7f35d014f040 2024-05-14T09:41:41.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.665+0000 7f35d5200640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f35b0076350 0x7f35b0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.668+0000 7f35d5200640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f35b0076350 0x7f35b0078860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35c40096f0 tx=0x7f35c4006c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:41.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.687+0000 7f35ccc00640 1 -- 172.21.15.135:0/3533050926 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f35bc0016b0 con 0x7f35d014f040 2024-05-14T09:41:41.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.710+0000 7f84e1600640 1 --2- 172.21.15.135:0/3216527049 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84c4003a50 0x7f84c4003ec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f84d0001650 tx=0x7f84c4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43b5a191042f32f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:41.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.745+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0001220 con 0x7f84c4003a50 2024-05-14T09:41:41.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.745+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d002e070 con 0x7f84c4003a50 2024-05-14T09:41:41.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.745+0000 7f84dbe00640 1 -- 172.21.15.135:0/3216527049 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d002a7c0 con 0x7f84c4003a50 2024-05-14T09:41:41.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.746+0000 7f84e4000640 1 -- 172.21.15.135:0/3216527049 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84c4003a50 msgr2=0x7f84c4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.746+0000 7f84e4000640 1 --2- 172.21.15.135:0/3216527049 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84c4003a50 0x7f84c4003ec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f84d0001650 tx=0x7f84c4005830 comp rx=0 tx=0).stop 2024-05-14T09:41:41.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.746+0000 7f84e4000640 1 -- 172.21.15.135:0/3216527049 shutdown_connections 2024-05-14T09:41:41.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.746+0000 7f84e4000640 1 --2- 172.21.15.135:0/3216527049 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84c4003a50 0x7f84c4003ec0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.746+0000 7f84e4000640 1 -- 172.21.15.135:0/3216527049 >> 172.21.15.135:0/3216527049 conn(0x7f84dc073d40 msgr2=0x7f84dc074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:41.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.747+0000 7f84e4000640 1 -- 172.21.15.135:0/3216527049 shutdown_connections 2024-05-14T09:41:41.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.747+0000 7f84e4000640 1 -- 172.21.15.135:0/3216527049 wait complete. 2024-05-14T09:41:41.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.748+0000 7f0f12000640 1 -- 172.21.15.135:0/1131642532 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0f0c01f020 con 0x7f0f00004ef0 2024-05-14T09:41:41.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.750+0000 7f84e4000640 1 Processor -- start 2024-05-14T09:41:41.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.750+0000 7f84e4000640 1 -- start start 2024-05-14T09:41:41.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.752+0000 7f84e4000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84c4003a50 0x7f84dc1f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.752+0000 7f84e4000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84dc0c62d0 0x7f84dc14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.752+0000 7f84e4000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84dc0c66e0 0x7f84dc148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:41.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.752+0000 7f84e4000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc0c6c70 con 0x7f84dc0c62d0 2024-05-14T09:41:41.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.752+0000 7f84e4000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc0c4690 con 0x7f84dc0c66e0 2024-05-14T09:41:41.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.752+0000 7f84e4000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f84dc0c6df0 con 0x7f84c4003a50 2024-05-14T09:41:41.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.753+0000 7f84e1600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84c4003a50 0x7f84dc1f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.754+0000 7f84e1600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84c4003a50 0x7f84dc1f5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:38868/0 (socket says 172.21.15.135:38868) 2024-05-14T09:41:41.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.754+0000 7f84e1600640 1 -- 172.21.15.135:0/3548998494 learned_addr learned my addr 172.21.15.135:0/3548998494 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:41.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.761+0000 7f84e2000640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84dc0c66e0 0x7f84dc148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:41.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.761+0000 7f84e1600640 1 -- 172.21.15.135:0/3548998494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84dc0c66e0 msgr2=0x7f84dc148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.761+0000 7f84e1600640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84dc0c66e0 0x7f84dc148ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.761+0000 7f84e1600640 1 -- 172.21.15.135:0/3548998494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84dc0c62d0 msgr2=0x7f84dc14ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.761+0000 7f84e1600640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84dc0c62d0 0x7f84dc14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.761+0000 7f84e1600640 1 -- 172.21.15.135:0/3548998494 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84dc1f64c0 con 0x7f84c4003a50 2024-05-14T09:41:41.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.766+0000 7f84e1600640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84c4003a50 0x7f84dc1f5f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84d0001740 tx=0x7f84d0000fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:41.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.780+0000 7f84d9600640 1 -- 172.21.15.135:0/3548998494 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d002a9c0 con 0x7f84c4003a50 2024-05-14T09:41:41.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.780+0000 7f84d9600640 1 -- 172.21.15.135:0/3548998494 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d002ab60 con 0x7f84c4003a50 2024-05-14T09:41:41.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.780+0000 7f84e4000640 1 -- 172.21.15.135:0/3548998494 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84dc0c4cb0 con 0x7f84c4003a50 2024-05-14T09:41:41.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.780+0000 7f84e4000640 1 -- 172.21.15.135:0/3548998494 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84dc0c5270 con 0x7f84c4003a50 2024-05-14T09:41:41.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.780+0000 7f84d9600640 1 -- 172.21.15.135:0/3548998494 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d00067b0 con 0x7f84c4003a50 2024-05-14T09:41:41.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.781+0000 7f84e4000640 1 -- 172.21.15.135:0/3548998494 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b8005290 con 0x7f84c4003a50 2024-05-14T09:41:41.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.809+0000 7fc51a000640 1 -- 172.21.15.135:0/983907418 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc510085950 con 0x7fc5200b54e0 2024-05-14T09:41:41.809 INFO:teuthology.orchestra.run.smithi135.stdout:64424509460 2024-05-14T09:41:41.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.812+0000 7fc528800640 1 -- 172.21.15.135:0/983907418 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc504076320 msgr2=0x7fc504078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.812+0000 7fc528800640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc504076320 0x7fc504078830 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc514006fd0 tx=0x7fc514006bc0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.812+0000 7fc528800640 1 -- 172.21.15.135:0/983907418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5200b54e0 msgr2=0x7fc520158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:41.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.812+0000 7fc528800640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5200b54e0 0x7fc520158740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc5100098c0 tx=0x7fc5100046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.812+0000 7fc528800640 1 -- 172.21.15.135:0/983907418 shutdown_connections 2024-05-14T09:41:41.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.812+0000 7fc528800640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc504076320 0x7fc504078830 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.812+0000 7fc528800640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc52015a2f0 0x7fc520155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.812+0000 7fc528800640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5200b54e0 0x7fc520158740 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.812+0000 7fc528800640 1 --2- 172.21.15.135:0/983907418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc52006c6f0 0x7fc520154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:41.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.812+0000 7fc528800640 1 -- 172.21.15.135:0/983907418 >> 172.21.15.135:0/983907418 conn(0x7fc5200cec00 msgr2=0x7fc5200b6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:41.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.813+0000 7fc528800640 1 -- 172.21.15.135:0/983907418 shutdown_connections 2024-05-14T09:41:41.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.813+0000 7fc528800640 1 -- 172.21.15.135:0/983907418 wait complete. 2024-05-14T09:41:41.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.832+0000 7f9d5ce00640 1 -- 172.21.15.135:0/1644967552 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9d580c6990 con 0x7f9d58074860 2024-05-14T09:41:41.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509460 got 64424509460 for osd.7 2024-05-14T09:41:41.838 DEBUG:teuthology.parallel:result is None 2024-05-14T09:41:41.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.957+0000 7f35d7c00640 1 -- 172.21.15.135:0/3533050926 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f35d014d8a0 con 0x7f35d014f040 2024-05-14T09:41:41.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.983+0000 7f0f1b200640 1 -- 172.21.15.135:0/1131642532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0f1c0c37b0 con 0x7f0f00004ef0 2024-05-14T09:41:41.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:41.997+0000 7f0f12000640 1 -- 172.21.15.135:0/1131642532 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0f0c061450 con 0x7f0f00004ef0 2024-05-14T09:41:41.997 INFO:teuthology.orchestra.run.smithi135.stdout:60129542162 2024-05-14T09:41:42.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 -- 172.21.15.135:0/1131642532 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0efc076350 msgr2=0x7f0efc078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0efc076350 0x7f0efc078860 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0f08001330 tx=0x7f0f08001da0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 -- 172.21.15.135:0/1131642532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 msgr2=0x7f0f1c156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 0x7f0f1c156df0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00b450 tx=0x7f0f0c00b910 comp rx=0 tx=0).stop 2024-05-14T09:41:42.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 -- 172.21.15.135:0/1131642532 shutdown_connections 2024-05-14T09:41:42.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0efc076350 0x7f0efc078860 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f1c1e6c20 0x7f0f1c1f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f1c1e59d0 0x7f0f1c155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 --2- 172.21.15.135:0/1131642532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00004ef0 0x7f0f1c156df0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 -- 172.21.15.135:0/1131642532 >> 172.21.15.135:0/1131642532 conn(0x7f0f1c0ce870 msgr2=0x7f0f1c15a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:42.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 -- 172.21.15.135:0/1131642532 shutdown_connections 2024-05-14T09:41:42.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.001+0000 7f0f1b200640 1 -- 172.21.15.135:0/1131642532 wait complete. 2024-05-14T09:41:42.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.007+0000 7f35ccc00640 1 -- 172.21.15.135:0/3533050926 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f35bc081bd0 con 0x7f35d014f040 2024-05-14T09:41:42.007 INFO:teuthology.orchestra.run.smithi135.stdout:68719476755 2024-05-14T09:41:42.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.009+0000 7f35d7c00640 1 -- 172.21.15.135:0/3533050926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f35b0076350 msgr2=0x7f35b0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.009+0000 7f35d7c00640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f35b0076350 0x7f35b0078860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35c40096f0 tx=0x7f35c4006c70 comp rx=0 tx=0).stop 2024-05-14T09:41:42.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.009+0000 7f35d7c00640 1 -- 172.21.15.135:0/3533050926 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35d014f040 msgr2=0x7f35d00cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.009+0000 7f35d7c00640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35d014f040 0x7f35d00cd4c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c280 tx=0x7f35d00b2a60 comp rx=0 tx=0).stop 2024-05-14T09:41:42.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.009+0000 7f35d7c00640 1 -- 172.21.15.135:0/3533050926 shutdown_connections 2024-05-14T09:41:42.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.009+0000 7f35d7c00640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f35b0076350 0x7f35b0078860 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.009+0000 7f35d7c00640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35d014f040 0x7f35d00cd4c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.009+0000 7f35d7c00640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35d014f450 0x7f35d00cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.009+0000 7f35d7c00640 1 --2- 172.21.15.135:0/3533050926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35d00cede0 0x7f35d01f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.009+0000 7f35d7c00640 1 -- 172.21.15.135:0/3533050926 >> 172.21.15.135:0/3533050926 conn(0x7f35d0073700 msgr2=0x7f35d00c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:42.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.010+0000 7f35d7c00640 1 -- 172.21.15.135:0/3533050926 shutdown_connections 2024-05-14T09:41:42.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.010+0000 7f35d7c00640 1 -- 172.21.15.135:0/3533050926 wait complete. 2024-05-14T09:41:42.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542161 got 60129542162 for osd.5 2024-05-14T09:41:42.026 DEBUG:teuthology.parallel:result is None 2024-05-14T09:41:42.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476755 got 68719476755 for osd.0 2024-05-14T09:41:42.037 DEBUG:teuthology.parallel:result is None 2024-05-14T09:41:42.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.159+0000 7f84d9600640 1 -- 172.21.15.135:0/3548998494 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f84d0006950 con 0x7f84c4003a50 2024-05-14T09:41:42.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.161+0000 7f84d9600640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f84bc076350 0x7f84bc078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:42.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.162+0000 7f84e0c00640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f84bc076350 0x7f84bc078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:42.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.164+0000 7f84d9600640 1 -- 172.21.15.135:0/3548998494 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f84d007d010 con 0x7f84c4003a50 2024-05-14T09:41:42.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.164+0000 7f84e0c00640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f84bc076350 0x7f84bc078860 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84dc14fa00 tx=0x7f84c8006d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:42.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.185+0000 7f9d4e000640 1 -- 172.21.15.135:0/1644967552 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d48032e20 con 0x7f9d58074860 2024-05-14T09:41:42.185 INFO:teuthology.orchestra.run.smithi135.stdout:68719476759 2024-05-14T09:41:42.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.186+0000 7f84d9600640 1 -- 172.21.15.135:0/3548998494 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f84d0081480 con 0x7f84c4003a50 2024-05-14T09:41:42.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 -- 172.21.15.135:0/1644967552 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9d38076320 msgr2=0x7f9d38078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9d38076320 0x7f9d38078830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9d44000f60 tx=0x7f9d44009040 comp rx=0 tx=0).stop 2024-05-14T09:41:42.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 -- 172.21.15.135:0/1644967552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 msgr2=0x7f9d581543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 0x7f9d581543d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9d480098f0 tx=0x7f9d480046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 -- 172.21.15.135:0/1644967552 shutdown_connections 2024-05-14T09:41:42.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9d38076320 0x7f9d38078830 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d580c8310 0x7f9d58151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d58156780 0x7f9d58146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 --2- 172.21.15.135:0/1644967552 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d58074860 0x7f9d581543d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 -- 172.21.15.135:0/1644967552 >> 172.21.15.135:0/1644967552 conn(0x7f9d58073d40 msgr2=0x7f9d580cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:42.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 -- 172.21.15.135:0/1644967552 shutdown_connections 2024-05-14T09:41:42.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.188+0000 7f9d5ce00640 1 -- 172.21.15.135:0/1644967552 wait complete. 2024-05-14T09:41:42.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476759 for osd.3 2024-05-14T09:41:42.216 DEBUG:teuthology.parallel:result is None 2024-05-14T09:41:42.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.398+0000 7f84e4000640 1 -- 172.21.15.135:0/3548998494 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f84b8005850 con 0x7f84c4003a50 2024-05-14T09:41:42.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.406+0000 7f84d9600640 1 -- 172.21.15.135:0/3548998494 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84d0080d80 con 0x7f84c4003a50 2024-05-14T09:41:42.406 INFO:teuthology.orchestra.run.smithi135.stdout:68719476755 2024-05-14T09:41:42.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.408+0000 7f84e4000640 1 -- 172.21.15.135:0/3548998494 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f84bc076350 msgr2=0x7f84bc078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.408+0000 7f84e4000640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f84bc076350 0x7f84bc078860 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84dc14fa00 tx=0x7f84c8006d00 comp rx=0 tx=0).stop 2024-05-14T09:41:42.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.408+0000 7f84e4000640 1 -- 172.21.15.135:0/3548998494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84c4003a50 msgr2=0x7f84dc1f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.408+0000 7f84e4000640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84c4003a50 0x7f84dc1f5f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84d0001740 tx=0x7f84d0000fb0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.408+0000 7f84e4000640 1 -- 172.21.15.135:0/3548998494 shutdown_connections 2024-05-14T09:41:42.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.408+0000 7f84e4000640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f84bc076350 0x7f84bc078860 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.408+0000 7f84e4000640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f84dc0c66e0 0x7f84dc148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.408+0000 7f84e4000640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84dc0c62d0 0x7f84dc14ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.408+0000 7f84e4000640 1 --2- 172.21.15.135:0/3548998494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f84c4003a50 0x7f84dc1f5f80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.408+0000 7f84e4000640 1 -- 172.21.15.135:0/3548998494 >> 172.21.15.135:0/3548998494 conn(0x7f84dc073d40 msgr2=0x7f84dc070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:42.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.409+0000 7f84e4000640 1 -- 172.21.15.135:0/3548998494 shutdown_connections 2024-05-14T09:41:42.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.409+0000 7f84e4000640 1 -- 172.21.15.135:0/3548998494 wait complete. 2024-05-14T09:41:42.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476755 got 68719476755 for osd.2 2024-05-14T09:41:42.434 DEBUG:teuthology.parallel:result is None 2024-05-14T09:41:42.435 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T09:41:42.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T09:41:42.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.691+0000 7f3ffe600640 1 Processor -- start 2024-05-14T09:41:42.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.692+0000 7f3ffe600640 1 -- start start 2024-05-14T09:41:42.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.694+0000 7f3ffe600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3ff8071fe0 0x7f3ff8154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:42.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.694+0000 7f3ffe600640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3ff8074810 0x7f3ff80c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:42.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.694+0000 7f3ffe600640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ff815b160 con 0x7f3ff80c97c0 2024-05-14T09:41:42.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.694+0000 7f3ffe600640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3ff815ac30 con 0x7f3ff8074810 2024-05-14T09:41:42.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.694+0000 7f3ffe600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f3ff815ae80 con 0x7f3ff8071fe0 2024-05-14T09:41:42.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.695+0000 7f3ff6a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3ff8074810 0x7f3ff80c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:42.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.695+0000 7f3ff7400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3ff8071fe0 0x7f3ff8154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:42.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.696+0000 7f3ff6a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3ff8074810 0x7f3ff80c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56240/0 (socket says 172.21.15.135:56240) 2024-05-14T09:41:42.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.696+0000 7f3ff6a00640 1 -- 172.21.15.135:0/713249037 learned_addr learned my addr 172.21.15.135:0/713249037 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:42.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.700+0000 7f3ff6a00640 1 -- 172.21.15.135:0/713249037 >> v2:172.21.15.196:3300/0 conn(0x7f3ff8071fe0 msgr2=0x7f3ff8154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:42.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.700+0000 7f3ff6a00640 1 --2- 172.21.15.135:0/713249037 >> v2:172.21.15.196:3300/0 conn(0x7f3ff8071fe0 0x7f3ff8154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.700+0000 7f3ff6a00640 1 -- 172.21.15.135:0/713249037 >> v1:172.21.15.135:6789/0 conn(0x7f3ff80c97c0 legacy=0x7f3ff80c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.700+0000 7f3ff6a00640 1 -- 172.21.15.135:0/713249037 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff80c8ce0 con 0x7f3ff8074810 2024-05-14T09:41:42.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.704+0000 7f3ff6a00640 1 --2- 172.21.15.135:0/713249037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff8074810 0x7f3ff80c84d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8073240 tx=0x7f3fe802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c2e8f07b8cbdd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:42.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.710+0000 7f3ff6000640 1 -- 172.21.15.135:0/713249037 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8036070 con 0x7f3ff8074810 2024-05-14T09:41:42.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.711+0000 7f3ff6000640 1 -- 172.21.15.135:0/713249037 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe8031600 con 0x7f3ff8074810 2024-05-14T09:41:42.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.711+0000 7f3ff6000640 1 -- 172.21.15.135:0/713249037 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe80319d0 con 0x7f3ff8074810 2024-05-14T09:41:42.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.712+0000 7f3ffe600640 1 -- 172.21.15.135:0/713249037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff8074810 msgr2=0x7f3ff80c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.712+0000 7f3ffe600640 1 --2- 172.21.15.135:0/713249037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff8074810 0x7f3ff80c84d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8073240 tx=0x7f3fe802a730 comp rx=0 tx=0).stop 2024-05-14T09:41:42.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.712+0000 7f3ffe600640 1 -- 172.21.15.135:0/713249037 shutdown_connections 2024-05-14T09:41:42.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.712+0000 7f3ffe600640 1 --2- 172.21.15.135:0/713249037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff8074810 0x7f3ff80c84d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.712+0000 7f3ffe600640 1 --2- 172.21.15.135:0/713249037 >> v2:172.21.15.196:3300/0 conn(0x7f3ff8071fe0 0x7f3ff8154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.712+0000 7f3ffe600640 1 -- 172.21.15.135:0/713249037 >> 172.21.15.135:0/713249037 conn(0x7f3ff8073cf0 msgr2=0x7f3ff8074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:42.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.712+0000 7f3ffe600640 1 -- 172.21.15.135:0/713249037 shutdown_connections 2024-05-14T09:41:42.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.712+0000 7f3ffe600640 1 -- 172.21.15.135:0/713249037 wait complete. 2024-05-14T09:41:42.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.714+0000 7f3ffe600640 1 Processor -- start 2024-05-14T09:41:42.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.714+0000 7f3ffe600640 1 -- start start 2024-05-14T09:41:42.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.716+0000 7f3ffe600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ff8071fe0 0x7f3ff81f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:42.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.716+0000 7f3ffe600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff8074810 0x7f3ff81e5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:42.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.716+0000 7f3ffe600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ff80c97c0 0x7f3ff80cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:42.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.716+0000 7f3ffe600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff80c72a0 con 0x7f3ff8074810 2024-05-14T09:41:42.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.716+0000 7f3ffe600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff80c92a0 con 0x7f3ff8071fe0 2024-05-14T09:41:42.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.716+0000 7f3ffe600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff80c7420 con 0x7f3ff80c97c0 2024-05-14T09:41:42.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.717+0000 7f3ff6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff8074810 0x7f3ff81e5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:42.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.717+0000 7f3ff6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff8074810 0x7f3ff81e5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56244/0 (socket says 172.21.15.135:56244) 2024-05-14T09:41:42.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.717+0000 7f3ff6a00640 1 -- 172.21.15.135:0/4024492252 learned_addr learned my addr 172.21.15.135:0/4024492252 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:42.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.718+0000 7f3ff7400640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ff8071fe0 0x7f3ff81f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:42.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.718+0000 7f3ff7e00640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ff80c97c0 0x7f3ff80cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:42.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.722+0000 7f3ff6a00640 1 -- 172.21.15.135:0/4024492252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ff80c97c0 msgr2=0x7f3ff80cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.722+0000 7f3ff6a00640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ff80c97c0 0x7f3ff80cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.722+0000 7f3ff6a00640 1 -- 172.21.15.135:0/4024492252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ff8071fe0 msgr2=0x7f3ff81f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:42.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.722+0000 7f3ff6a00640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ff8071fe0 0x7f3ff81f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:42.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.722+0000 7f3ff6a00640 1 -- 172.21.15.135:0/4024492252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff81f3fa0 con 0x7f3ff8074810 2024-05-14T09:41:42.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.724+0000 7f3ff6a00640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff8074810 0x7f3ff81e5cd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3fe802ad20 tx=0x7f3fe8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:42.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.727+0000 7f3fef400640 1 -- 172.21.15.135:0/4024492252 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8041020 con 0x7f3ff8074810 2024-05-14T09:41:42.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.727+0000 7f3ffe600640 1 -- 172.21.15.135:0/4024492252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff815d180 con 0x7f3ff8074810 2024-05-14T09:41:42.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.727+0000 7f3ffe600640 1 -- 172.21.15.135:0/4024492252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff815d720 con 0x7f3ff8074810 2024-05-14T09:41:42.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.728+0000 7f3fef400640 1 -- 172.21.15.135:0/4024492252 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe8031600 con 0x7f3ff8074810 2024-05-14T09:41:42.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.728+0000 7f3fef400640 1 -- 172.21.15.135:0/4024492252 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8036040 con 0x7f3ff8074810 2024-05-14T09:41:42.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:42.729+0000 7f3ffe600640 1 -- 172.21.15.135:0/4024492252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff8069a90 con 0x7f3ff8074810 2024-05-14T09:41:43.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.064+0000 7f3fef400640 1 -- 172.21.15.135:0/4024492252 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3fe8044020 con 0x7f3ff8074810 2024-05-14T09:41:43.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.067+0000 7f3fef400640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3fd40762d0 0x7f3fd40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:43.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.068+0000 7f3ff7400640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3fd40762d0 0x7f3fd40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:43.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.069+0000 7f3ff7400640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3fd40762d0 0x7f3fd40787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009aa0 tx=0x7f3fe0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:43.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.115+0000 7f3fef400640 1 -- 172.21.15.135:0/4024492252 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f3fe80b6ba0 con 0x7f3ff8074810 2024-05-14T09:41:43.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.116+0000 7f3fef400640 1 -- 172.21.15.135:0/4024492252 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3fe804b030 con 0x7f3ff8074810 2024-05-14T09:41:43.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.333+0000 7f3ffe600640 1 -- 172.21.15.135:0/4024492252 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ff8157bd0 con 0x7f3fd40762d0 2024-05-14T09:41:43.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.357+0000 7f3fef400640 1 -- 172.21.15.135:0/4024492252 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332587 (secure 0 0 0) 0x7f3ff8157bd0 con 0x7f3fd40762d0 2024-05-14T09:41:43.362 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:43.363 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-14T09:41:43.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.363+0000 7f3ffe600640 1 -- 172.21.15.135:0/4024492252 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3fd40762d0 msgr2=0x7f3fd40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:43.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.363+0000 7f3ffe600640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3fd40762d0 0x7f3fd40787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009aa0 tx=0x7f3fe0009190 comp rx=0 tx=0).stop 2024-05-14T09:41:43.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.363+0000 7f3ffe600640 1 -- 172.21.15.135:0/4024492252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff8074810 msgr2=0x7f3ff81e5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:43.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.363+0000 7f3ffe600640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff8074810 0x7f3ff81e5cd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3fe802ad20 tx=0x7f3fe8004a40 comp rx=0 tx=0).stop 2024-05-14T09:41:43.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.363+0000 7f3ffe600640 1 -- 172.21.15.135:0/4024492252 shutdown_connections 2024-05-14T09:41:43.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.363+0000 7f3ffe600640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3fd40762d0 0x7f3fd40787e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:43.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.363+0000 7f3ffe600640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ff80c97c0 0x7f3ff80cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:43.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.363+0000 7f3ffe600640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ff8074810 0x7f3ff81e5cd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:43.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.363+0000 7f3ffe600640 1 --2- 172.21.15.135:0/4024492252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ff8071fe0 0x7f3ff81f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:43.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.363+0000 7f3ffe600640 1 -- 172.21.15.135:0/4024492252 >> 172.21.15.135:0/4024492252 conn(0x7f3ff8073cf0 msgr2=0x7f3ff806ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:43.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.363+0000 7f3ffe600640 1 -- 172.21.15.135:0/4024492252 shutdown_connections 2024-05-14T09:41:43.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.364+0000 7f3ffe600640 1 -- 172.21.15.135:0/4024492252 wait complete. 2024-05-14T09:41:43.391 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-05-14T09:41:42.352988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":230,"num_write_kb":1671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220200,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754520,"statfs":{"total":773094113280,"available":772868628480,"internally_reserved":0,"allocated":4169728,"data_stored":2384464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2118,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005553"},"pg_stats":[{"pgid":"2.1f","version":"33'9","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.861707+0000","last_change":"2024-05-14T09:40:43.106486+0000","last_active":"2024-05-14T09:41:30.861707+0000","last_peered":"2024-05-14T09:41:30.861707+0000","last_clean":"2024-05-14T09:41:30.861707+0000","last_became_active":"2024-05-14T09:40:43.105731+0000","last_became_peered":"2024-05-14T09:40:43.105731+0000","last_unstale":"2024-05-14T09:41:30.861707+0000","last_undegraded":"2024-05-14T09:41:30.861707+0000","last_fullsized":"2024-05-14T09:41:30.861707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:32:09.735265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197157+0000","last_change":"2024-05-14T09:40:45.750103+0000","last_active":"2024-05-14T09:41:04.197157+0000","last_peered":"2024-05-14T09:41:04.197157+0000","last_clean":"2024-05-14T09:41:04.197157+0000","last_became_active":"2024-05-14T09:40:45.747865+0000","last_became_peered":"2024-05-14T09:40:45.747865+0000","last_unstale":"2024-05-14T09:41:04.197157+0000","last_undegraded":"2024-05-14T09:41:04.197157+0000","last_fullsized":"2024-05-14T09:41:04.197157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:06.549076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195817+0000","last_change":"2024-05-14T09:40:53.664918+0000","last_active":"2024-05-14T09:41:04.195817+0000","last_peered":"2024-05-14T09:41:04.195817+0000","last_clean":"2024-05-14T09:41:04.195817+0000","last_became_active":"2024-05-14T09:40:53.664366+0000","last_became_peered":"2024-05-14T09:40:53.664366+0000","last_unstale":"2024-05-14T09:41:04.195817+0000","last_undegraded":"2024-05-14T09:41:04.195817+0000","last_fullsized":"2024-05-14T09:41:04.195817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:20:52.204134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198009+0000","last_change":"2024-05-14T09:40:43.101185+0000","last_active":"2024-05-14T09:41:04.198009+0000","last_peered":"2024-05-14T09:41:04.198009+0000","last_clean":"2024-05-14T09:41:04.198009+0000","last_became_active":"2024-05-14T09:40:43.098862+0000","last_became_peered":"2024-05-14T09:40:43.098862+0000","last_unstale":"2024-05-14T09:41:04.198009+0000","last_undegraded":"2024-05-14T09:41:04.198009+0000","last_fullsized":"2024-05-14T09:41:04.198009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203770+0000","last_change":"2024-05-14T09:40:45.752960+0000","last_active":"2024-05-14T09:41:04.203770+0000","last_peered":"2024-05-14T09:41:04.203770+0000","last_clean":"2024-05-14T09:41:04.203770+0000","last_became_active":"2024-05-14T09:40:45.752627+0000","last_became_peered":"2024-05-14T09:40:45.752627+0000","last_unstale":"2024-05-14T09:41:04.203770+0000","last_undegraded":"2024-05-14T09:41:04.203770+0000","last_fullsized":"2024-05-14T09:41:04.203770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.192616+0000","last_change":"2024-05-14T09:40:53.662032+0000","last_active":"2024-05-14T09:41:04.192616+0000","last_peered":"2024-05-14T09:41:04.192616+0000","last_clean":"2024-05-14T09:41:04.192616+0000","last_became_active":"2024-05-14T09:40:53.661453+0000","last_became_peered":"2024-05-14T09:40:53.661453+0000","last_unstale":"2024-05-14T09:41:04.192616+0000","last_undegraded":"2024-05-14T09:41:04.192616+0000","last_fullsized":"2024-05-14T09:41:04.192616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:11.724866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.692297+0000","last_change":"2024-05-14T09:40:43.114965+0000","last_active":"2024-05-14T09:41:30.692297+0000","last_peered":"2024-05-14T09:41:30.692297+0000","last_clean":"2024-05-14T09:41:30.692297+0000","last_became_active":"2024-05-14T09:40:43.114379+0000","last_became_peered":"2024-05-14T09:40:43.114379+0000","last_unstale":"2024-05-14T09:41:30.692297+0000","last_undegraded":"2024-05-14T09:41:30.692297+0000","last_fullsized":"2024-05-14T09:41:30.692297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:43.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204333+0000","last_change":"2024-05-14T09:40:45.758305+0000","last_active":"2024-05-14T09:41:04.204333+0000","last_peered":"2024-05-14T09:41:04.204333+0000","last_clean":"2024-05-14T09:41:04.204333+0000","last_became_active":"2024-05-14T09:40:45.754110+0000","last_became_peered":"2024-05-14T09:40:45.754110+0000","last_unstale":"2024-05-14T09:41:04.204333+0000","last_undegraded":"2024-05-14T09:41:04.204333+0000","last_fullsized":"2024-05-14T09:41:04.204333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:12:42.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.601574+0000","last_change":"2024-05-14T09:41:04.601574+0000","last_active":"2024-05-14T09:41:04.601574+0000","last_peered":"2024-05-14T09:41:04.601574+0000","last_clean":"2024-05-14T09:41:04.601574+0000","last_became_active":"2024-05-14T09:41:04.599475+0000","last_became_peered":"2024-05-14T09:41:04.599475+0000","last_unstale":"2024-05-14T09:41:04.601574+0000","last_undegraded":"2024-05-14T09:41:04.601574+0000","last_fullsized":"2024-05-14T09:41:04.601574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610183+0000","last_change":"2024-05-14T09:40:43.110296+0000","last_active":"2024-05-14T09:41:04.610183+0000","last_peered":"2024-05-14T09:41:04.610183+0000","last_clean":"2024-05-14T09:41:04.610183+0000","last_became_active":"2024-05-14T09:40:43.109932+0000","last_became_peered":"2024-05-14T09:40:43.109932+0000","last_unstale":"2024-05-14T09:41:04.610183+0000","last_undegraded":"2024-05-14T09:41:04.610183+0000","last_fullsized":"2024-05-14T09:41:04.610183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:29.003048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205871+0000","last_change":"2024-05-14T09:40:45.773110+0000","last_active":"2024-05-14T09:41:04.205871+0000","last_peered":"2024-05-14T09:41:04.205871+0000","last_clean":"2024-05-14T09:41:04.205871+0000","last_became_active":"2024-05-14T09:40:45.770117+0000","last_became_peered":"2024-05-14T09:40:45.770117+0000","last_unstale":"2024-05-14T09:41:04.205871+0000","last_undegraded":"2024-05-14T09:41:04.205871+0000","last_fullsized":"2024-05-14T09:41:04.205871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:28.718450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.192677+0000","last_change":"2024-05-14T09:40:53.652049+0000","last_active":"2024-05-14T09:41:04.192677+0000","last_peered":"2024-05-14T09:41:04.192677+0000","last_clean":"2024-05-14T09:41:04.192677+0000","last_became_active":"2024-05-14T09:40:53.651570+0000","last_became_peered":"2024-05-14T09:40:53.651570+0000","last_unstale":"2024-05-14T09:41:04.192677+0000","last_undegraded":"2024-05-14T09:41:04.192677+0000","last_fullsized":"2024-05-14T09:41:04.192677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:30.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595721+0000","last_change":"2024-05-14T09:40:45.753771+0000","last_active":"2024-05-14T09:41:04.595721+0000","last_peered":"2024-05-14T09:41:04.595721+0000","last_clean":"2024-05-14T09:41:04.595721+0000","last_became_active":"2024-05-14T09:40:45.753319+0000","last_became_peered":"2024-05-14T09:40:45.753319+0000","last_unstale":"2024-05-14T09:41:04.595721+0000","last_undegraded":"2024-05-14T09:41:04.595721+0000","last_fullsized":"2024-05-14T09:41:04.595721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.542521+0000","last_change":"2024-05-14T09:40:43.125708+0000","last_active":"2024-05-14T09:41:27.542521+0000","last_peered":"2024-05-14T09:41:27.542521+0000","last_clean":"2024-05-14T09:41:27.542521+0000","last_became_active":"2024-05-14T09:40:43.125239+0000","last_became_peered":"2024-05-14T09:40:43.125239+0000","last_unstale":"2024-05-14T09:41:27.542521+0000","last_undegraded":"2024-05-14T09:41:27.542521+0000","last_fullsized":"2024-05-14T09:41:27.542521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:22.781125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.194099+0000","last_change":"2024-05-14T09:40:53.663353+0000","last_active":"2024-05-14T09:41:04.194099+0000","last_peered":"2024-05-14T09:41:04.194099+0000","last_clean":"2024-05-14T09:41:04.194099+0000","last_became_active":"2024-05-14T09:40:53.662559+0000","last_became_peered":"2024-05-14T09:40:53.662559+0000","last_unstale":"2024-05-14T09:41:04.194099+0000","last_undegraded":"2024-05-14T09:41:04.194099+0000","last_fullsized":"2024-05-14T09:41:04.194099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:14.708431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197527+0000","last_change":"2024-05-14T09:40:45.751929+0000","last_active":"2024-05-14T09:41:04.197527+0000","last_peered":"2024-05-14T09:41:04.197527+0000","last_clean":"2024-05-14T09:41:04.197527+0000","last_became_active":"2024-05-14T09:40:45.751015+0000","last_became_peered":"2024-05-14T09:40:45.751015+0000","last_unstale":"2024-05-14T09:41:04.197527+0000","last_undegraded":"2024-05-14T09:41:04.197527+0000","last_fullsized":"2024-05-14T09:41:04.197527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:12.550231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247388+0000","last_change":"2024-05-14T09:40:43.023070+0000","last_active":"2024-05-14T09:41:04.247388+0000","last_peered":"2024-05-14T09:41:04.247388+0000","last_clean":"2024-05-14T09:41:04.247388+0000","last_became_active":"2024-05-14T09:40:43.022234+0000","last_became_peered":"2024-05-14T09:40:43.022234+0000","last_unstale":"2024-05-14T09:41:04.247388+0000","last_undegraded":"2024-05-14T09:41:04.247388+0000","last_fullsized":"2024-05-14T09:41:04.247388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:30:06.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.601663+0000","last_change":"2024-05-14T09:41:04.601663+0000","last_active":"2024-05-14T09:41:04.601663+0000","last_peered":"2024-05-14T09:41:04.601663+0000","last_clean":"2024-05-14T09:41:04.601663+0000","last_became_active":"2024-05-14T09:41:04.600186+0000","last_became_peered":"2024-05-14T09:41:04.600186+0000","last_unstale":"2024-05-14T09:41:04.601663+0000","last_undegraded":"2024-05-14T09:41:04.601663+0000","last_fullsized":"2024-05-14T09:41:04.601663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196422+0000","last_change":"2024-05-14T09:40:45.746999+0000","last_active":"2024-05-14T09:41:04.196422+0000","last_peered":"2024-05-14T09:41:04.196422+0000","last_clean":"2024-05-14T09:41:04.196422+0000","last_became_active":"2024-05-14T09:40:45.746607+0000","last_became_peered":"2024-05-14T09:40:45.746607+0000","last_unstale":"2024-05-14T09:41:04.196422+0000","last_undegraded":"2024-05-14T09:41:04.196422+0000","last_fullsized":"2024-05-14T09:41:04.196422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:03.565510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.774259+0000","last_change":"2024-05-14T09:40:43.105149+0000","last_active":"2024-05-14T09:41:27.774259+0000","last_peered":"2024-05-14T09:41:27.774259+0000","last_clean":"2024-05-14T09:41:27.774259+0000","last_became_active":"2024-05-14T09:40:43.104277+0000","last_became_peered":"2024-05-14T09:40:43.104277+0000","last_unstale":"2024-05-14T09:41:27.774259+0000","last_undegraded":"2024-05-14T09:41:27.774259+0000","last_fullsized":"2024-05-14T09:41:27.774259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:48.598915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247251+0000","last_change":"2024-05-14T09:40:53.649256+0000","last_active":"2024-05-14T09:41:04.247251+0000","last_peered":"2024-05-14T09:41:04.247251+0000","last_clean":"2024-05-14T09:41:04.247251+0000","last_became_active":"2024-05-14T09:40:53.648765+0000","last_became_peered":"2024-05-14T09:40:53.648765+0000","last_unstale":"2024-05-14T09:41:04.247251+0000","last_undegraded":"2024-05-14T09:41:04.247251+0000","last_fullsized":"2024-05-14T09:41:04.247251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:25.060381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196117+0000","last_change":"2024-05-14T09:40:45.730862+0000","last_active":"2024-05-14T09:41:04.196117+0000","last_peered":"2024-05-14T09:41:04.196117+0000","last_clean":"2024-05-14T09:41:04.196117+0000","last_became_active":"2024-05-14T09:40:45.730014+0000","last_became_peered":"2024-05-14T09:40:45.730014+0000","last_unstale":"2024-05-14T09:41:04.196117+0000","last_undegraded":"2024-05-14T09:41:04.196117+0000","last_fullsized":"2024-05-14T09:41:04.196117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:05.679719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.533383+0000","last_change":"2024-05-14T09:40:43.112127+0000","last_active":"2024-05-14T09:41:27.533383+0000","last_peered":"2024-05-14T09:41:27.533383+0000","last_clean":"2024-05-14T09:41:27.533383+0000","last_became_active":"2024-05-14T09:40:43.111574+0000","last_became_peered":"2024-05-14T09:40:43.111574+0000","last_unstale":"2024-05-14T09:41:27.533383+0000","last_undegraded":"2024-05-14T09:41:27.533383+0000","last_fullsized":"2024-05-14T09:41:27.533383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:13.668017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193742+0000","last_change":"2024-05-14T09:40:53.666100+0000","last_active":"2024-05-14T09:41:04.193742+0000","last_peered":"2024-05-14T09:41:04.193742+0000","last_clean":"2024-05-14T09:41:04.193742+0000","last_became_active":"2024-05-14T09:40:53.665635+0000","last_became_peered":"2024-05-14T09:40:53.665635+0000","last_unstale":"2024-05-14T09:41:04.193742+0000","last_undegraded":"2024-05-14T09:41:04.193742+0000","last_fullsized":"2024-05-14T09:41:04.193742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:21.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205010+0000","last_change":"2024-05-14T09:40:45.758554+0000","last_active":"2024-05-14T09:41:04.205010+0000","last_peered":"2024-05-14T09:41:04.205010+0000","last_clean":"2024-05-14T09:41:04.205010+0000","last_became_active":"2024-05-14T09:40:45.757938+0000","last_became_peered":"2024-05-14T09:40:45.757938+0000","last_unstale":"2024-05-14T09:41:04.205010+0000","last_undegraded":"2024-05-14T09:41:04.205010+0000","last_fullsized":"2024-05-14T09:41:04.205010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.545839+0000","last_change":"2024-05-14T09:40:43.116767+0000","last_active":"2024-05-14T09:41:27.545839+0000","last_peered":"2024-05-14T09:41:27.545839+0000","last_clean":"2024-05-14T09:41:27.545839+0000","last_became_active":"2024-05-14T09:40:43.116142+0000","last_became_peered":"2024-05-14T09:40:43.116142+0000","last_unstale":"2024-05-14T09:41:27.545839+0000","last_undegraded":"2024-05-14T09:41:27.545839+0000","last_fullsized":"2024-05-14T09:41:27.545839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195886+0000","last_change":"2024-05-14T09:40:53.666811+0000","last_active":"2024-05-14T09:41:04.195886+0000","last_peered":"2024-05-14T09:41:04.195886+0000","last_clean":"2024-05-14T09:41:04.195886+0000","last_became_active":"2024-05-14T09:40:53.666455+0000","last_became_peered":"2024-05-14T09:40:53.666455+0000","last_unstale":"2024-05-14T09:41:04.195886+0000","last_undegraded":"2024-05-14T09:41:04.195886+0000","last_fullsized":"2024-05-14T09:41:04.195886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:33.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198714+0000","last_change":"2024-05-14T09:40:45.768162+0000","last_active":"2024-05-14T09:41:04.198714+0000","last_peered":"2024-05-14T09:41:04.198714+0000","last_clean":"2024-05-14T09:41:04.198714+0000","last_became_active":"2024-05-14T09:40:45.767810+0000","last_became_peered":"2024-05-14T09:40:45.767810+0000","last_unstale":"2024-05-14T09:41:04.198714+0000","last_undegraded":"2024-05-14T09:41:04.198714+0000","last_fullsized":"2024-05-14T09:41:04.198714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:25.075246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.686318+0000","last_change":"2024-05-14T09:40:43.115650+0000","last_active":"2024-05-14T09:41:30.686318+0000","last_peered":"2024-05-14T09:41:30.686318+0000","last_clean":"2024-05-14T09:41:30.686318+0000","last_became_active":"2024-05-14T09:40:43.114902+0000","last_became_peered":"2024-05-14T09:40:43.114902+0000","last_unstale":"2024-05-14T09:41:30.686318+0000","last_undegraded":"2024-05-14T09:41:30.686318+0000","last_fullsized":"2024-05-14T09:41:30.686318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:19.284998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195677+0000","last_change":"2024-05-14T09:40:53.650297+0000","last_active":"2024-05-14T09:41:04.195677+0000","last_peered":"2024-05-14T09:41:04.195677+0000","last_clean":"2024-05-14T09:41:04.195677+0000","last_became_active":"2024-05-14T09:40:53.649263+0000","last_became_peered":"2024-05-14T09:40:53.649263+0000","last_unstale":"2024-05-14T09:41:04.195677+0000","last_undegraded":"2024-05-14T09:41:04.195677+0000","last_fullsized":"2024-05-14T09:41:04.195677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:22.637337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247816+0000","last_change":"2024-05-14T09:40:45.733131+0000","last_active":"2024-05-14T09:41:04.247816+0000","last_peered":"2024-05-14T09:41:04.247816+0000","last_clean":"2024-05-14T09:41:04.247816+0000","last_became_active":"2024-05-14T09:40:45.732154+0000","last_became_peered":"2024-05-14T09:40:45.732154+0000","last_unstale":"2024-05-14T09:41:04.247816+0000","last_undegraded":"2024-05-14T09:41:04.247816+0000","last_fullsized":"2024-05-14T09:41:04.247816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:23:16.904648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611279+0000","last_change":"2024-05-14T09:40:43.112841+0000","last_active":"2024-05-14T09:41:04.611279+0000","last_peered":"2024-05-14T09:41:04.611279+0000","last_clean":"2024-05-14T09:41:04.611279+0000","last_became_active":"2024-05-14T09:40:43.110703+0000","last_became_peered":"2024-05-14T09:40:43.110703+0000","last_unstale":"2024-05-14T09:41:04.611279+0000","last_undegraded":"2024-05-14T09:41:04.611279+0000","last_fullsized":"2024-05-14T09:41:04.611279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:01.271389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203306+0000","last_change":"2024-05-14T09:40:53.657532+0000","last_active":"2024-05-14T09:41:04.203306+0000","last_peered":"2024-05-14T09:41:04.203306+0000","last_clean":"2024-05-14T09:41:04.203306+0000","last_became_active":"2024-05-14T09:40:53.657073+0000","last_became_peered":"2024-05-14T09:40:53.657073+0000","last_unstale":"2024-05-14T09:41:04.203306+0000","last_undegraded":"2024-05-14T09:41:04.203306+0000","last_fullsized":"2024-05-14T09:41:04.203306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:56.882153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.206106+0000","last_change":"2024-05-14T09:40:45.752122+0000","last_active":"2024-05-14T09:41:04.206106+0000","last_peered":"2024-05-14T09:41:04.206106+0000","last_clean":"2024-05-14T09:41:04.206106+0000","last_became_active":"2024-05-14T09:40:45.751546+0000","last_became_peered":"2024-05-14T09:40:45.751546+0000","last_unstale":"2024-05-14T09:41:04.206106+0000","last_undegraded":"2024-05-14T09:41:04.206106+0000","last_fullsized":"2024-05-14T09:41:04.206106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:19:55.897772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247921+0000","last_change":"2024-05-14T09:40:43.099478+0000","last_active":"2024-05-14T09:41:04.247921+0000","last_peered":"2024-05-14T09:41:04.247921+0000","last_clean":"2024-05-14T09:41:04.247921+0000","last_became_active":"2024-05-14T09:40:43.098776+0000","last_became_peered":"2024-05-14T09:40:43.098776+0000","last_unstale":"2024-05-14T09:41:04.247921+0000","last_undegraded":"2024-05-14T09:41:04.247921+0000","last_fullsized":"2024-05-14T09:41:04.247921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:35.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.246451+0000","last_change":"2024-05-14T09:40:53.650794+0000","last_active":"2024-05-14T09:41:04.246451+0000","last_peered":"2024-05-14T09:41:04.246451+0000","last_clean":"2024-05-14T09:41:04.246451+0000","last_became_active":"2024-05-14T09:40:53.650139+0000","last_became_peered":"2024-05-14T09:40:53.650139+0000","last_unstale":"2024-05-14T09:41:04.246451+0000","last_undegraded":"2024-05-14T09:41:04.246451+0000","last_fullsized":"2024-05-14T09:41:04.246451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:36.877806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193914+0000","last_change":"2024-05-14T09:40:45.748430+0000","last_active":"2024-05-14T09:41:04.193914+0000","last_peered":"2024-05-14T09:41:04.193914+0000","last_clean":"2024-05-14T09:41:04.193914+0000","last_became_active":"2024-05-14T09:40:45.748048+0000","last_became_peered":"2024-05-14T09:40:45.748048+0000","last_unstale":"2024-05-14T09:41:04.193914+0000","last_undegraded":"2024-05-14T09:41:04.193914+0000","last_fullsized":"2024-05-14T09:41:04.193914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:29.240543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205515+0000","last_change":"2024-05-14T09:40:43.088293+0000","last_active":"2024-05-14T09:41:04.205515+0000","last_peered":"2024-05-14T09:41:04.205515+0000","last_clean":"2024-05-14T09:41:04.205515+0000","last_became_active":"2024-05-14T09:40:43.087310+0000","last_became_peered":"2024-05-14T09:40:43.087310+0000","last_unstale":"2024-05-14T09:41:04.205515+0000","last_undegraded":"2024-05-14T09:41:04.205515+0000","last_fullsized":"2024-05-14T09:41:04.205515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:38.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.604273+0000","last_change":"2024-05-14T09:41:04.598844+0000","last_active":"2024-05-14T09:41:04.604273+0000","last_peered":"2024-05-14T09:41:04.604273+0000","last_clean":"2024-05-14T09:41:04.604273+0000","last_became_active":"2024-05-14T09:41:04.597473+0000","last_became_peered":"2024-05-14T09:41:04.597473+0000","last_unstale":"2024-05-14T09:41:04.604273+0000","last_undegraded":"2024-05-14T09:41:04.604273+0000","last_fullsized":"2024-05-14T09:41:04.604273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:48.257782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245464+0000","last_change":"2024-05-14T09:40:45.740074+0000","last_active":"2024-05-14T09:41:04.245464+0000","last_peered":"2024-05-14T09:41:04.245464+0000","last_clean":"2024-05-14T09:41:04.245464+0000","last_became_active":"2024-05-14T09:40:45.739647+0000","last_became_peered":"2024-05-14T09:40:45.739647+0000","last_unstale":"2024-05-14T09:41:04.245464+0000","last_undegraded":"2024-05-14T09:41:04.245464+0000","last_fullsized":"2024-05-14T09:41:04.245464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:38.401151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.853150+0000","last_change":"2024-05-14T09:40:43.043210+0000","last_active":"2024-05-14T09:41:30.853150+0000","last_peered":"2024-05-14T09:41:30.853150+0000","last_clean":"2024-05-14T09:41:30.853150+0000","last_became_active":"2024-05-14T09:40:43.042243+0000","last_became_peered":"2024-05-14T09:40:43.042243+0000","last_unstale":"2024-05-14T09:41:30.853150+0000","last_undegraded":"2024-05-14T09:41:30.853150+0000","last_fullsized":"2024-05-14T09:41:30.853150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.946422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247618+0000","last_change":"2024-05-14T09:40:53.652161+0000","last_active":"2024-05-14T09:41:04.247618+0000","last_peered":"2024-05-14T09:41:04.247618+0000","last_clean":"2024-05-14T09:41:04.247618+0000","last_became_active":"2024-05-14T09:40:53.649990+0000","last_became_peered":"2024-05-14T09:40:53.649990+0000","last_unstale":"2024-05-14T09:41:04.247618+0000","last_undegraded":"2024-05-14T09:41:04.247618+0000","last_fullsized":"2024-05-14T09:41:04.247618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:20:04.057127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203229+0000","last_change":"2024-05-14T09:40:45.754250+0000","last_active":"2024-05-14T09:41:04.203229+0000","last_peered":"2024-05-14T09:41:04.203229+0000","last_clean":"2024-05-14T09:41:04.203229+0000","last_became_active":"2024-05-14T09:40:45.753850+0000","last_became_peered":"2024-05-14T09:40:45.753850+0000","last_unstale":"2024-05-14T09:41:04.203229+0000","last_undegraded":"2024-05-14T09:41:04.203229+0000","last_fullsized":"2024-05-14T09:41:04.203229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:15.962138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.690809+0000","last_change":"2024-05-14T09:40:43.111905+0000","last_active":"2024-05-14T09:41:30.690809+0000","last_peered":"2024-05-14T09:41:30.690809+0000","last_clean":"2024-05-14T09:41:30.690809+0000","last_became_active":"2024-05-14T09:40:43.108233+0000","last_became_peered":"2024-05-14T09:40:43.108233+0000","last_unstale":"2024-05-14T09:41:30.690809+0000","last_undegraded":"2024-05-14T09:41:30.690809+0000","last_fullsized":"2024-05-14T09:41:30.690809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204679+0000","last_change":"2024-05-14T09:40:53.663789+0000","last_active":"2024-05-14T09:41:04.204679+0000","last_peered":"2024-05-14T09:41:04.204679+0000","last_clean":"2024-05-14T09:41:04.204679+0000","last_became_active":"2024-05-14T09:40:53.662980+0000","last_became_peered":"2024-05-14T09:40:53.662980+0000","last_unstale":"2024-05-14T09:41:04.204679+0000","last_undegraded":"2024-05-14T09:41:04.204679+0000","last_fullsized":"2024-05-14T09:41:04.204679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:46.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196055+0000","last_change":"2024-05-14T09:40:45.754347+0000","last_active":"2024-05-14T09:41:04.196055+0000","last_peered":"2024-05-14T09:41:04.196055+0000","last_clean":"2024-05-14T09:41:04.196055+0000","last_became_active":"2024-05-14T09:40:45.753869+0000","last_became_peered":"2024-05-14T09:40:45.753869+0000","last_unstale":"2024-05-14T09:41:04.196055+0000","last_undegraded":"2024-05-14T09:41:04.196055+0000","last_fullsized":"2024-05-14T09:41:04.196055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.548510+0000","last_change":"2024-05-14T09:40:43.087481+0000","last_active":"2024-05-14T09:41:27.548510+0000","last_peered":"2024-05-14T09:41:27.548510+0000","last_clean":"2024-05-14T09:41:27.548510+0000","last_became_active":"2024-05-14T09:40:43.086487+0000","last_became_peered":"2024-05-14T09:40:43.086487+0000","last_unstale":"2024-05-14T09:41:27.548510+0000","last_undegraded":"2024-05-14T09:41:27.548510+0000","last_fullsized":"2024-05-14T09:41:27.548510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:54.225063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.608887+0000","last_change":"2024-05-14T09:40:22.705545+0000","last_active":"2024-05-14T09:41:04.608887+0000","last_peered":"2024-05-14T09:41:04.608887+0000","last_clean":"2024-05-14T09:41:04.608887+0000","last_became_active":"2024-05-14T09:40:22.701797+0000","last_became_peered":"2024-05-14T09:40:22.701797+0000","last_unstale":"2024-05-14T09:41:04.608887+0000","last_undegraded":"2024-05-14T09:41:04.608887+0000","last_fullsized":"2024-05-14T09:41:04.608887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_clean_scrub_stamp":"2024-05-14T09:40:17.767400+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:48:21.700172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596932+0000","last_change":"2024-05-14T09:40:53.681915+0000","last_active":"2024-05-14T09:41:04.596932+0000","last_peered":"2024-05-14T09:41:04.596932+0000","last_clean":"2024-05-14T09:41:04.596932+0000","last_became_active":"2024-05-14T09:40:53.681296+0000","last_became_peered":"2024-05-14T09:40:53.681296+0000","last_unstale":"2024-05-14T09:41:04.596932+0000","last_undegraded":"2024-05-14T09:41:04.596932+0000","last_fullsized":"2024-05-14T09:41:04.596932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:21.455981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.216856+0000","last_change":"2024-05-14T09:41:04.213355+0000","last_active":"2024-05-14T09:41:04.216856+0000","last_peered":"2024-05-14T09:41:04.216856+0000","last_clean":"2024-05-14T09:41:04.216856+0000","last_became_active":"2024-05-14T09:41:04.212709+0000","last_became_peered":"2024-05-14T09:41:04.212709+0000","last_unstale":"2024-05-14T09:41:04.216856+0000","last_undegraded":"2024-05-14T09:41:04.216856+0000","last_fullsized":"2024-05-14T09:41:04.216856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.848240+0000","last_change":"2024-05-14T09:40:43.090401+0000","last_active":"2024-05-14T09:41:30.848240+0000","last_peered":"2024-05-14T09:41:30.848240+0000","last_clean":"2024-05-14T09:41:30.848240+0000","last_became_active":"2024-05-14T09:40:43.089548+0000","last_became_peered":"2024-05-14T09:40:43.089548+0000","last_unstale":"2024-05-14T09:41:30.848240+0000","last_undegraded":"2024-05-14T09:41:30.848240+0000","last_fullsized":"2024-05-14T09:41:30.848240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:03.385598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595424+0000","last_change":"2024-05-14T09:40:53.677072+0000","last_active":"2024-05-14T09:41:04.595424+0000","last_peered":"2024-05-14T09:41:04.595424+0000","last_clean":"2024-05-14T09:41:04.595424+0000","last_became_active":"2024-05-14T09:40:53.676636+0000","last_became_peered":"2024-05-14T09:40:53.676636+0000","last_unstale":"2024-05-14T09:41:04.595424+0000","last_undegraded":"2024-05-14T09:41:04.595424+0000","last_fullsized":"2024-05-14T09:41:04.595424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205238+0000","last_change":"2024-05-14T09:40:45.750962+0000","last_active":"2024-05-14T09:41:04.205238+0000","last_peered":"2024-05-14T09:41:04.205238+0000","last_clean":"2024-05-14T09:41:04.205238+0000","last_became_active":"2024-05-14T09:40:45.750539+0000","last_became_peered":"2024-05-14T09:40:45.750539+0000","last_unstale":"2024-05-14T09:41:04.205238+0000","last_undegraded":"2024-05-14T09:41:04.205238+0000","last_fullsized":"2024-05-14T09:41:04.205238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:42.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247645+0000","last_change":"2024-05-14T09:40:43.122483+0000","last_active":"2024-05-14T09:41:04.247645+0000","last_peered":"2024-05-14T09:41:04.247645+0000","last_clean":"2024-05-14T09:41:04.247645+0000","last_became_active":"2024-05-14T09:40:43.121427+0000","last_became_peered":"2024-05-14T09:40:43.121427+0000","last_unstale":"2024-05-14T09:41:04.247645+0000","last_undegraded":"2024-05-14T09:41:04.247645+0000","last_fullsized":"2024-05-14T09:41:04.247645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:31.384470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203609+0000","last_change":"2024-05-14T09:40:53.656157+0000","last_active":"2024-05-14T09:41:04.203609+0000","last_peered":"2024-05-14T09:41:04.203609+0000","last_clean":"2024-05-14T09:41:04.203609+0000","last_became_active":"2024-05-14T09:40:53.655141+0000","last_became_peered":"2024-05-14T09:40:53.655141+0000","last_unstale":"2024-05-14T09:41:04.203609+0000","last_undegraded":"2024-05-14T09:41:04.203609+0000","last_fullsized":"2024-05-14T09:41:04.203609+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611389+0000","last_change":"2024-05-14T09:40:45.778555+0000","last_active":"2024-05-14T09:41:04.611389+0000","last_peered":"2024-05-14T09:41:04.611389+0000","last_clean":"2024-05-14T09:41:04.611389+0000","last_became_active":"2024-05-14T09:40:45.776967+0000","last_became_peered":"2024-05-14T09:40:45.776967+0000","last_unstale":"2024-05-14T09:41:04.611389+0000","last_undegraded":"2024-05-14T09:41:04.611389+0000","last_fullsized":"2024-05-14T09:41:04.611389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:45:35.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211879+0000","last_change":"2024-05-14T09:40:43.043359+0000","last_active":"2024-05-14T09:41:04.211879+0000","last_peered":"2024-05-14T09:41:04.211879+0000","last_clean":"2024-05-14T09:41:04.211879+0000","last_became_active":"2024-05-14T09:40:43.042486+0000","last_became_peered":"2024-05-14T09:40:43.042486+0000","last_unstale":"2024-05-14T09:41:04.211879+0000","last_undegraded":"2024-05-14T09:41:04.211879+0000","last_fullsized":"2024-05-14T09:41:04.211879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:15.480365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203108+0000","last_change":"2024-05-14T09:40:53.662719+0000","last_active":"2024-05-14T09:41:04.203108+0000","last_peered":"2024-05-14T09:41:04.203108+0000","last_clean":"2024-05-14T09:41:04.203108+0000","last_became_active":"2024-05-14T09:40:53.660933+0000","last_became_peered":"2024-05-14T09:40:53.660933+0000","last_unstale":"2024-05-14T09:41:04.203108+0000","last_undegraded":"2024-05-14T09:41:04.203108+0000","last_fullsized":"2024-05-14T09:41:04.203108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:02.584358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610643+0000","last_change":"2024-05-14T09:40:45.776336+0000","last_active":"2024-05-14T09:41:04.610643+0000","last_peered":"2024-05-14T09:41:04.610643+0000","last_clean":"2024-05-14T09:41:04.610643+0000","last_became_active":"2024-05-14T09:40:45.775936+0000","last_became_peered":"2024-05-14T09:40:45.775936+0000","last_unstale":"2024-05-14T09:41:04.610643+0000","last_undegraded":"2024-05-14T09:41:04.610643+0000","last_fullsized":"2024-05-14T09:41:04.610643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:59.300900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.194909+0000","last_change":"2024-05-14T09:40:43.124714+0000","last_active":"2024-05-14T09:41:04.194909+0000","last_peered":"2024-05-14T09:41:04.194909+0000","last_clean":"2024-05-14T09:41:04.194909+0000","last_became_active":"2024-05-14T09:40:43.124370+0000","last_became_peered":"2024-05-14T09:40:43.124370+0000","last_unstale":"2024-05-14T09:41:04.194909+0000","last_undegraded":"2024-05-14T09:41:04.194909+0000","last_fullsized":"2024-05-14T09:41:04.194909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:52.132214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195468+0000","last_change":"2024-05-14T09:40:53.667102+0000","last_active":"2024-05-14T09:41:04.195468+0000","last_peered":"2024-05-14T09:41:04.195468+0000","last_clean":"2024-05-14T09:41:04.195468+0000","last_became_active":"2024-05-14T09:40:53.666666+0000","last_became_peered":"2024-05-14T09:40:53.666666+0000","last_unstale":"2024-05-14T09:41:04.195468+0000","last_undegraded":"2024-05-14T09:41:04.195468+0000","last_fullsized":"2024-05-14T09:41:04.195468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609479+0000","last_change":"2024-05-14T09:40:45.777251+0000","last_active":"2024-05-14T09:41:04.609479+0000","last_peered":"2024-05-14T09:41:04.609479+0000","last_clean":"2024-05-14T09:41:04.609479+0000","last_became_active":"2024-05-14T09:40:45.775668+0000","last_became_peered":"2024-05-14T09:40:45.775668+0000","last_unstale":"2024-05-14T09:41:04.609479+0000","last_undegraded":"2024-05-14T09:41:04.609479+0000","last_fullsized":"2024-05-14T09:41:04.609479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:54.917354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.859595+0000","last_change":"2024-05-14T09:40:43.040000+0000","last_active":"2024-05-14T09:41:30.859595+0000","last_peered":"2024-05-14T09:41:30.859595+0000","last_clean":"2024-05-14T09:41:30.859595+0000","last_became_active":"2024-05-14T09:40:43.039186+0000","last_became_peered":"2024-05-14T09:40:43.039186+0000","last_unstale":"2024-05-14T09:41:30.859595+0000","last_undegraded":"2024-05-14T09:41:30.859595+0000","last_fullsized":"2024-05-14T09:41:30.859595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:41:44.514114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204660+0000","last_change":"2024-05-14T09:40:53.667056+0000","last_active":"2024-05-14T09:41:04.204660+0000","last_peered":"2024-05-14T09:41:04.204660+0000","last_clean":"2024-05-14T09:41:04.204660+0000","last_became_active":"2024-05-14T09:40:53.666575+0000","last_became_peered":"2024-05-14T09:40:53.666575+0000","last_unstale":"2024-05-14T09:41:04.204660+0000","last_undegraded":"2024-05-14T09:41:04.204660+0000","last_fullsized":"2024-05-14T09:41:04.204660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594614+0000","last_change":"2024-05-14T09:40:45.754466+0000","last_active":"2024-05-14T09:41:04.594614+0000","last_peered":"2024-05-14T09:41:04.594614+0000","last_clean":"2024-05-14T09:41:04.594614+0000","last_became_active":"2024-05-14T09:40:45.753839+0000","last_became_peered":"2024-05-14T09:40:45.753839+0000","last_unstale":"2024-05-14T09:41:04.594614+0000","last_undegraded":"2024-05-14T09:41:04.594614+0000","last_fullsized":"2024-05-14T09:41:04.594614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.902026+0000","last_change":"2024-05-14T09:40:43.121744+0000","last_active":"2024-05-14T09:41:30.902026+0000","last_peered":"2024-05-14T09:41:30.902026+0000","last_clean":"2024-05-14T09:41:30.902026+0000","last_became_active":"2024-05-14T09:40:43.121388+0000","last_became_peered":"2024-05-14T09:40:43.121388+0000","last_unstale":"2024-05-14T09:41:30.902026+0000","last_undegraded":"2024-05-14T09:41:30.902026+0000","last_fullsized":"2024-05-14T09:41:30.902026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198145+0000","last_change":"2024-05-14T09:40:53.659658+0000","last_active":"2024-05-14T09:41:04.198145+0000","last_peered":"2024-05-14T09:41:04.198145+0000","last_clean":"2024-05-14T09:41:04.198145+0000","last_became_active":"2024-05-14T09:40:53.659191+0000","last_became_peered":"2024-05-14T09:40:53.659191+0000","last_unstale":"2024-05-14T09:41:04.198145+0000","last_undegraded":"2024-05-14T09:41:04.198145+0000","last_fullsized":"2024-05-14T09:41:04.198145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:15:39.587593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609972+0000","last_change":"2024-05-14T09:40:45.776748+0000","last_active":"2024-05-14T09:41:04.609972+0000","last_peered":"2024-05-14T09:41:04.609972+0000","last_clean":"2024-05-14T09:41:04.609972+0000","last_became_active":"2024-05-14T09:40:45.776451+0000","last_became_peered":"2024-05-14T09:40:45.776451+0000","last_unstale":"2024-05-14T09:41:04.609972+0000","last_undegraded":"2024-05-14T09:41:04.609972+0000","last_fullsized":"2024-05-14T09:41:04.609972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:39.890407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.545190+0000","last_change":"2024-05-14T09:40:43.086185+0000","last_active":"2024-05-14T09:41:27.545190+0000","last_peered":"2024-05-14T09:41:27.545190+0000","last_clean":"2024-05-14T09:41:27.545190+0000","last_became_active":"2024-05-14T09:40:43.085320+0000","last_became_peered":"2024-05-14T09:40:43.085320+0000","last_unstale":"2024-05-14T09:41:27.545190+0000","last_undegraded":"2024-05-14T09:41:27.545190+0000","last_fullsized":"2024-05-14T09:41:27.545190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:26:22.301593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196812+0000","last_change":"2024-05-14T09:40:53.673710+0000","last_active":"2024-05-14T09:41:04.196812+0000","last_peered":"2024-05-14T09:41:04.196812+0000","last_clean":"2024-05-14T09:41:04.196812+0000","last_became_active":"2024-05-14T09:40:53.672089+0000","last_became_peered":"2024-05-14T09:40:53.672089+0000","last_unstale":"2024-05-14T09:41:04.196812+0000","last_undegraded":"2024-05-14T09:41:04.196812+0000","last_fullsized":"2024-05-14T09:41:04.196812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:48:16.697615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205653+0000","last_change":"2024-05-14T09:40:45.767220+0000","last_active":"2024-05-14T09:41:04.205653+0000","last_peered":"2024-05-14T09:41:04.205653+0000","last_clean":"2024-05-14T09:41:04.205653+0000","last_became_active":"2024-05-14T09:40:45.766895+0000","last_became_peered":"2024-05-14T09:40:45.766895+0000","last_unstale":"2024-05-14T09:41:04.205653+0000","last_undegraded":"2024-05-14T09:41:04.205653+0000","last_fullsized":"2024-05-14T09:41:04.205653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.860251+0000","last_change":"2024-05-14T09:40:43.124937+0000","last_active":"2024-05-14T09:41:30.860251+0000","last_peered":"2024-05-14T09:41:30.860251+0000","last_clean":"2024-05-14T09:41:30.860251+0000","last_became_active":"2024-05-14T09:40:43.124129+0000","last_became_peered":"2024-05-14T09:40:43.124129+0000","last_unstale":"2024-05-14T09:41:30.860251+0000","last_undegraded":"2024-05-14T09:41:30.860251+0000","last_fullsized":"2024-05-14T09:41:30.860251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205748+0000","last_change":"2024-05-14T09:40:53.664722+0000","last_active":"2024-05-14T09:41:04.205748+0000","last_peered":"2024-05-14T09:41:04.205748+0000","last_clean":"2024-05-14T09:41:04.205748+0000","last_became_active":"2024-05-14T09:40:53.664194+0000","last_became_peered":"2024-05-14T09:40:53.664194+0000","last_unstale":"2024-05-14T09:41:04.205748+0000","last_undegraded":"2024-05-14T09:41:04.205748+0000","last_fullsized":"2024-05-14T09:41:04.205748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:35:57.826557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610449+0000","last_change":"2024-05-14T09:40:45.770662+0000","last_active":"2024-05-14T09:41:04.610449+0000","last_peered":"2024-05-14T09:41:04.610449+0000","last_clean":"2024-05-14T09:41:04.610449+0000","last_became_active":"2024-05-14T09:40:45.768058+0000","last_became_peered":"2024-05-14T09:40:45.768058+0000","last_unstale":"2024-05-14T09:41:04.610449+0000","last_undegraded":"2024-05-14T09:41:04.610449+0000","last_fullsized":"2024-05-14T09:41:04.610449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:13.296625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'12","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.546757+0000","last_change":"2024-05-14T09:40:43.113989+0000","last_active":"2024-05-14T09:41:27.546757+0000","last_peered":"2024-05-14T09:41:27.546757+0000","last_clean":"2024-05-14T09:41:27.546757+0000","last_became_active":"2024-05-14T09:40:43.113589+0000","last_became_peered":"2024-05-14T09:40:43.113589+0000","last_unstale":"2024-05-14T09:41:27.546757+0000","last_undegraded":"2024-05-14T09:41:27.546757+0000","last_fullsized":"2024-05-14T09:41:27.546757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:42:17.351523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.246643+0000","last_change":"2024-05-14T09:40:53.663887+0000","last_active":"2024-05-14T09:41:04.246643+0000","last_peered":"2024-05-14T09:41:04.246643+0000","last_clean":"2024-05-14T09:41:04.246643+0000","last_became_active":"2024-05-14T09:40:53.663419+0000","last_became_peered":"2024-05-14T09:40:53.663419+0000","last_unstale":"2024-05-14T09:41:04.246643+0000","last_undegraded":"2024-05-14T09:41:04.246643+0000","last_fullsized":"2024-05-14T09:41:04.246643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:18.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196203+0000","last_change":"2024-05-14T09:40:45.767184+0000","last_active":"2024-05-14T09:41:04.196203+0000","last_peered":"2024-05-14T09:41:04.196203+0000","last_clean":"2024-05-14T09:41:04.196203+0000","last_became_active":"2024-05-14T09:40:45.766784+0000","last_became_peered":"2024-05-14T09:40:45.766784+0000","last_unstale":"2024-05-14T09:41:04.196203+0000","last_undegraded":"2024-05-14T09:41:04.196203+0000","last_fullsized":"2024-05-14T09:41:04.196203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247559+0000","last_change":"2024-05-14T09:40:43.089869+0000","last_active":"2024-05-14T09:41:04.247559+0000","last_peered":"2024-05-14T09:41:04.247559+0000","last_clean":"2024-05-14T09:41:04.247559+0000","last_became_active":"2024-05-14T09:40:43.088906+0000","last_became_peered":"2024-05-14T09:40:43.088906+0000","last_unstale":"2024-05-14T09:41:04.247559+0000","last_undegraded":"2024-05-14T09:41:04.247559+0000","last_fullsized":"2024-05-14T09:41:04.247559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:28.223322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193385+0000","last_change":"2024-05-14T09:40:53.667412+0000","last_active":"2024-05-14T09:41:04.193385+0000","last_peered":"2024-05-14T09:41:04.193385+0000","last_clean":"2024-05-14T09:41:04.193385+0000","last_became_active":"2024-05-14T09:40:53.666533+0000","last_became_peered":"2024-05-14T09:40:53.666533+0000","last_unstale":"2024-05-14T09:41:04.193385+0000","last_undegraded":"2024-05-14T09:41:04.193385+0000","last_fullsized":"2024-05-14T09:41:04.193385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:53:41.310701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.250664+0000","last_change":"2024-05-14T09:41:04.250664+0000","last_active":"2024-05-14T09:41:04.250664+0000","last_peered":"2024-05-14T09:41:04.250664+0000","last_clean":"2024-05-14T09:41:04.250664+0000","last_became_active":"2024-05-14T09:41:04.250043+0000","last_became_peered":"2024-05-14T09:41:04.250043+0000","last_unstale":"2024-05-14T09:41:04.250664+0000","last_undegraded":"2024-05-14T09:41:04.250664+0000","last_fullsized":"2024-05-14T09:41:04.250664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:46:49.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.542416+0000","last_change":"2024-05-14T09:40:43.116130+0000","last_active":"2024-05-14T09:41:27.542416+0000","last_peered":"2024-05-14T09:41:27.542416+0000","last_clean":"2024-05-14T09:41:27.542416+0000","last_became_active":"2024-05-14T09:40:43.115741+0000","last_became_peered":"2024-05-14T09:40:43.115741+0000","last_unstale":"2024-05-14T09:41:27.542416+0000","last_undegraded":"2024-05-14T09:41:27.542416+0000","last_fullsized":"2024-05-14T09:41:27.542416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:35.083285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196132+0000","last_change":"2024-05-14T09:40:53.667088+0000","last_active":"2024-05-14T09:41:04.196132+0000","last_peered":"2024-05-14T09:41:04.196132+0000","last_clean":"2024-05-14T09:41:04.196132+0000","last_became_active":"2024-05-14T09:40:53.662581+0000","last_became_peered":"2024-05-14T09:40:53.662581+0000","last_unstale":"2024-05-14T09:41:04.196132+0000","last_undegraded":"2024-05-14T09:41:04.196132+0000","last_fullsized":"2024-05-14T09:41:04.196132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:14:18.824424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204868+0000","last_change":"2024-05-14T09:40:45.774302+0000","last_active":"2024-05-14T09:41:04.204868+0000","last_peered":"2024-05-14T09:41:04.204868+0000","last_clean":"2024-05-14T09:41:04.204868+0000","last_became_active":"2024-05-14T09:40:45.773879+0000","last_became_peered":"2024-05-14T09:40:45.773879+0000","last_unstale":"2024-05-14T09:41:04.204868+0000","last_undegraded":"2024-05-14T09:41:04.204868+0000","last_fullsized":"2024-05-14T09:41:04.204868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:09.921679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.549532+0000","last_change":"2024-05-14T09:40:43.116616+0000","last_active":"2024-05-14T09:41:27.549532+0000","last_peered":"2024-05-14T09:41:27.549532+0000","last_clean":"2024-05-14T09:41:27.549532+0000","last_became_active":"2024-05-14T09:40:43.115166+0000","last_became_peered":"2024-05-14T09:40:43.115166+0000","last_unstale":"2024-05-14T09:41:27.549532+0000","last_undegraded":"2024-05-14T09:41:27.549532+0000","last_fullsized":"2024-05-14T09:41:27.549532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:52.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196032+0000","last_change":"2024-05-14T09:40:53.668423+0000","last_active":"2024-05-14T09:41:04.196032+0000","last_peered":"2024-05-14T09:41:04.196032+0000","last_clean":"2024-05-14T09:41:04.196032+0000","last_became_active":"2024-05-14T09:40:53.664838+0000","last_became_peered":"2024-05-14T09:40:53.664838+0000","last_unstale":"2024-05-14T09:41:04.196032+0000","last_undegraded":"2024-05-14T09:41:04.196032+0000","last_fullsized":"2024-05-14T09:41:04.196032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:00:35.633754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204241+0000","last_change":"2024-05-14T09:40:53.656095+0000","last_active":"2024-05-14T09:41:04.204241+0000","last_peered":"2024-05-14T09:41:04.204241+0000","last_clean":"2024-05-14T09:41:04.204241+0000","last_became_active":"2024-05-14T09:40:53.655439+0000","last_became_peered":"2024-05-14T09:40:53.655439+0000","last_unstale":"2024-05-14T09:41:04.204241+0000","last_undegraded":"2024-05-14T09:41:04.204241+0000","last_fullsized":"2024-05-14T09:41:04.204241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:44.521319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245578+0000","last_change":"2024-05-14T09:40:45.744447+0000","last_active":"2024-05-14T09:41:04.245578+0000","last_peered":"2024-05-14T09:41:04.245578+0000","last_clean":"2024-05-14T09:41:04.245578+0000","last_became_active":"2024-05-14T09:40:45.743611+0000","last_became_peered":"2024-05-14T09:40:45.743611+0000","last_unstale":"2024-05-14T09:41:04.245578+0000","last_undegraded":"2024-05-14T09:41:04.245578+0000","last_fullsized":"2024-05-14T09:41:04.245578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:56.519183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203943+0000","last_change":"2024-05-14T09:40:43.122005+0000","last_active":"2024-05-14T09:41:04.203943+0000","last_peered":"2024-05-14T09:41:04.203943+0000","last_clean":"2024-05-14T09:41:04.203943+0000","last_became_active":"2024-05-14T09:40:43.121629+0000","last_became_peered":"2024-05-14T09:40:43.121629+0000","last_unstale":"2024-05-14T09:41:04.203943+0000","last_undegraded":"2024-05-14T09:41:04.203943+0000","last_fullsized":"2024-05-14T09:41:04.203943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:31:03.016812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596267+0000","last_change":"2024-05-14T09:40:53.679415+0000","last_active":"2024-05-14T09:41:04.596267+0000","last_peered":"2024-05-14T09:41:04.596267+0000","last_clean":"2024-05-14T09:41:04.596267+0000","last_became_active":"2024-05-14T09:40:53.678851+0000","last_became_peered":"2024-05-14T09:40:53.678851+0000","last_unstale":"2024-05-14T09:41:04.596267+0000","last_undegraded":"2024-05-14T09:41:04.596267+0000","last_fullsized":"2024-05-14T09:41:04.596267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:48.049763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196225+0000","last_change":"2024-05-14T09:40:45.743111+0000","last_active":"2024-05-14T09:41:04.196225+0000","last_peered":"2024-05-14T09:41:04.196225+0000","last_clean":"2024-05-14T09:41:04.196225+0000","last_became_active":"2024-05-14T09:40:45.742702+0000","last_became_peered":"2024-05-14T09:40:45.742702+0000","last_unstale":"2024-05-14T09:41:04.196225+0000","last_undegraded":"2024-05-14T09:41:04.196225+0000","last_fullsized":"2024-05-14T09:41:04.196225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:17:39.673477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.682978+0000","last_change":"2024-05-14T09:40:43.116535+0000","last_active":"2024-05-14T09:41:30.682978+0000","last_peered":"2024-05-14T09:41:30.682978+0000","last_clean":"2024-05-14T09:41:30.682978+0000","last_became_active":"2024-05-14T09:40:43.115860+0000","last_became_peered":"2024-05-14T09:40:43.115860+0000","last_unstale":"2024-05-14T09:41:30.682978+0000","last_undegraded":"2024-05-14T09:41:30.682978+0000","last_fullsized":"2024-05-14T09:41:30.682978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.897871+0000","last_change":"2024-05-14T09:40:43.120700+0000","last_active":"2024-05-14T09:41:30.897871+0000","last_peered":"2024-05-14T09:41:30.897871+0000","last_clean":"2024-05-14T09:41:30.897871+0000","last_became_active":"2024-05-14T09:40:43.120353+0000","last_became_peered":"2024-05-14T09:40:43.120353+0000","last_unstale":"2024-05-14T09:41:30.897871+0000","last_undegraded":"2024-05-14T09:41:30.897871+0000","last_fullsized":"2024-05-14T09:41:30.897871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:35.425012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203768+0000","last_change":"2024-05-14T09:40:45.758385+0000","last_active":"2024-05-14T09:41:04.203768+0000","last_peered":"2024-05-14T09:41:04.203768+0000","last_clean":"2024-05-14T09:41:04.203768+0000","last_became_active":"2024-05-14T09:40:45.758017+0000","last_became_peered":"2024-05-14T09:40:45.758017+0000","last_unstale":"2024-05-14T09:41:04.203768+0000","last_undegraded":"2024-05-14T09:41:04.203768+0000","last_fullsized":"2024-05-14T09:41:04.203768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.210781+0000","last_change":"2024-05-14T09:40:53.671995+0000","last_active":"2024-05-14T09:41:04.210781+0000","last_peered":"2024-05-14T09:41:04.210781+0000","last_clean":"2024-05-14T09:41:04.210781+0000","last_became_active":"2024-05-14T09:40:53.671145+0000","last_became_peered":"2024-05-14T09:40:53.671145+0000","last_unstale":"2024-05-14T09:41:04.210781+0000","last_undegraded":"2024-05-14T09:41:04.210781+0000","last_fullsized":"2024-05-14T09:41:04.210781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:02.991096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'5","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.652423+0000","last_change":"2024-05-14T09:40:43.105812+0000","last_active":"2024-05-14T09:41:27.652423+0000","last_peered":"2024-05-14T09:41:27.652423+0000","last_clean":"2024-05-14T09:41:27.652423+0000","last_became_active":"2024-05-14T09:40:43.104821+0000","last_became_peered":"2024-05-14T09:40:43.104821+0000","last_unstale":"2024-05-14T09:41:27.652423+0000","last_undegraded":"2024-05-14T09:41:27.652423+0000","last_fullsized":"2024-05-14T09:41:27.652423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193448+0000","last_change":"2024-05-14T09:40:45.746294+0000","last_active":"2024-05-14T09:41:04.193448+0000","last_peered":"2024-05-14T09:41:04.193448+0000","last_clean":"2024-05-14T09:41:04.193448+0000","last_became_active":"2024-05-14T09:40:45.745850+0000","last_became_peered":"2024-05-14T09:40:45.745850+0000","last_unstale":"2024-05-14T09:41:04.193448+0000","last_undegraded":"2024-05-14T09:41:04.193448+0000","last_fullsized":"2024-05-14T09:41:04.193448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:17.774486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197287+0000","last_change":"2024-05-14T09:40:53.670990+0000","last_active":"2024-05-14T09:41:04.197287+0000","last_peered":"2024-05-14T09:41:04.197287+0000","last_clean":"2024-05-14T09:41:04.197287+0000","last_became_active":"2024-05-14T09:40:53.669094+0000","last_became_peered":"2024-05-14T09:40:53.669094+0000","last_unstale":"2024-05-14T09:41:04.197287+0000","last_undegraded":"2024-05-14T09:41:04.197287+0000","last_fullsized":"2024-05-14T09:41:04.197287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:35:15.483140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594603+0000","last_change":"2024-05-14T09:40:45.754615+0000","last_active":"2024-05-14T09:41:04.594603+0000","last_peered":"2024-05-14T09:41:04.594603+0000","last_clean":"2024-05-14T09:41:04.594603+0000","last_became_active":"2024-05-14T09:40:45.754283+0000","last_became_peered":"2024-05-14T09:40:45.754283+0000","last_unstale":"2024-05-14T09:41:04.594603+0000","last_undegraded":"2024-05-14T09:41:04.594603+0000","last_fullsized":"2024-05-14T09:41:04.594603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211227+0000","last_change":"2024-05-14T09:40:45.753218+0000","last_active":"2024-05-14T09:41:04.211227+0000","last_peered":"2024-05-14T09:41:04.211227+0000","last_clean":"2024-05-14T09:41:04.211227+0000","last_became_active":"2024-05-14T09:40:45.752599+0000","last_became_peered":"2024-05-14T09:40:45.752599+0000","last_unstale":"2024-05-14T09:41:04.211227+0000","last_undegraded":"2024-05-14T09:41:04.211227+0000","last_fullsized":"2024-05-14T09:41:04.211227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205092+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T09:41:04.205092+0000","last_peered":"2024-05-14T09:41:04.205092+0000","last_clean":"2024-05-14T09:41:04.205092+0000","last_became_active":"2024-05-14T09:40:45.750387+0000","last_became_peered":"2024-05-14T09:40:45.750387+0000","last_unstale":"2024-05-14T09:41:04.205092+0000","last_undegraded":"2024-05-14T09:41:04.205092+0000","last_fullsized":"2024-05-14T09:41:04.205092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:54.689111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.251002+0000","last_change":"2024-05-14T09:41:04.251002+0000","last_active":"2024-05-14T09:41:04.251002+0000","last_peered":"2024-05-14T09:41:04.251002+0000","last_clean":"2024-05-14T09:41:04.251002+0000","last_became_active":"2024-05-14T09:41:04.250037+0000","last_became_peered":"2024-05-14T09:41:04.250037+0000","last_unstale":"2024-05-14T09:41:04.251002+0000","last_undegraded":"2024-05-14T09:41:04.251002+0000","last_fullsized":"2024-05-14T09:41:04.251002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:42:35.669137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197833+0000","last_change":"2024-05-14T09:40:45.723956+0000","last_active":"2024-05-14T09:41:04.197833+0000","last_peered":"2024-05-14T09:41:04.197833+0000","last_clean":"2024-05-14T09:41:04.197833+0000","last_became_active":"2024-05-14T09:40:45.723040+0000","last_became_peered":"2024-05-14T09:40:45.723040+0000","last_unstale":"2024-05-14T09:41:04.197833+0000","last_undegraded":"2024-05-14T09:41:04.197833+0000","last_fullsized":"2024-05-14T09:41:04.197833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:45.690725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247145+0000","last_change":"2024-05-14T09:40:45.746942+0000","last_active":"2024-05-14T09:41:04.247145+0000","last_peered":"2024-05-14T09:41:04.247145+0000","last_clean":"2024-05-14T09:41:04.247145+0000","last_became_active":"2024-05-14T09:40:45.745393+0000","last_became_peered":"2024-05-14T09:40:45.745393+0000","last_unstale":"2024-05-14T09:41:04.247145+0000","last_undegraded":"2024-05-14T09:41:04.247145+0000","last_fullsized":"2024-05-14T09:41:04.247145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:37.377406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595966+0000","last_change":"2024-05-14T09:40:45.772238+0000","last_active":"2024-05-14T09:41:04.595966+0000","last_peered":"2024-05-14T09:41:04.595966+0000","last_clean":"2024-05-14T09:41:04.595966+0000","last_became_active":"2024-05-14T09:40:45.771838+0000","last_became_peered":"2024-05-14T09:40:45.771838+0000","last_unstale":"2024-05-14T09:41:04.595966+0000","last_undegraded":"2024-05-14T09:41:04.595966+0000","last_fullsized":"2024-05-14T09:41:04.595966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198586+0000","last_change":"2024-05-14T09:40:45.727770+0000","last_active":"2024-05-14T09:41:04.198586+0000","last_peered":"2024-05-14T09:41:04.198586+0000","last_clean":"2024-05-14T09:41:04.198586+0000","last_became_active":"2024-05-14T09:40:45.725283+0000","last_became_peered":"2024-05-14T09:40:45.725283+0000","last_unstale":"2024-05-14T09:41:04.198586+0000","last_undegraded":"2024-05-14T09:41:04.198586+0000","last_fullsized":"2024-05-14T09:41:04.198586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:22.638700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203472+0000","last_change":"2024-05-14T09:40:45.749288+0000","last_active":"2024-05-14T09:41:04.203472+0000","last_peered":"2024-05-14T09:41:04.203472+0000","last_clean":"2024-05-14T09:41:04.203472+0000","last_became_active":"2024-05-14T09:40:45.748925+0000","last_became_peered":"2024-05-14T09:40:45.748925+0000","last_unstale":"2024-05-14T09:41:04.203472+0000","last_undegraded":"2024-05-14T09:41:04.203472+0000","last_fullsized":"2024-05-14T09:41:04.203472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:03.576418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196797+0000","last_change":"2024-05-14T09:40:45.724197+0000","last_active":"2024-05-14T09:41:04.196797+0000","last_peered":"2024-05-14T09:41:04.196797+0000","last_clean":"2024-05-14T09:41:04.196797+0000","last_became_active":"2024-05-14T09:40:45.723317+0000","last_became_peered":"2024-05-14T09:40:45.723317+0000","last_unstale":"2024-05-14T09:41:04.196797+0000","last_undegraded":"2024-05-14T09:41:04.196797+0000","last_fullsized":"2024-05-14T09:41:04.196797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204963+0000","last_change":"2024-05-14T09:40:45.770723+0000","last_active":"2024-05-14T09:41:04.204963+0000","last_peered":"2024-05-14T09:41:04.204963+0000","last_clean":"2024-05-14T09:41:04.204963+0000","last_became_active":"2024-05-14T09:40:45.769772+0000","last_became_peered":"2024-05-14T09:40:45.769772+0000","last_unstale":"2024-05-14T09:41:04.204963+0000","last_undegraded":"2024-05-14T09:41:04.204963+0000","last_fullsized":"2024-05-14T09:41:04.204963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:44.852533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203481+0000","last_change":"2024-05-14T09:40:45.766217+0000","last_active":"2024-05-14T09:41:04.203481+0000","last_peered":"2024-05-14T09:41:04.203481+0000","last_clean":"2024-05-14T09:41:04.203481+0000","last_became_active":"2024-05-14T09:40:45.765830+0000","last_became_peered":"2024-05-14T09:40:45.765830+0000","last_unstale":"2024-05-14T09:41:04.203481+0000","last_undegraded":"2024-05-14T09:41:04.203481+0000","last_fullsized":"2024-05-14T09:41:04.203481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594937+0000","last_change":"2024-05-14T09:40:45.760838+0000","last_active":"2024-05-14T09:41:04.594937+0000","last_peered":"2024-05-14T09:41:04.594937+0000","last_clean":"2024-05-14T09:41:04.594937+0000","last_became_active":"2024-05-14T09:40:45.760535+0000","last_became_peered":"2024-05-14T09:40:45.760535+0000","last_unstale":"2024-05-14T09:41:04.594937+0000","last_undegraded":"2024-05-14T09:41:04.594937+0000","last_fullsized":"2024-05-14T09:41:04.594937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610853+0000","last_change":"2024-05-14T09:40:45.778218+0000","last_active":"2024-05-14T09:41:04.610853+0000","last_peered":"2024-05-14T09:41:04.610853+0000","last_clean":"2024-05-14T09:41:04.610853+0000","last_became_active":"2024-05-14T09:40:45.775602+0000","last_became_peered":"2024-05-14T09:40:45.775602+0000","last_unstale":"2024-05-14T09:41:04.610853+0000","last_undegraded":"2024-05-14T09:41:04.610853+0000","last_fullsized":"2024-05-14T09:41:04.610853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:40.574917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211569+0000","last_change":"2024-05-14T09:40:45.748996+0000","last_active":"2024-05-14T09:41:04.211569+0000","last_peered":"2024-05-14T09:41:04.211569+0000","last_clean":"2024-05-14T09:41:04.211569+0000","last_became_active":"2024-05-14T09:40:45.748266+0000","last_became_peered":"2024-05-14T09:40:45.748266+0000","last_unstale":"2024-05-14T09:41:04.211569+0000","last_undegraded":"2024-05-14T09:41:04.211569+0000","last_fullsized":"2024-05-14T09:41:04.211569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.615498+0000","last_change":"2024-05-14T09:41:04.613266+0000","last_active":"2024-05-14T09:41:04.615498+0000","last_peered":"2024-05-14T09:41:04.615498+0000","last_clean":"2024-05-14T09:41:04.615498+0000","last_became_active":"2024-05-14T09:41:04.612160+0000","last_became_peered":"2024-05-14T09:41:04.612160+0000","last_unstale":"2024-05-14T09:41:04.615498+0000","last_undegraded":"2024-05-14T09:41:04.615498+0000","last_fullsized":"2024-05-14T09:41:04.615498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203375+0000","last_change":"2024-05-14T09:40:45.757279+0000","last_active":"2024-05-14T09:41:04.203375+0000","last_peered":"2024-05-14T09:41:04.203375+0000","last_clean":"2024-05-14T09:41:04.203375+0000","last_became_active":"2024-05-14T09:40:45.749692+0000","last_became_peered":"2024-05-14T09:40:45.749692+0000","last_unstale":"2024-05-14T09:41:04.203375+0000","last_undegraded":"2024-05-14T09:41:04.203375+0000","last_fullsized":"2024-05-14T09:41:04.203375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:39:52.486187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245774+0000","last_change":"2024-05-14T09:40:45.744802+0000","last_active":"2024-05-14T09:41:04.245774+0000","last_peered":"2024-05-14T09:41:04.245774+0000","last_clean":"2024-05-14T09:41:04.245774+0000","last_became_active":"2024-05-14T09:40:45.744011+0000","last_became_peered":"2024-05-14T09:40:45.744011+0000","last_unstale":"2024-05-14T09:41:04.245774+0000","last_undegraded":"2024-05-14T09:41:04.245774+0000","last_fullsized":"2024-05-14T09:41:04.245774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:20.468216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205334+0000","last_change":"2024-05-14T09:40:45.757983+0000","last_active":"2024-05-14T09:41:04.205334+0000","last_peered":"2024-05-14T09:41:04.205334+0000","last_clean":"2024-05-14T09:41:04.205334+0000","last_became_active":"2024-05-14T09:40:45.757450+0000","last_became_peered":"2024-05-14T09:40:45.757450+0000","last_unstale":"2024-05-14T09:41:04.205334+0000","last_undegraded":"2024-05-14T09:41:04.205334+0000","last_fullsized":"2024-05-14T09:41:04.205334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:07.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197114+0000","last_change":"2024-05-14T09:40:45.745021+0000","last_active":"2024-05-14T09:41:04.197114+0000","last_peered":"2024-05-14T09:41:04.197114+0000","last_clean":"2024-05-14T09:41:04.197114+0000","last_became_active":"2024-05-14T09:40:45.744550+0000","last_became_peered":"2024-05-14T09:40:45.744550+0000","last_unstale":"2024-05-14T09:41:04.197114+0000","last_undegraded":"2024-05-14T09:41:04.197114+0000","last_fullsized":"2024-05-14T09:41:04.197114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195987+0000","last_change":"2024-05-14T09:40:45.749109+0000","last_active":"2024-05-14T09:41:04.195987+0000","last_peered":"2024-05-14T09:41:04.195987+0000","last_clean":"2024-05-14T09:41:04.195987+0000","last_became_active":"2024-05-14T09:40:45.748419+0000","last_became_peered":"2024-05-14T09:40:45.748419+0000","last_unstale":"2024-05-14T09:41:04.195987+0000","last_undegraded":"2024-05-14T09:41:04.195987+0000","last_fullsized":"2024-05-14T09:41:04.195987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.597196+0000","last_change":"2024-05-14T09:40:45.753508+0000","last_active":"2024-05-14T09:41:04.597196+0000","last_peered":"2024-05-14T09:41:04.597196+0000","last_clean":"2024-05-14T09:41:04.597196+0000","last_became_active":"2024-05-14T09:40:45.752982+0000","last_became_peered":"2024-05-14T09:40:45.752982+0000","last_unstale":"2024-05-14T09:41:04.597196+0000","last_undegraded":"2024-05-14T09:41:04.597196+0000","last_fullsized":"2024-05-14T09:41:04.597196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595663+0000","last_change":"2024-05-14T09:40:45.759266+0000","last_active":"2024-05-14T09:41:04.595663+0000","last_peered":"2024-05-14T09:41:04.595663+0000","last_clean":"2024-05-14T09:41:04.595663+0000","last_became_active":"2024-05-14T09:40:45.758912+0000","last_became_peered":"2024-05-14T09:40:45.758912+0000","last_unstale":"2024-05-14T09:41:04.595663+0000","last_undegraded":"2024-05-14T09:41:04.595663+0000","last_fullsized":"2024-05-14T09:41:04.595663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611324+0000","last_change":"2024-05-14T09:40:45.780527+0000","last_active":"2024-05-14T09:41:04.611324+0000","last_peered":"2024-05-14T09:41:04.611324+0000","last_clean":"2024-05-14T09:41:04.611324+0000","last_became_active":"2024-05-14T09:40:45.780197+0000","last_became_peered":"2024-05-14T09:40:45.780197+0000","last_unstale":"2024-05-14T09:41:04.611324+0000","last_undegraded":"2024-05-14T09:41:04.611324+0000","last_fullsized":"2024-05-14T09:41:04.611324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:38.220230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195825+0000","last_change":"2024-05-14T09:40:45.761049+0000","last_active":"2024-05-14T09:41:04.195825+0000","last_peered":"2024-05-14T09:41:04.195825+0000","last_clean":"2024-05-14T09:41:04.195825+0000","last_became_active":"2024-05-14T09:40:45.760738+0000","last_became_peered":"2024-05-14T09:40:45.760738+0000","last_unstale":"2024-05-14T09:41:04.195825+0000","last_undegraded":"2024-05-14T09:41:04.195825+0000","last_fullsized":"2024-05-14T09:41:04.195825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609336+0000","last_change":"2024-05-14T09:40:45.776380+0000","last_active":"2024-05-14T09:41:04.609336+0000","last_peered":"2024-05-14T09:41:04.609336+0000","last_clean":"2024-05-14T09:41:04.609336+0000","last_became_active":"2024-05-14T09:40:45.776005+0000","last_became_peered":"2024-05-14T09:40:45.776005+0000","last_unstale":"2024-05-14T09:41:04.609336+0000","last_undegraded":"2024-05-14T09:41:04.609336+0000","last_fullsized":"2024-05-14T09:41:04.609336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:27.969792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.219398+0000","last_change":"2024-05-14T09:41:04.214552+0000","last_active":"2024-05-14T09:41:04.219398+0000","last_peered":"2024-05-14T09:41:04.219398+0000","last_clean":"2024-05-14T09:41:04.219398+0000","last_became_active":"2024-05-14T09:41:04.213721+0000","last_became_peered":"2024-05-14T09:41:04.213721+0000","last_unstale":"2024-05-14T09:41:04.219398+0000","last_undegraded":"2024-05-14T09:41:04.219398+0000","last_fullsized":"2024-05-14T09:41:04.219398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609591+0000","last_change":"2024-05-14T09:40:45.776955+0000","last_active":"2024-05-14T09:41:04.609591+0000","last_peered":"2024-05-14T09:41:04.609591+0000","last_clean":"2024-05-14T09:41:04.609591+0000","last_became_active":"2024-05-14T09:40:45.775953+0000","last_became_peered":"2024-05-14T09:40:45.775953+0000","last_unstale":"2024-05-14T09:41:04.609591+0000","last_undegraded":"2024-05-14T09:41:04.609591+0000","last_fullsized":"2024-05-14T09:41:04.609591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:13.534273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204293+0000","last_change":"2024-05-14T09:40:45.750766+0000","last_active":"2024-05-14T09:41:04.204293+0000","last_peered":"2024-05-14T09:41:04.204293+0000","last_clean":"2024-05-14T09:41:04.204293+0000","last_became_active":"2024-05-14T09:40:45.750416+0000","last_became_peered":"2024-05-14T09:40:45.750416+0000","last_unstale":"2024-05-14T09:41:04.204293+0000","last_undegraded":"2024-05-14T09:41:04.204293+0000","last_fullsized":"2024-05-14T09:41:04.204293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:29:30.022171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204845+0000","last_change":"2024-05-14T09:40:45.748573+0000","last_active":"2024-05-14T09:41:04.204845+0000","last_peered":"2024-05-14T09:41:04.204845+0000","last_clean":"2024-05-14T09:41:04.204845+0000","last_became_active":"2024-05-14T09:40:45.746640+0000","last_became_peered":"2024-05-14T09:40:45.746640+0000","last_unstale":"2024-05-14T09:41:04.204845+0000","last_undegraded":"2024-05-14T09:41:04.204845+0000","last_fullsized":"2024-05-14T09:41:04.204845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247941+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T09:41:04.247941+0000","last_peered":"2024-05-14T09:41:04.247941+0000","last_clean":"2024-05-14T09:41:04.247941+0000","last_became_active":"2024-05-14T09:40:45.752589+0000","last_became_peered":"2024-05-14T09:40:45.752589+0000","last_unstale":"2024-05-14T09:41:04.247941+0000","last_undegraded":"2024-05-14T09:41:04.247941+0000","last_fullsized":"2024-05-14T09:41:04.247941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:43.043120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611042+0000","last_change":"2024-05-14T09:40:45.771577+0000","last_active":"2024-05-14T09:41:04.611042+0000","last_peered":"2024-05-14T09:41:04.611042+0000","last_clean":"2024-05-14T09:41:04.611042+0000","last_became_active":"2024-05-14T09:40:45.771228+0000","last_became_peered":"2024-05-14T09:40:45.771228+0000","last_unstale":"2024-05-14T09:41:04.611042+0000","last_undegraded":"2024-05-14T09:41:04.611042+0000","last_fullsized":"2024-05-14T09:41:04.611042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:36.361964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476757,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":153123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476759,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":149317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":16,"seq":68719476760,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":153157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476756,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":149421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476756,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":962560,"data_stored":739631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":966656,"data_stored":740287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":149981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":149547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T09:41:43.395 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T09:41:43.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.700+0000 7f331c600640 1 Processor -- start 2024-05-14T09:41:43.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.700+0000 7f331c600640 1 -- start start 2024-05-14T09:41:43.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.703+0000 7f331c600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3314071de0 0x7f33141532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:43.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.703+0000 7f331c600640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33140c5590 con 0x7f33140c6570 2024-05-14T09:41:43.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.703+0000 7f331c600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33140c6980 con 0x7f33140c6160 2024-05-14T09:41:43.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.703+0000 7f331c600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f331415d4d0 con 0x7f3314071de0 2024-05-14T09:41:43.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.704+0000 7f331a600640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f33140c6570 0x7f331415cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:41540/0 (socket says 172.21.15.135:41540) 2024-05-14T09:41:43.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.704+0000 7f331a600640 1 -- 172.21.15.135:0/3083936194 learned_addr learned my addr 172.21.15.135:0/3083936194 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:43.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.707+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2501635111 0 0) 0x7f33140c5590 con 0x7f33140c6570 2024-05-14T09:41:43.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.707+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32fc005730 con 0x7f33140c6570 2024-05-14T09:41:43.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.712+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 868829194 0 0) 0x7f32fc005730 con 0x7f33140c6570 2024-05-14T09:41:43.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.712+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 >> v2:172.21.15.196:3300/0 conn(0x7f3314071de0 msgr2=0x7f33141532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:43.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.712+0000 7f3313e00640 1 --2- 172.21.15.135:0/3083936194 >> v2:172.21.15.196:3300/0 conn(0x7f3314071de0 0x7f33141532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:43.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.712+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 >> v1:172.21.15.196:6789/0 conn(0x7f33140c6160 legacy=0x7f331415c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:43.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.712+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33140c52b0 con 0x7f33140c6570 2024-05-14T09:41:43.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.712+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f330c001a70 con 0x7f33140c6570 2024-05-14T09:41:43.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.712+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 >> v1:172.21.15.135:6789/0 conn(0x7f33140c6570 legacy=0x7f331415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:43.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.713+0000 7f3313e00640 1 --2- 172.21.15.135:0/3083936194 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32fc005c60 0x7f32fc0060b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:43.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.713+0000 7f3313e00640 1 --2- 172.21.15.135:0/3083936194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 0x7f32fc006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:43.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.713+0000 7f3313e00640 1 --2- 172.21.15.135:0/3083936194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32fc007600 0x7f32fc00dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:43.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.713+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f331415d4d0 con 0x7f32fc006a10 2024-05-14T09:41:43.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.713+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc00e560 con 0x7f32fc007600 2024-05-14T09:41:43.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.713+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f32fc00e760 con 0x7f32fc005c60 2024-05-14T09:41:43.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.715+0000 7f3319c00640 1 --2- 172.21.15.135:0/3083936194 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32fc005c60 0x7f32fc0060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:43.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.717+0000 7f3319200640 1 --2- 172.21.15.135:0/3083936194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 0x7f32fc006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:43.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.722+0000 7f3319200640 1 -- 172.21.15.135:0/3083936194 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32fc005c60 msgr2=0x7f32fc0060b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:43.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.722+0000 7f3319200640 1 --2- 172.21.15.135:0/3083936194 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32fc005c60 0x7f32fc0060b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:43.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.722+0000 7f3319200640 1 -- 172.21.15.135:0/3083936194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32fc007600 msgr2=0x7f32fc00dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:43.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.722+0000 7f3319200640 1 --2- 172.21.15.135:0/3083936194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32fc007600 0x7f32fc00dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:43.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.722+0000 7f3319200640 1 -- 172.21.15.135:0/3083936194 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32fc005730 con 0x7f32fc006a10 2024-05-14T09:41:43.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.722+0000 7f331a600640 1 -- 172.21.15.135:0/3083936194 reap_dead start 2024-05-14T09:41:43.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.724+0000 7f3319200640 1 --2- 172.21.15.135:0/3083936194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 0x7f32fc006e20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3300001640 tx=0x7f32fc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e23ec26f83b8f06 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:43.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.731+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300001240 con 0x7f32fc006a10 2024-05-14T09:41:43.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.731+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330002e070 con 0x7f32fc006a10 2024-05-14T09:41:43.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.731+0000 7f3313e00640 1 -- 172.21.15.135:0/3083936194 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330002a7c0 con 0x7f32fc006a10 2024-05-14T09:41:43.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.732+0000 7f331c600640 1 -- 172.21.15.135:0/3083936194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 msgr2=0x7f32fc006e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:43.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.732+0000 7f331c600640 1 --2- 172.21.15.135:0/3083936194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 0x7f32fc006e20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3300001640 tx=0x7f32fc007a40 comp rx=0 tx=0).stop 2024-05-14T09:41:43.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.732+0000 7f331c600640 1 -- 172.21.15.135:0/3083936194 shutdown_connections 2024-05-14T09:41:43.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.732+0000 7f331c600640 1 --2- 172.21.15.135:0/3083936194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 0x7f32fc006e20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:43.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.732+0000 7f331c600640 1 -- 172.21.15.135:0/3083936194 >> 172.21.15.135:0/3083936194 conn(0x7f3314073cf0 msgr2=0x7f3314074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:43.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.733+0000 7f331c600640 1 -- 172.21.15.135:0/3083936194 shutdown_connections 2024-05-14T09:41:43.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.733+0000 7f331c600640 1 -- 172.21.15.135:0/3083936194 wait complete. 2024-05-14T09:41:43.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.737+0000 7f331c600640 1 Processor -- start 2024-05-14T09:41:43.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.737+0000 7f331c600640 1 -- start start 2024-05-14T09:41:43.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.739+0000 7f331c600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 0x7f33140cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:43.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.739+0000 7f331c600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f331415a9c0 0x7f3314155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:43.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.740+0000 7f331c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f331414a070 0x7f33141e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:43.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.740+0000 7f331c600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f331406c790 con 0x7f32fc006a10 2024-05-14T09:41:43.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.740+0000 7f331c600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3314074c00 con 0x7f331415a9c0 2024-05-14T09:41:43.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.740+0000 7f331c600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f33140c4c40 con 0x7f331414a070 2024-05-14T09:41:43.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.741+0000 7f3319c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 0x7f33140cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:43.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.741+0000 7f3319c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 0x7f33140cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56270/0 (socket says 172.21.15.135:56270) 2024-05-14T09:41:43.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.741+0000 7f3319c00640 1 -- 172.21.15.135:0/396502689 learned_addr learned my addr 172.21.15.135:0/396502689 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:43.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.742+0000 7f331a600640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f331414a070 0x7f33141e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:43.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.746+0000 7f3319c00640 1 -- 172.21.15.135:0/396502689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f331414a070 msgr2=0x7f33141e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:43.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.746+0000 7f3319c00640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f331414a070 0x7f33141e9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:43.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.746+0000 7f3319c00640 1 -- 172.21.15.135:0/396502689 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f331415a9c0 msgr2=0x7f3314155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:43.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.746+0000 7f3319c00640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f331415a9c0 0x7f3314155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:43.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.746+0000 7f3319c00640 1 -- 172.21.15.135:0/396502689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331415af40 con 0x7f32fc006a10 2024-05-14T09:41:43.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.749+0000 7f3319c00640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 0x7f33140cb380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f330800e870 tx=0x7f330800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:43.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.780+0000 7f3311600640 1 -- 172.21.15.135:0/396502689 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3308017070 con 0x7f32fc006a10 2024-05-14T09:41:43.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.780+0000 7f3311600640 1 -- 172.21.15.135:0/396502689 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330800ee60 con 0x7f32fc006a10 2024-05-14T09:41:43.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.781+0000 7f3311600640 1 -- 172.21.15.135:0/396502689 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330800cb60 con 0x7f32fc006a10 2024-05-14T09:41:43.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.781+0000 7f331c600640 1 -- 172.21.15.135:0/396502689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f331415b700 con 0x7f32fc006a10 2024-05-14T09:41:43.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.781+0000 7f331c600640 1 -- 172.21.15.135:0/396502689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f331415cf70 con 0x7f32fc006a10 2024-05-14T09:41:43.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.782+0000 7f331c600640 1 -- 172.21.15.135:0/396502689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3314069a90 con 0x7f32fc006a10 2024-05-14T09:41:43.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.809+0000 7f3311600640 1 -- 172.21.15.135:0/396502689 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f330801a070 con 0x7f32fc006a10 2024-05-14T09:41:43.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.811+0000 7f3311600640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f32f4076350 0x7f32f4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:43.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.812+0000 7f3319200640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f32f4076350 0x7f32f4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:43.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.814+0000 7f3319200640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f32f4076350 0x7f32f4078860 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3300032000 tx=0x7f330002c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:43.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:43.814+0000 7f3311600640 1 -- 172.21.15.135:0/396502689 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f330800cd00 con 0x7f32fc006a10 2024-05-14T09:41:44.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.118+0000 7f3311600640 1 -- 172.21.15.135:0/396502689 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3308060f00 con 0x7f32fc006a10 2024-05-14T09:41:44.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.332+0000 7f331c600640 1 -- 172.21.15.135:0/396502689 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f331415c620 con 0x7f32f4076350 2024-05-14T09:41:44.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.345+0000 7f3311600640 1 -- 172.21.15.135:0/396502689 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332587 (secure 0 0 0) 0x7f330002e050 con 0x7f32f4076350 2024-05-14T09:41:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:44.351 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 -- 172.21.15.135:0/396502689 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f32f4076350 msgr2=0x7f32f4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f32f4076350 0x7f32f4078860 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3300032000 tx=0x7f330002c000 comp rx=0 tx=0).stop 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 -- 172.21.15.135:0/396502689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 msgr2=0x7f33140cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 0x7f33140cb380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f330800e870 tx=0x7f330800ed30 comp rx=0 tx=0).stop 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 -- 172.21.15.135:0/396502689 shutdown_connections 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f32f4076350 0x7f32f4078860 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f331415a9c0 0x7f3314155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f331414a070 0x7f33141e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 --2- 172.21.15.135:0/396502689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32fc006a10 0x7f33140cb380 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 -- 172.21.15.135:0/396502689 >> 172.21.15.135:0/396502689 conn(0x7f3314073cf0 msgr2=0x7f3314152320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 -- 172.21.15.135:0/396502689 shutdown_connections 2024-05-14T09:41:44.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.352+0000 7f331c600640 1 -- 172.21.15.135:0/396502689 wait complete. 2024-05-14T09:41:44.379 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-05-14T09:41:42.352988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":230,"num_write_kb":1671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220200,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754520,"statfs":{"total":773094113280,"available":772868628480,"internally_reserved":0,"allocated":4169728,"data_stored":2384464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2118,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005553"},"pg_stats":[{"pgid":"2.1f","version":"33'9","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.861707+0000","last_change":"2024-05-14T09:40:43.106486+0000","last_active":"2024-05-14T09:41:30.861707+0000","last_peered":"2024-05-14T09:41:30.861707+0000","last_clean":"2024-05-14T09:41:30.861707+0000","last_became_active":"2024-05-14T09:40:43.105731+0000","last_became_peered":"2024-05-14T09:40:43.105731+0000","last_unstale":"2024-05-14T09:41:30.861707+0000","last_undegraded":"2024-05-14T09:41:30.861707+0000","last_fullsized":"2024-05-14T09:41:30.861707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:32:09.735265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197157+0000","last_change":"2024-05-14T09:40:45.750103+0000","last_active":"2024-05-14T09:41:04.197157+0000","last_peered":"2024-05-14T09:41:04.197157+0000","last_clean":"2024-05-14T09:41:04.197157+0000","last_became_active":"2024-05-14T09:40:45.747865+0000","last_became_peered":"2024-05-14T09:40:45.747865+0000","last_unstale":"2024-05-14T09:41:04.197157+0000","last_undegraded":"2024-05-14T09:41:04.197157+0000","last_fullsized":"2024-05-14T09:41:04.197157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:06.549076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195817+0000","last_change":"2024-05-14T09:40:53.664918+0000","last_active":"2024-05-14T09:41:04.195817+0000","last_peered":"2024-05-14T09:41:04.195817+0000","last_clean":"2024-05-14T09:41:04.195817+0000","last_became_active":"2024-05-14T09:40:53.664366+0000","last_became_peered":"2024-05-14T09:40:53.664366+0000","last_unstale":"2024-05-14T09:41:04.195817+0000","last_undegraded":"2024-05-14T09:41:04.195817+0000","last_fullsized":"2024-05-14T09:41:04.195817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:20:52.204134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198009+0000","last_change":"2024-05-14T09:40:43.101185+0000","last_active":"2024-05-14T09:41:04.198009+0000","last_peered":"2024-05-14T09:41:04.198009+0000","last_clean":"2024-05-14T09:41:04.198009+0000","last_became_active":"2024-05-14T09:40:43.098862+0000","last_became_peered":"2024-05-14T09:40:43.098862+0000","last_unstale":"2024-05-14T09:41:04.198009+0000","last_undegraded":"2024-05-14T09:41:04.198009+0000","last_fullsized":"2024-05-14T09:41:04.198009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203770+0000","last_change":"2024-05-14T09:40:45.752960+0000","last_active":"2024-05-14T09:41:04.203770+0000","last_peered":"2024-05-14T09:41:04.203770+0000","last_clean":"2024-05-14T09:41:04.203770+0000","last_became_active":"2024-05-14T09:40:45.752627+0000","last_became_peered":"2024-05-14T09:40:45.752627+0000","last_unstale":"2024-05-14T09:41:04.203770+0000","last_undegraded":"2024-05-14T09:41:04.203770+0000","last_fullsized":"2024-05-14T09:41:04.203770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.192616+0000","last_change":"2024-05-14T09:40:53.662032+0000","last_active":"2024-05-14T09:41:04.192616+0000","last_peered":"2024-05-14T09:41:04.192616+0000","last_clean":"2024-05-14T09:41:04.192616+0000","last_became_active":"2024-05-14T09:40:53.661453+0000","last_became_peered":"2024-05-14T09:40:53.661453+0000","last_unstale":"2024-05-14T09:41:04.192616+0000","last_undegraded":"2024-05-14T09:41:04.192616+0000","last_fullsized":"2024-05-14T09:41:04.192616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:11.724866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.692297+0000","last_change":"2024-05-14T09:40:43.114965+0000","last_active":"2024-05-14T09:41:30.692297+0000","last_peered":"2024-05-14T09:41:30.692297+0000","last_clean":"2024-05-14T09:41:30.692297+0000","last_became_active":"2024-05-14T09:40:43.114379+0000","last_became_peered":"2024-05-14T09:40:43.114379+0000","last_unstale":"2024-05-14T09:41:30.692297+0000","last_undegraded":"2024-05-14T09:41:30.692297+0000","last_fullsized":"2024-05-14T09:41:30.692297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:43.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204333+0000","last_change":"2024-05-14T09:40:45.758305+0000","last_active":"2024-05-14T09:41:04.204333+0000","last_peered":"2024-05-14T09:41:04.204333+0000","last_clean":"2024-05-14T09:41:04.204333+0000","last_became_active":"2024-05-14T09:40:45.754110+0000","last_became_peered":"2024-05-14T09:40:45.754110+0000","last_unstale":"2024-05-14T09:41:04.204333+0000","last_undegraded":"2024-05-14T09:41:04.204333+0000","last_fullsized":"2024-05-14T09:41:04.204333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:12:42.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.601574+0000","last_change":"2024-05-14T09:41:04.601574+0000","last_active":"2024-05-14T09:41:04.601574+0000","last_peered":"2024-05-14T09:41:04.601574+0000","last_clean":"2024-05-14T09:41:04.601574+0000","last_became_active":"2024-05-14T09:41:04.599475+0000","last_became_peered":"2024-05-14T09:41:04.599475+0000","last_unstale":"2024-05-14T09:41:04.601574+0000","last_undegraded":"2024-05-14T09:41:04.601574+0000","last_fullsized":"2024-05-14T09:41:04.601574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610183+0000","last_change":"2024-05-14T09:40:43.110296+0000","last_active":"2024-05-14T09:41:04.610183+0000","last_peered":"2024-05-14T09:41:04.610183+0000","last_clean":"2024-05-14T09:41:04.610183+0000","last_became_active":"2024-05-14T09:40:43.109932+0000","last_became_peered":"2024-05-14T09:40:43.109932+0000","last_unstale":"2024-05-14T09:41:04.610183+0000","last_undegraded":"2024-05-14T09:41:04.610183+0000","last_fullsized":"2024-05-14T09:41:04.610183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:29.003048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205871+0000","last_change":"2024-05-14T09:40:45.773110+0000","last_active":"2024-05-14T09:41:04.205871+0000","last_peered":"2024-05-14T09:41:04.205871+0000","last_clean":"2024-05-14T09:41:04.205871+0000","last_became_active":"2024-05-14T09:40:45.770117+0000","last_became_peered":"2024-05-14T09:40:45.770117+0000","last_unstale":"2024-05-14T09:41:04.205871+0000","last_undegraded":"2024-05-14T09:41:04.205871+0000","last_fullsized":"2024-05-14T09:41:04.205871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:28.718450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.192677+0000","last_change":"2024-05-14T09:40:53.652049+0000","last_active":"2024-05-14T09:41:04.192677+0000","last_peered":"2024-05-14T09:41:04.192677+0000","last_clean":"2024-05-14T09:41:04.192677+0000","last_became_active":"2024-05-14T09:40:53.651570+0000","last_became_peered":"2024-05-14T09:40:53.651570+0000","last_unstale":"2024-05-14T09:41:04.192677+0000","last_undegraded":"2024-05-14T09:41:04.192677+0000","last_fullsized":"2024-05-14T09:41:04.192677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:30.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595721+0000","last_change":"2024-05-14T09:40:45.753771+0000","last_active":"2024-05-14T09:41:04.595721+0000","last_peered":"2024-05-14T09:41:04.595721+0000","last_clean":"2024-05-14T09:41:04.595721+0000","last_became_active":"2024-05-14T09:40:45.753319+0000","last_became_peered":"2024-05-14T09:40:45.753319+0000","last_unstale":"2024-05-14T09:41:04.595721+0000","last_undegraded":"2024-05-14T09:41:04.595721+0000","last_fullsized":"2024-05-14T09:41:04.595721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.542521+0000","last_change":"2024-05-14T09:40:43.125708+0000","last_active":"2024-05-14T09:41:27.542521+0000","last_peered":"2024-05-14T09:41:27.542521+0000","last_clean":"2024-05-14T09:41:27.542521+0000","last_became_active":"2024-05-14T09:40:43.125239+0000","last_became_peered":"2024-05-14T09:40:43.125239+0000","last_unstale":"2024-05-14T09:41:27.542521+0000","last_undegraded":"2024-05-14T09:41:27.542521+0000","last_fullsized":"2024-05-14T09:41:27.542521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:22.781125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.194099+0000","last_change":"2024-05-14T09:40:53.663353+0000","last_active":"2024-05-14T09:41:04.194099+0000","last_peered":"2024-05-14T09:41:04.194099+0000","last_clean":"2024-05-14T09:41:04.194099+0000","last_became_active":"2024-05-14T09:40:53.662559+0000","last_became_peered":"2024-05-14T09:40:53.662559+0000","last_unstale":"2024-05-14T09:41:04.194099+0000","last_undegraded":"2024-05-14T09:41:04.194099+0000","last_fullsized":"2024-05-14T09:41:04.194099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:14.708431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197527+0000","last_change":"2024-05-14T09:40:45.751929+0000","last_active":"2024-05-14T09:41:04.197527+0000","last_peered":"2024-05-14T09:41:04.197527+0000","last_clean":"2024-05-14T09:41:04.197527+0000","last_became_active":"2024-05-14T09:40:45.751015+0000","last_became_peered":"2024-05-14T09:40:45.751015+0000","last_unstale":"2024-05-14T09:41:04.197527+0000","last_undegraded":"2024-05-14T09:41:04.197527+0000","last_fullsized":"2024-05-14T09:41:04.197527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:12.550231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247388+0000","last_change":"2024-05-14T09:40:43.023070+0000","last_active":"2024-05-14T09:41:04.247388+0000","last_peered":"2024-05-14T09:41:04.247388+0000","last_clean":"2024-05-14T09:41:04.247388+0000","last_became_active":"2024-05-14T09:40:43.022234+0000","last_became_peered":"2024-05-14T09:40:43.022234+0000","last_unstale":"2024-05-14T09:41:04.247388+0000","last_undegraded":"2024-05-14T09:41:04.247388+0000","last_fullsized":"2024-05-14T09:41:04.247388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:30:06.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.601663+0000","last_change":"2024-05-14T09:41:04.601663+0000","last_active":"2024-05-14T09:41:04.601663+0000","last_peered":"2024-05-14T09:41:04.601663+0000","last_clean":"2024-05-14T09:41:04.601663+0000","last_became_active":"2024-05-14T09:41:04.600186+0000","last_became_peered":"2024-05-14T09:41:04.600186+0000","last_unstale":"2024-05-14T09:41:04.601663+0000","last_undegraded":"2024-05-14T09:41:04.601663+0000","last_fullsized":"2024-05-14T09:41:04.601663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196422+0000","last_change":"2024-05-14T09:40:45.746999+0000","last_active":"2024-05-14T09:41:04.196422+0000","last_peered":"2024-05-14T09:41:04.196422+0000","last_clean":"2024-05-14T09:41:04.196422+0000","last_became_active":"2024-05-14T09:40:45.746607+0000","last_became_peered":"2024-05-14T09:40:45.746607+0000","last_unstale":"2024-05-14T09:41:04.196422+0000","last_undegraded":"2024-05-14T09:41:04.196422+0000","last_fullsized":"2024-05-14T09:41:04.196422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:03.565510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.774259+0000","last_change":"2024-05-14T09:40:43.105149+0000","last_active":"2024-05-14T09:41:27.774259+0000","last_peered":"2024-05-14T09:41:27.774259+0000","last_clean":"2024-05-14T09:41:27.774259+0000","last_became_active":"2024-05-14T09:40:43.104277+0000","last_became_peered":"2024-05-14T09:40:43.104277+0000","last_unstale":"2024-05-14T09:41:27.774259+0000","last_undegraded":"2024-05-14T09:41:27.774259+0000","last_fullsized":"2024-05-14T09:41:27.774259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:48.598915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247251+0000","last_change":"2024-05-14T09:40:53.649256+0000","last_active":"2024-05-14T09:41:04.247251+0000","last_peered":"2024-05-14T09:41:04.247251+0000","last_clean":"2024-05-14T09:41:04.247251+0000","last_became_active":"2024-05-14T09:40:53.648765+0000","last_became_peered":"2024-05-14T09:40:53.648765+0000","last_unstale":"2024-05-14T09:41:04.247251+0000","last_undegraded":"2024-05-14T09:41:04.247251+0000","last_fullsized":"2024-05-14T09:41:04.247251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:25.060381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196117+0000","last_change":"2024-05-14T09:40:45.730862+0000","last_active":"2024-05-14T09:41:04.196117+0000","last_peered":"2024-05-14T09:41:04.196117+0000","last_clean":"2024-05-14T09:41:04.196117+0000","last_became_active":"2024-05-14T09:40:45.730014+0000","last_became_peered":"2024-05-14T09:40:45.730014+0000","last_unstale":"2024-05-14T09:41:04.196117+0000","last_undegraded":"2024-05-14T09:41:04.196117+0000","last_fullsized":"2024-05-14T09:41:04.196117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:05.679719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.533383+0000","last_change":"2024-05-14T09:40:43.112127+0000","last_active":"2024-05-14T09:41:27.533383+0000","last_peered":"2024-05-14T09:41:27.533383+0000","last_clean":"2024-05-14T09:41:27.533383+0000","last_became_active":"2024-05-14T09:40:43.111574+0000","last_became_peered":"2024-05-14T09:40:43.111574+0000","last_unstale":"2024-05-14T09:41:27.533383+0000","last_undegraded":"2024-05-14T09:41:27.533383+0000","last_fullsized":"2024-05-14T09:41:27.533383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:13.668017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193742+0000","last_change":"2024-05-14T09:40:53.666100+0000","last_active":"2024-05-14T09:41:04.193742+0000","last_peered":"2024-05-14T09:41:04.193742+0000","last_clean":"2024-05-14T09:41:04.193742+0000","last_became_active":"2024-05-14T09:40:53.665635+0000","last_became_peered":"2024-05-14T09:40:53.665635+0000","last_unstale":"2024-05-14T09:41:04.193742+0000","last_undegraded":"2024-05-14T09:41:04.193742+0000","last_fullsized":"2024-05-14T09:41:04.193742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:21.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205010+0000","last_change":"2024-05-14T09:40:45.758554+0000","last_active":"2024-05-14T09:41:04.205010+0000","last_peered":"2024-05-14T09:41:04.205010+0000","last_clean":"2024-05-14T09:41:04.205010+0000","last_became_active":"2024-05-14T09:40:45.757938+0000","last_became_peered":"2024-05-14T09:40:45.757938+0000","last_unstale":"2024-05-14T09:41:04.205010+0000","last_undegraded":"2024-05-14T09:41:04.205010+0000","last_fullsized":"2024-05-14T09:41:04.205010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.545839+0000","last_change":"2024-05-14T09:40:43.116767+0000","last_active":"2024-05-14T09:41:27.545839+0000","last_peered":"2024-05-14T09:41:27.545839+0000","last_clean":"2024-05-14T09:41:27.545839+0000","last_became_active":"2024-05-14T09:40:43.116142+0000","last_became_peered":"2024-05-14T09:40:43.116142+0000","last_unstale":"2024-05-14T09:41:27.545839+0000","last_undegraded":"2024-05-14T09:41:27.545839+0000","last_fullsized":"2024-05-14T09:41:27.545839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195886+0000","last_change":"2024-05-14T09:40:53.666811+0000","last_active":"2024-05-14T09:41:04.195886+0000","last_peered":"2024-05-14T09:41:04.195886+0000","last_clean":"2024-05-14T09:41:04.195886+0000","last_became_active":"2024-05-14T09:40:53.666455+0000","last_became_peered":"2024-05-14T09:40:53.666455+0000","last_unstale":"2024-05-14T09:41:04.195886+0000","last_undegraded":"2024-05-14T09:41:04.195886+0000","last_fullsized":"2024-05-14T09:41:04.195886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:33.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198714+0000","last_change":"2024-05-14T09:40:45.768162+0000","last_active":"2024-05-14T09:41:04.198714+0000","last_peered":"2024-05-14T09:41:04.198714+0000","last_clean":"2024-05-14T09:41:04.198714+0000","last_became_active":"2024-05-14T09:40:45.767810+0000","last_became_peered":"2024-05-14T09:40:45.767810+0000","last_unstale":"2024-05-14T09:41:04.198714+0000","last_undegraded":"2024-05-14T09:41:04.198714+0000","last_fullsized":"2024-05-14T09:41:04.198714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:25.075246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.686318+0000","last_change":"2024-05-14T09:40:43.115650+0000","last_active":"2024-05-14T09:41:30.686318+0000","last_peered":"2024-05-14T09:41:30.686318+0000","last_clean":"2024-05-14T09:41:30.686318+0000","last_became_active":"2024-05-14T09:40:43.114902+0000","last_became_peered":"2024-05-14T09:40:43.114902+0000","last_unstale":"2024-05-14T09:41:30.686318+0000","last_undegraded":"2024-05-14T09:41:30.686318+0000","last_fullsized":"2024-05-14T09:41:30.686318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:19.284998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195677+0000","last_change":"2024-05-14T09:40:53.650297+0000","last_active":"2024-05-14T09:41:04.195677+0000","last_peered":"2024-05-14T09:41:04.195677+0000","last_clean":"2024-05-14T09:41:04.195677+0000","last_became_active":"2024-05-14T09:40:53.649263+0000","last_became_peered":"2024-05-14T09:40:53.649263+0000","last_unstale":"2024-05-14T09:41:04.195677+0000","last_undegraded":"2024-05-14T09:41:04.195677+0000","last_fullsized":"2024-05-14T09:41:04.195677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:22.637337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247816+0000","last_change":"2024-05-14T09:40:45.733131+0000","last_active":"2024-05-14T09:41:04.247816+0000","last_peered":"2024-05-14T09:41:04.247816+0000","last_clean":"2024-05-14T09:41:04.247816+0000","last_became_active":"2024-05-14T09:40:45.732154+0000","last_became_peered":"2024-05-14T09:40:45.732154+0000","last_unstale":"2024-05-14T09:41:04.247816+0000","last_undegraded":"2024-05-14T09:41:04.247816+0000","last_fullsized":"2024-05-14T09:41:04.247816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:23:16.904648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611279+0000","last_change":"2024-05-14T09:40:43.112841+0000","last_active":"2024-05-14T09:41:04.611279+0000","last_peered":"2024-05-14T09:41:04.611279+0000","last_clean":"2024-05-14T09:41:04.611279+0000","last_became_active":"2024-05-14T09:40:43.110703+0000","last_became_peered":"2024-05-14T09:40:43.110703+0000","last_unstale":"2024-05-14T09:41:04.611279+0000","last_undegraded":"2024-05-14T09:41:04.611279+0000","last_fullsized":"2024-05-14T09:41:04.611279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:01.271389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203306+0000","last_change":"2024-05-14T09:40:53.657532+0000","last_active":"2024-05-14T09:41:04.203306+0000","last_peered":"2024-05-14T09:41:04.203306+0000","last_clean":"2024-05-14T09:41:04.203306+0000","last_became_active":"2024-05-14T09:40:53.657073+0000","last_became_peered":"2024-05-14T09:40:53.657073+0000","last_unstale":"2024-05-14T09:41:04.203306+0000","last_undegraded":"2024-05-14T09:41:04.203306+0000","last_fullsized":"2024-05-14T09:41:04.203306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:56.882153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.206106+0000","last_change":"2024-05-14T09:40:45.752122+0000","last_active":"2024-05-14T09:41:04.206106+0000","last_peered":"2024-05-14T09:41:04.206106+0000","last_clean":"2024-05-14T09:41:04.206106+0000","last_became_active":"2024-05-14T09:40:45.751546+0000","last_became_peered":"2024-05-14T09:40:45.751546+0000","last_unstale":"2024-05-14T09:41:04.206106+0000","last_undegraded":"2024-05-14T09:41:04.206106+0000","last_fullsized":"2024-05-14T09:41:04.206106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:19:55.897772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247921+0000","last_change":"2024-05-14T09:40:43.099478+0000","last_active":"2024-05-14T09:41:04.247921+0000","last_peered":"2024-05-14T09:41:04.247921+0000","last_clean":"2024-05-14T09:41:04.247921+0000","last_became_active":"2024-05-14T09:40:43.098776+0000","last_became_peered":"2024-05-14T09:40:43.098776+0000","last_unstale":"2024-05-14T09:41:04.247921+0000","last_undegraded":"2024-05-14T09:41:04.247921+0000","last_fullsized":"2024-05-14T09:41:04.247921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:35.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.246451+0000","last_change":"2024-05-14T09:40:53.650794+0000","last_active":"2024-05-14T09:41:04.246451+0000","last_peered":"2024-05-14T09:41:04.246451+0000","last_clean":"2024-05-14T09:41:04.246451+0000","last_became_active":"2024-05-14T09:40:53.650139+0000","last_became_peered":"2024-05-14T09:40:53.650139+0000","last_unstale":"2024-05-14T09:41:04.246451+0000","last_undegraded":"2024-05-14T09:41:04.246451+0000","last_fullsized":"2024-05-14T09:41:04.246451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:36.877806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193914+0000","last_change":"2024-05-14T09:40:45.748430+0000","last_active":"2024-05-14T09:41:04.193914+0000","last_peered":"2024-05-14T09:41:04.193914+0000","last_clean":"2024-05-14T09:41:04.193914+0000","last_became_active":"2024-05-14T09:40:45.748048+0000","last_became_peered":"2024-05-14T09:40:45.748048+0000","last_unstale":"2024-05-14T09:41:04.193914+0000","last_undegraded":"2024-05-14T09:41:04.193914+0000","last_fullsized":"2024-05-14T09:41:04.193914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:29.240543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205515+0000","last_change":"2024-05-14T09:40:43.088293+0000","last_active":"2024-05-14T09:41:04.205515+0000","last_peered":"2024-05-14T09:41:04.205515+0000","last_clean":"2024-05-14T09:41:04.205515+0000","last_became_active":"2024-05-14T09:40:43.087310+0000","last_became_peered":"2024-05-14T09:40:43.087310+0000","last_unstale":"2024-05-14T09:41:04.205515+0000","last_undegraded":"2024-05-14T09:41:04.205515+0000","last_fullsized":"2024-05-14T09:41:04.205515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:38.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.604273+0000","last_change":"2024-05-14T09:41:04.598844+0000","last_active":"2024-05-14T09:41:04.604273+0000","last_peered":"2024-05-14T09:41:04.604273+0000","last_clean":"2024-05-14T09:41:04.604273+0000","last_became_active":"2024-05-14T09:41:04.597473+0000","last_became_peered":"2024-05-14T09:41:04.597473+0000","last_unstale":"2024-05-14T09:41:04.604273+0000","last_undegraded":"2024-05-14T09:41:04.604273+0000","last_fullsized":"2024-05-14T09:41:04.604273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:48.257782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245464+0000","last_change":"2024-05-14T09:40:45.740074+0000","last_active":"2024-05-14T09:41:04.245464+0000","last_peered":"2024-05-14T09:41:04.245464+0000","last_clean":"2024-05-14T09:41:04.245464+0000","last_became_active":"2024-05-14T09:40:45.739647+0000","last_became_peered":"2024-05-14T09:40:45.739647+0000","last_unstale":"2024-05-14T09:41:04.245464+0000","last_undegraded":"2024-05-14T09:41:04.245464+0000","last_fullsized":"2024-05-14T09:41:04.245464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:38.401151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.853150+0000","last_change":"2024-05-14T09:40:43.043210+0000","last_active":"2024-05-14T09:41:30.853150+0000","last_peered":"2024-05-14T09:41:30.853150+0000","last_clean":"2024-05-14T09:41:30.853150+0000","last_became_active":"2024-05-14T09:40:43.042243+0000","last_became_peered":"2024-05-14T09:40:43.042243+0000","last_unstale":"2024-05-14T09:41:30.853150+0000","last_undegraded":"2024-05-14T09:41:30.853150+0000","last_fullsized":"2024-05-14T09:41:30.853150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.946422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247618+0000","last_change":"2024-05-14T09:40:53.652161+0000","last_active":"2024-05-14T09:41:04.247618+0000","last_peered":"2024-05-14T09:41:04.247618+0000","last_clean":"2024-05-14T09:41:04.247618+0000","last_became_active":"2024-05-14T09:40:53.649990+0000","last_became_peered":"2024-05-14T09:40:53.649990+0000","last_unstale":"2024-05-14T09:41:04.247618+0000","last_undegraded":"2024-05-14T09:41:04.247618+0000","last_fullsized":"2024-05-14T09:41:04.247618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:20:04.057127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203229+0000","last_change":"2024-05-14T09:40:45.754250+0000","last_active":"2024-05-14T09:41:04.203229+0000","last_peered":"2024-05-14T09:41:04.203229+0000","last_clean":"2024-05-14T09:41:04.203229+0000","last_became_active":"2024-05-14T09:40:45.753850+0000","last_became_peered":"2024-05-14T09:40:45.753850+0000","last_unstale":"2024-05-14T09:41:04.203229+0000","last_undegraded":"2024-05-14T09:41:04.203229+0000","last_fullsized":"2024-05-14T09:41:04.203229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:15.962138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.690809+0000","last_change":"2024-05-14T09:40:43.111905+0000","last_active":"2024-05-14T09:41:30.690809+0000","last_peered":"2024-05-14T09:41:30.690809+0000","last_clean":"2024-05-14T09:41:30.690809+0000","last_became_active":"2024-05-14T09:40:43.108233+0000","last_became_peered":"2024-05-14T09:40:43.108233+0000","last_unstale":"2024-05-14T09:41:30.690809+0000","last_undegraded":"2024-05-14T09:41:30.690809+0000","last_fullsized":"2024-05-14T09:41:30.690809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204679+0000","last_change":"2024-05-14T09:40:53.663789+0000","last_active":"2024-05-14T09:41:04.204679+0000","last_peered":"2024-05-14T09:41:04.204679+0000","last_clean":"2024-05-14T09:41:04.204679+0000","last_became_active":"2024-05-14T09:40:53.662980+0000","last_became_peered":"2024-05-14T09:40:53.662980+0000","last_unstale":"2024-05-14T09:41:04.204679+0000","last_undegraded":"2024-05-14T09:41:04.204679+0000","last_fullsized":"2024-05-14T09:41:04.204679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:46.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196055+0000","last_change":"2024-05-14T09:40:45.754347+0000","last_active":"2024-05-14T09:41:04.196055+0000","last_peered":"2024-05-14T09:41:04.196055+0000","last_clean":"2024-05-14T09:41:04.196055+0000","last_became_active":"2024-05-14T09:40:45.753869+0000","last_became_peered":"2024-05-14T09:40:45.753869+0000","last_unstale":"2024-05-14T09:41:04.196055+0000","last_undegraded":"2024-05-14T09:41:04.196055+0000","last_fullsized":"2024-05-14T09:41:04.196055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.548510+0000","last_change":"2024-05-14T09:40:43.087481+0000","last_active":"2024-05-14T09:41:27.548510+0000","last_peered":"2024-05-14T09:41:27.548510+0000","last_clean":"2024-05-14T09:41:27.548510+0000","last_became_active":"2024-05-14T09:40:43.086487+0000","last_became_peered":"2024-05-14T09:40:43.086487+0000","last_unstale":"2024-05-14T09:41:27.548510+0000","last_undegraded":"2024-05-14T09:41:27.548510+0000","last_fullsized":"2024-05-14T09:41:27.548510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:54.225063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.608887+0000","last_change":"2024-05-14T09:40:22.705545+0000","last_active":"2024-05-14T09:41:04.608887+0000","last_peered":"2024-05-14T09:41:04.608887+0000","last_clean":"2024-05-14T09:41:04.608887+0000","last_became_active":"2024-05-14T09:40:22.701797+0000","last_became_peered":"2024-05-14T09:40:22.701797+0000","last_unstale":"2024-05-14T09:41:04.608887+0000","last_undegraded":"2024-05-14T09:41:04.608887+0000","last_fullsized":"2024-05-14T09:41:04.608887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_clean_scrub_stamp":"2024-05-14T09:40:17.767400+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:48:21.700172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596932+0000","last_change":"2024-05-14T09:40:53.681915+0000","last_active":"2024-05-14T09:41:04.596932+0000","last_peered":"2024-05-14T09:41:04.596932+0000","last_clean":"2024-05-14T09:41:04.596932+0000","last_became_active":"2024-05-14T09:40:53.681296+0000","last_became_peered":"2024-05-14T09:40:53.681296+0000","last_unstale":"2024-05-14T09:41:04.596932+0000","last_undegraded":"2024-05-14T09:41:04.596932+0000","last_fullsized":"2024-05-14T09:41:04.596932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:21.455981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.216856+0000","last_change":"2024-05-14T09:41:04.213355+0000","last_active":"2024-05-14T09:41:04.216856+0000","last_peered":"2024-05-14T09:41:04.216856+0000","last_clean":"2024-05-14T09:41:04.216856+0000","last_became_active":"2024-05-14T09:41:04.212709+0000","last_became_peered":"2024-05-14T09:41:04.212709+0000","last_unstale":"2024-05-14T09:41:04.216856+0000","last_undegraded":"2024-05-14T09:41:04.216856+0000","last_fullsized":"2024-05-14T09:41:04.216856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.848240+0000","last_change":"2024-05-14T09:40:43.090401+0000","last_active":"2024-05-14T09:41:30.848240+0000","last_peered":"2024-05-14T09:41:30.848240+0000","last_clean":"2024-05-14T09:41:30.848240+0000","last_became_active":"2024-05-14T09:40:43.089548+0000","last_became_peered":"2024-05-14T09:40:43.089548+0000","last_unstale":"2024-05-14T09:41:30.848240+0000","last_undegraded":"2024-05-14T09:41:30.848240+0000","last_fullsized":"2024-05-14T09:41:30.848240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:03.385598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595424+0000","last_change":"2024-05-14T09:40:53.677072+0000","last_active":"2024-05-14T09:41:04.595424+0000","last_peered":"2024-05-14T09:41:04.595424+0000","last_clean":"2024-05-14T09:41:04.595424+0000","last_became_active":"2024-05-14T09:40:53.676636+0000","last_became_peered":"2024-05-14T09:40:53.676636+0000","last_unstale":"2024-05-14T09:41:04.595424+0000","last_undegraded":"2024-05-14T09:41:04.595424+0000","last_fullsized":"2024-05-14T09:41:04.595424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205238+0000","last_change":"2024-05-14T09:40:45.750962+0000","last_active":"2024-05-14T09:41:04.205238+0000","last_peered":"2024-05-14T09:41:04.205238+0000","last_clean":"2024-05-14T09:41:04.205238+0000","last_became_active":"2024-05-14T09:40:45.750539+0000","last_became_peered":"2024-05-14T09:40:45.750539+0000","last_unstale":"2024-05-14T09:41:04.205238+0000","last_undegraded":"2024-05-14T09:41:04.205238+0000","last_fullsized":"2024-05-14T09:41:04.205238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:42.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247645+0000","last_change":"2024-05-14T09:40:43.122483+0000","last_active":"2024-05-14T09:41:04.247645+0000","last_peered":"2024-05-14T09:41:04.247645+0000","last_clean":"2024-05-14T09:41:04.247645+0000","last_became_active":"2024-05-14T09:40:43.121427+0000","last_became_peered":"2024-05-14T09:40:43.121427+0000","last_unstale":"2024-05-14T09:41:04.247645+0000","last_undegraded":"2024-05-14T09:41:04.247645+0000","last_fullsized":"2024-05-14T09:41:04.247645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:31.384470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203609+0000","last_change":"2024-05-14T09:40:53.656157+0000","last_active":"2024-05-14T09:41:04.203609+0000","last_peered":"2024-05-14T09:41:04.203609+0000","last_clean":"2024-05-14T09:41:04.203609+0000","last_became_active":"2024-05-14T09:40:53.655141+0000","last_became_peered":"2024-05-14T09:40:53.655141+0000","last_unstale":"2024-05-14T09:41:04.203609+0000","last_undegraded":"2024-05-14T09:41:04.203609+0000","last_fullsized":"2024-05-14T09:41:04.203609+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611389+0000","last_change":"2024-05-14T09:40:45.778555+0000","last_active":"2024-05-14T09:41:04.611389+0000","last_peered":"2024-05-14T09:41:04.611389+0000","last_clean":"2024-05-14T09:41:04.611389+0000","last_became_active":"2024-05-14T09:40:45.776967+0000","last_became_peered":"2024-05-14T09:40:45.776967+0000","last_unstale":"2024-05-14T09:41:04.611389+0000","last_undegraded":"2024-05-14T09:41:04.611389+0000","last_fullsized":"2024-05-14T09:41:04.611389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:45:35.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211879+0000","last_change":"2024-05-14T09:40:43.043359+0000","last_active":"2024-05-14T09:41:04.211879+0000","last_peered":"2024-05-14T09:41:04.211879+0000","last_clean":"2024-05-14T09:41:04.211879+0000","last_became_active":"2024-05-14T09:40:43.042486+0000","last_became_peered":"2024-05-14T09:40:43.042486+0000","last_unstale":"2024-05-14T09:41:04.211879+0000","last_undegraded":"2024-05-14T09:41:04.211879+0000","last_fullsized":"2024-05-14T09:41:04.211879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:15.480365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203108+0000","last_change":"2024-05-14T09:40:53.662719+0000","last_active":"2024-05-14T09:41:04.203108+0000","last_peered":"2024-05-14T09:41:04.203108+0000","last_clean":"2024-05-14T09:41:04.203108+0000","last_became_active":"2024-05-14T09:40:53.660933+0000","last_became_peered":"2024-05-14T09:40:53.660933+0000","last_unstale":"2024-05-14T09:41:04.203108+0000","last_undegraded":"2024-05-14T09:41:04.203108+0000","last_fullsized":"2024-05-14T09:41:04.203108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:02.584358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610643+0000","last_change":"2024-05-14T09:40:45.776336+0000","last_active":"2024-05-14T09:41:04.610643+0000","last_peered":"2024-05-14T09:41:04.610643+0000","last_clean":"2024-05-14T09:41:04.610643+0000","last_became_active":"2024-05-14T09:40:45.775936+0000","last_became_peered":"2024-05-14T09:40:45.775936+0000","last_unstale":"2024-05-14T09:41:04.610643+0000","last_undegraded":"2024-05-14T09:41:04.610643+0000","last_fullsized":"2024-05-14T09:41:04.610643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:59.300900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.194909+0000","last_change":"2024-05-14T09:40:43.124714+0000","last_active":"2024-05-14T09:41:04.194909+0000","last_peered":"2024-05-14T09:41:04.194909+0000","last_clean":"2024-05-14T09:41:04.194909+0000","last_became_active":"2024-05-14T09:40:43.124370+0000","last_became_peered":"2024-05-14T09:40:43.124370+0000","last_unstale":"2024-05-14T09:41:04.194909+0000","last_undegraded":"2024-05-14T09:41:04.194909+0000","last_fullsized":"2024-05-14T09:41:04.194909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:52.132214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195468+0000","last_change":"2024-05-14T09:40:53.667102+0000","last_active":"2024-05-14T09:41:04.195468+0000","last_peered":"2024-05-14T09:41:04.195468+0000","last_clean":"2024-05-14T09:41:04.195468+0000","last_became_active":"2024-05-14T09:40:53.666666+0000","last_became_peered":"2024-05-14T09:40:53.666666+0000","last_unstale":"2024-05-14T09:41:04.195468+0000","last_undegraded":"2024-05-14T09:41:04.195468+0000","last_fullsized":"2024-05-14T09:41:04.195468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609479+0000","last_change":"2024-05-14T09:40:45.777251+0000","last_active":"2024-05-14T09:41:04.609479+0000","last_peered":"2024-05-14T09:41:04.609479+0000","last_clean":"2024-05-14T09:41:04.609479+0000","last_became_active":"2024-05-14T09:40:45.775668+0000","last_became_peered":"2024-05-14T09:40:45.775668+0000","last_unstale":"2024-05-14T09:41:04.609479+0000","last_undegraded":"2024-05-14T09:41:04.609479+0000","last_fullsized":"2024-05-14T09:41:04.609479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:54.917354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'15","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.859595+0000","last_change":"2024-05-14T09:40:43.040000+0000","last_active":"2024-05-14T09:41:30.859595+0000","last_peered":"2024-05-14T09:41:30.859595+0000","last_clean":"2024-05-14T09:41:30.859595+0000","last_became_active":"2024-05-14T09:40:43.039186+0000","last_became_peered":"2024-05-14T09:40:43.039186+0000","last_unstale":"2024-05-14T09:41:30.859595+0000","last_undegraded":"2024-05-14T09:41:30.859595+0000","last_fullsized":"2024-05-14T09:41:30.859595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:41:44.514114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204660+0000","last_change":"2024-05-14T09:40:53.667056+0000","last_active":"2024-05-14T09:41:04.204660+0000","last_peered":"2024-05-14T09:41:04.204660+0000","last_clean":"2024-05-14T09:41:04.204660+0000","last_became_active":"2024-05-14T09:40:53.666575+0000","last_became_peered":"2024-05-14T09:40:53.666575+0000","last_unstale":"2024-05-14T09:41:04.204660+0000","last_undegraded":"2024-05-14T09:41:04.204660+0000","last_fullsized":"2024-05-14T09:41:04.204660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594614+0000","last_change":"2024-05-14T09:40:45.754466+0000","last_active":"2024-05-14T09:41:04.594614+0000","last_peered":"2024-05-14T09:41:04.594614+0000","last_clean":"2024-05-14T09:41:04.594614+0000","last_became_active":"2024-05-14T09:40:45.753839+0000","last_became_peered":"2024-05-14T09:40:45.753839+0000","last_unstale":"2024-05-14T09:41:04.594614+0000","last_undegraded":"2024-05-14T09:41:04.594614+0000","last_fullsized":"2024-05-14T09:41:04.594614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.902026+0000","last_change":"2024-05-14T09:40:43.121744+0000","last_active":"2024-05-14T09:41:30.902026+0000","last_peered":"2024-05-14T09:41:30.902026+0000","last_clean":"2024-05-14T09:41:30.902026+0000","last_became_active":"2024-05-14T09:40:43.121388+0000","last_became_peered":"2024-05-14T09:40:43.121388+0000","last_unstale":"2024-05-14T09:41:30.902026+0000","last_undegraded":"2024-05-14T09:41:30.902026+0000","last_fullsized":"2024-05-14T09:41:30.902026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198145+0000","last_change":"2024-05-14T09:40:53.659658+0000","last_active":"2024-05-14T09:41:04.198145+0000","last_peered":"2024-05-14T09:41:04.198145+0000","last_clean":"2024-05-14T09:41:04.198145+0000","last_became_active":"2024-05-14T09:40:53.659191+0000","last_became_peered":"2024-05-14T09:40:53.659191+0000","last_unstale":"2024-05-14T09:41:04.198145+0000","last_undegraded":"2024-05-14T09:41:04.198145+0000","last_fullsized":"2024-05-14T09:41:04.198145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:15:39.587593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609972+0000","last_change":"2024-05-14T09:40:45.776748+0000","last_active":"2024-05-14T09:41:04.609972+0000","last_peered":"2024-05-14T09:41:04.609972+0000","last_clean":"2024-05-14T09:41:04.609972+0000","last_became_active":"2024-05-14T09:40:45.776451+0000","last_became_peered":"2024-05-14T09:40:45.776451+0000","last_unstale":"2024-05-14T09:41:04.609972+0000","last_undegraded":"2024-05-14T09:41:04.609972+0000","last_fullsized":"2024-05-14T09:41:04.609972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:39.890407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.545190+0000","last_change":"2024-05-14T09:40:43.086185+0000","last_active":"2024-05-14T09:41:27.545190+0000","last_peered":"2024-05-14T09:41:27.545190+0000","last_clean":"2024-05-14T09:41:27.545190+0000","last_became_active":"2024-05-14T09:40:43.085320+0000","last_became_peered":"2024-05-14T09:40:43.085320+0000","last_unstale":"2024-05-14T09:41:27.545190+0000","last_undegraded":"2024-05-14T09:41:27.545190+0000","last_fullsized":"2024-05-14T09:41:27.545190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:26:22.301593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196812+0000","last_change":"2024-05-14T09:40:53.673710+0000","last_active":"2024-05-14T09:41:04.196812+0000","last_peered":"2024-05-14T09:41:04.196812+0000","last_clean":"2024-05-14T09:41:04.196812+0000","last_became_active":"2024-05-14T09:40:53.672089+0000","last_became_peered":"2024-05-14T09:40:53.672089+0000","last_unstale":"2024-05-14T09:41:04.196812+0000","last_undegraded":"2024-05-14T09:41:04.196812+0000","last_fullsized":"2024-05-14T09:41:04.196812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:48:16.697615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205653+0000","last_change":"2024-05-14T09:40:45.767220+0000","last_active":"2024-05-14T09:41:04.205653+0000","last_peered":"2024-05-14T09:41:04.205653+0000","last_clean":"2024-05-14T09:41:04.205653+0000","last_became_active":"2024-05-14T09:40:45.766895+0000","last_became_peered":"2024-05-14T09:40:45.766895+0000","last_unstale":"2024-05-14T09:41:04.205653+0000","last_undegraded":"2024-05-14T09:41:04.205653+0000","last_fullsized":"2024-05-14T09:41:04.205653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.860251+0000","last_change":"2024-05-14T09:40:43.124937+0000","last_active":"2024-05-14T09:41:30.860251+0000","last_peered":"2024-05-14T09:41:30.860251+0000","last_clean":"2024-05-14T09:41:30.860251+0000","last_became_active":"2024-05-14T09:40:43.124129+0000","last_became_peered":"2024-05-14T09:40:43.124129+0000","last_unstale":"2024-05-14T09:41:30.860251+0000","last_undegraded":"2024-05-14T09:41:30.860251+0000","last_fullsized":"2024-05-14T09:41:30.860251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205748+0000","last_change":"2024-05-14T09:40:53.664722+0000","last_active":"2024-05-14T09:41:04.205748+0000","last_peered":"2024-05-14T09:41:04.205748+0000","last_clean":"2024-05-14T09:41:04.205748+0000","last_became_active":"2024-05-14T09:40:53.664194+0000","last_became_peered":"2024-05-14T09:40:53.664194+0000","last_unstale":"2024-05-14T09:41:04.205748+0000","last_undegraded":"2024-05-14T09:41:04.205748+0000","last_fullsized":"2024-05-14T09:41:04.205748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:35:57.826557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610449+0000","last_change":"2024-05-14T09:40:45.770662+0000","last_active":"2024-05-14T09:41:04.610449+0000","last_peered":"2024-05-14T09:41:04.610449+0000","last_clean":"2024-05-14T09:41:04.610449+0000","last_became_active":"2024-05-14T09:40:45.768058+0000","last_became_peered":"2024-05-14T09:40:45.768058+0000","last_unstale":"2024-05-14T09:41:04.610449+0000","last_undegraded":"2024-05-14T09:41:04.610449+0000","last_fullsized":"2024-05-14T09:41:04.610449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:13.296625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'12","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.546757+0000","last_change":"2024-05-14T09:40:43.113989+0000","last_active":"2024-05-14T09:41:27.546757+0000","last_peered":"2024-05-14T09:41:27.546757+0000","last_clean":"2024-05-14T09:41:27.546757+0000","last_became_active":"2024-05-14T09:40:43.113589+0000","last_became_peered":"2024-05-14T09:40:43.113589+0000","last_unstale":"2024-05-14T09:41:27.546757+0000","last_undegraded":"2024-05-14T09:41:27.546757+0000","last_fullsized":"2024-05-14T09:41:27.546757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:42:17.351523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.246643+0000","last_change":"2024-05-14T09:40:53.663887+0000","last_active":"2024-05-14T09:41:04.246643+0000","last_peered":"2024-05-14T09:41:04.246643+0000","last_clean":"2024-05-14T09:41:04.246643+0000","last_became_active":"2024-05-14T09:40:53.663419+0000","last_became_peered":"2024-05-14T09:40:53.663419+0000","last_unstale":"2024-05-14T09:41:04.246643+0000","last_undegraded":"2024-05-14T09:41:04.246643+0000","last_fullsized":"2024-05-14T09:41:04.246643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:18.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196203+0000","last_change":"2024-05-14T09:40:45.767184+0000","last_active":"2024-05-14T09:41:04.196203+0000","last_peered":"2024-05-14T09:41:04.196203+0000","last_clean":"2024-05-14T09:41:04.196203+0000","last_became_active":"2024-05-14T09:40:45.766784+0000","last_became_peered":"2024-05-14T09:40:45.766784+0000","last_unstale":"2024-05-14T09:41:04.196203+0000","last_undegraded":"2024-05-14T09:41:04.196203+0000","last_fullsized":"2024-05-14T09:41:04.196203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247559+0000","last_change":"2024-05-14T09:40:43.089869+0000","last_active":"2024-05-14T09:41:04.247559+0000","last_peered":"2024-05-14T09:41:04.247559+0000","last_clean":"2024-05-14T09:41:04.247559+0000","last_became_active":"2024-05-14T09:40:43.088906+0000","last_became_peered":"2024-05-14T09:40:43.088906+0000","last_unstale":"2024-05-14T09:41:04.247559+0000","last_undegraded":"2024-05-14T09:41:04.247559+0000","last_fullsized":"2024-05-14T09:41:04.247559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:28.223322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193385+0000","last_change":"2024-05-14T09:40:53.667412+0000","last_active":"2024-05-14T09:41:04.193385+0000","last_peered":"2024-05-14T09:41:04.193385+0000","last_clean":"2024-05-14T09:41:04.193385+0000","last_became_active":"2024-05-14T09:40:53.666533+0000","last_became_peered":"2024-05-14T09:40:53.666533+0000","last_unstale":"2024-05-14T09:41:04.193385+0000","last_undegraded":"2024-05-14T09:41:04.193385+0000","last_fullsized":"2024-05-14T09:41:04.193385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:53:41.310701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.250664+0000","last_change":"2024-05-14T09:41:04.250664+0000","last_active":"2024-05-14T09:41:04.250664+0000","last_peered":"2024-05-14T09:41:04.250664+0000","last_clean":"2024-05-14T09:41:04.250664+0000","last_became_active":"2024-05-14T09:41:04.250043+0000","last_became_peered":"2024-05-14T09:41:04.250043+0000","last_unstale":"2024-05-14T09:41:04.250664+0000","last_undegraded":"2024-05-14T09:41:04.250664+0000","last_fullsized":"2024-05-14T09:41:04.250664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:46:49.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.542416+0000","last_change":"2024-05-14T09:40:43.116130+0000","last_active":"2024-05-14T09:41:27.542416+0000","last_peered":"2024-05-14T09:41:27.542416+0000","last_clean":"2024-05-14T09:41:27.542416+0000","last_became_active":"2024-05-14T09:40:43.115741+0000","last_became_peered":"2024-05-14T09:40:43.115741+0000","last_unstale":"2024-05-14T09:41:27.542416+0000","last_undegraded":"2024-05-14T09:41:27.542416+0000","last_fullsized":"2024-05-14T09:41:27.542416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:35.083285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196132+0000","last_change":"2024-05-14T09:40:53.667088+0000","last_active":"2024-05-14T09:41:04.196132+0000","last_peered":"2024-05-14T09:41:04.196132+0000","last_clean":"2024-05-14T09:41:04.196132+0000","last_became_active":"2024-05-14T09:40:53.662581+0000","last_became_peered":"2024-05-14T09:40:53.662581+0000","last_unstale":"2024-05-14T09:41:04.196132+0000","last_undegraded":"2024-05-14T09:41:04.196132+0000","last_fullsized":"2024-05-14T09:41:04.196132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:14:18.824424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204868+0000","last_change":"2024-05-14T09:40:45.774302+0000","last_active":"2024-05-14T09:41:04.204868+0000","last_peered":"2024-05-14T09:41:04.204868+0000","last_clean":"2024-05-14T09:41:04.204868+0000","last_became_active":"2024-05-14T09:40:45.773879+0000","last_became_peered":"2024-05-14T09:40:45.773879+0000","last_unstale":"2024-05-14T09:41:04.204868+0000","last_undegraded":"2024-05-14T09:41:04.204868+0000","last_fullsized":"2024-05-14T09:41:04.204868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:09.921679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.549532+0000","last_change":"2024-05-14T09:40:43.116616+0000","last_active":"2024-05-14T09:41:27.549532+0000","last_peered":"2024-05-14T09:41:27.549532+0000","last_clean":"2024-05-14T09:41:27.549532+0000","last_became_active":"2024-05-14T09:40:43.115166+0000","last_became_peered":"2024-05-14T09:40:43.115166+0000","last_unstale":"2024-05-14T09:41:27.549532+0000","last_undegraded":"2024-05-14T09:41:27.549532+0000","last_fullsized":"2024-05-14T09:41:27.549532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:52.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196032+0000","last_change":"2024-05-14T09:40:53.668423+0000","last_active":"2024-05-14T09:41:04.196032+0000","last_peered":"2024-05-14T09:41:04.196032+0000","last_clean":"2024-05-14T09:41:04.196032+0000","last_became_active":"2024-05-14T09:40:53.664838+0000","last_became_peered":"2024-05-14T09:40:53.664838+0000","last_unstale":"2024-05-14T09:41:04.196032+0000","last_undegraded":"2024-05-14T09:41:04.196032+0000","last_fullsized":"2024-05-14T09:41:04.196032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:00:35.633754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204241+0000","last_change":"2024-05-14T09:40:53.656095+0000","last_active":"2024-05-14T09:41:04.204241+0000","last_peered":"2024-05-14T09:41:04.204241+0000","last_clean":"2024-05-14T09:41:04.204241+0000","last_became_active":"2024-05-14T09:40:53.655439+0000","last_became_peered":"2024-05-14T09:40:53.655439+0000","last_unstale":"2024-05-14T09:41:04.204241+0000","last_undegraded":"2024-05-14T09:41:04.204241+0000","last_fullsized":"2024-05-14T09:41:04.204241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:44.521319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245578+0000","last_change":"2024-05-14T09:40:45.744447+0000","last_active":"2024-05-14T09:41:04.245578+0000","last_peered":"2024-05-14T09:41:04.245578+0000","last_clean":"2024-05-14T09:41:04.245578+0000","last_became_active":"2024-05-14T09:40:45.743611+0000","last_became_peered":"2024-05-14T09:40:45.743611+0000","last_unstale":"2024-05-14T09:41:04.245578+0000","last_undegraded":"2024-05-14T09:41:04.245578+0000","last_fullsized":"2024-05-14T09:41:04.245578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:56.519183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'1","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203943+0000","last_change":"2024-05-14T09:40:43.122005+0000","last_active":"2024-05-14T09:41:04.203943+0000","last_peered":"2024-05-14T09:41:04.203943+0000","last_clean":"2024-05-14T09:41:04.203943+0000","last_became_active":"2024-05-14T09:40:43.121629+0000","last_became_peered":"2024-05-14T09:40:43.121629+0000","last_unstale":"2024-05-14T09:41:04.203943+0000","last_undegraded":"2024-05-14T09:41:04.203943+0000","last_fullsized":"2024-05-14T09:41:04.203943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:31:03.016812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.596267+0000","last_change":"2024-05-14T09:40:53.679415+0000","last_active":"2024-05-14T09:41:04.596267+0000","last_peered":"2024-05-14T09:41:04.596267+0000","last_clean":"2024-05-14T09:41:04.596267+0000","last_became_active":"2024-05-14T09:40:53.678851+0000","last_became_peered":"2024-05-14T09:40:53.678851+0000","last_unstale":"2024-05-14T09:41:04.596267+0000","last_undegraded":"2024-05-14T09:41:04.596267+0000","last_fullsized":"2024-05-14T09:41:04.596267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:48.049763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196225+0000","last_change":"2024-05-14T09:40:45.743111+0000","last_active":"2024-05-14T09:41:04.196225+0000","last_peered":"2024-05-14T09:41:04.196225+0000","last_clean":"2024-05-14T09:41:04.196225+0000","last_became_active":"2024-05-14T09:40:45.742702+0000","last_became_peered":"2024-05-14T09:40:45.742702+0000","last_unstale":"2024-05-14T09:41:04.196225+0000","last_undegraded":"2024-05-14T09:41:04.196225+0000","last_fullsized":"2024-05-14T09:41:04.196225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:17:39.673477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.682978+0000","last_change":"2024-05-14T09:40:43.116535+0000","last_active":"2024-05-14T09:41:30.682978+0000","last_peered":"2024-05-14T09:41:30.682978+0000","last_clean":"2024-05-14T09:41:30.682978+0000","last_became_active":"2024-05-14T09:40:43.115860+0000","last_became_peered":"2024-05-14T09:40:43.115860+0000","last_unstale":"2024-05-14T09:41:30.682978+0000","last_undegraded":"2024-05-14T09:41:30.682978+0000","last_fullsized":"2024-05-14T09:41:30.682978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'3","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:30.897871+0000","last_change":"2024-05-14T09:40:43.120700+0000","last_active":"2024-05-14T09:41:30.897871+0000","last_peered":"2024-05-14T09:41:30.897871+0000","last_clean":"2024-05-14T09:41:30.897871+0000","last_became_active":"2024-05-14T09:40:43.120353+0000","last_became_peered":"2024-05-14T09:40:43.120353+0000","last_unstale":"2024-05-14T09:41:30.897871+0000","last_undegraded":"2024-05-14T09:41:30.897871+0000","last_fullsized":"2024-05-14T09:41:30.897871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:35.425012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203768+0000","last_change":"2024-05-14T09:40:45.758385+0000","last_active":"2024-05-14T09:41:04.203768+0000","last_peered":"2024-05-14T09:41:04.203768+0000","last_clean":"2024-05-14T09:41:04.203768+0000","last_became_active":"2024-05-14T09:40:45.758017+0000","last_became_peered":"2024-05-14T09:40:45.758017+0000","last_unstale":"2024-05-14T09:41:04.203768+0000","last_undegraded":"2024-05-14T09:41:04.203768+0000","last_fullsized":"2024-05-14T09:41:04.203768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.210781+0000","last_change":"2024-05-14T09:40:53.671995+0000","last_active":"2024-05-14T09:41:04.210781+0000","last_peered":"2024-05-14T09:41:04.210781+0000","last_clean":"2024-05-14T09:41:04.210781+0000","last_became_active":"2024-05-14T09:40:53.671145+0000","last_became_peered":"2024-05-14T09:40:53.671145+0000","last_unstale":"2024-05-14T09:41:04.210781+0000","last_undegraded":"2024-05-14T09:41:04.210781+0000","last_fullsized":"2024-05-14T09:41:04.210781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:02.991096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'5","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:27.652423+0000","last_change":"2024-05-14T09:40:43.105812+0000","last_active":"2024-05-14T09:41:27.652423+0000","last_peered":"2024-05-14T09:41:27.652423+0000","last_clean":"2024-05-14T09:41:27.652423+0000","last_became_active":"2024-05-14T09:40:43.104821+0000","last_became_peered":"2024-05-14T09:40:43.104821+0000","last_unstale":"2024-05-14T09:41:27.652423+0000","last_undegraded":"2024-05-14T09:41:27.652423+0000","last_fullsized":"2024-05-14T09:41:27.652423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.193448+0000","last_change":"2024-05-14T09:40:45.746294+0000","last_active":"2024-05-14T09:41:04.193448+0000","last_peered":"2024-05-14T09:41:04.193448+0000","last_clean":"2024-05-14T09:41:04.193448+0000","last_became_active":"2024-05-14T09:40:45.745850+0000","last_became_peered":"2024-05-14T09:40:45.745850+0000","last_unstale":"2024-05-14T09:41:04.193448+0000","last_undegraded":"2024-05-14T09:41:04.193448+0000","last_fullsized":"2024-05-14T09:41:04.193448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:17.774486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197287+0000","last_change":"2024-05-14T09:40:53.670990+0000","last_active":"2024-05-14T09:41:04.197287+0000","last_peered":"2024-05-14T09:41:04.197287+0000","last_clean":"2024-05-14T09:41:04.197287+0000","last_became_active":"2024-05-14T09:40:53.669094+0000","last_became_peered":"2024-05-14T09:40:53.669094+0000","last_unstale":"2024-05-14T09:41:04.197287+0000","last_undegraded":"2024-05-14T09:41:04.197287+0000","last_fullsized":"2024-05-14T09:41:04.197287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:35:15.483140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594603+0000","last_change":"2024-05-14T09:40:45.754615+0000","last_active":"2024-05-14T09:41:04.594603+0000","last_peered":"2024-05-14T09:41:04.594603+0000","last_clean":"2024-05-14T09:41:04.594603+0000","last_became_active":"2024-05-14T09:40:45.754283+0000","last_became_peered":"2024-05-14T09:40:45.754283+0000","last_unstale":"2024-05-14T09:41:04.594603+0000","last_undegraded":"2024-05-14T09:41:04.594603+0000","last_fullsized":"2024-05-14T09:41:04.594603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211227+0000","last_change":"2024-05-14T09:40:45.753218+0000","last_active":"2024-05-14T09:41:04.211227+0000","last_peered":"2024-05-14T09:41:04.211227+0000","last_clean":"2024-05-14T09:41:04.211227+0000","last_became_active":"2024-05-14T09:40:45.752599+0000","last_became_peered":"2024-05-14T09:40:45.752599+0000","last_unstale":"2024-05-14T09:41:04.211227+0000","last_undegraded":"2024-05-14T09:41:04.211227+0000","last_fullsized":"2024-05-14T09:41:04.211227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205092+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T09:41:04.205092+0000","last_peered":"2024-05-14T09:41:04.205092+0000","last_clean":"2024-05-14T09:41:04.205092+0000","last_became_active":"2024-05-14T09:40:45.750387+0000","last_became_peered":"2024-05-14T09:40:45.750387+0000","last_unstale":"2024-05-14T09:41:04.205092+0000","last_undegraded":"2024-05-14T09:41:04.205092+0000","last_fullsized":"2024-05-14T09:41:04.205092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:54.689111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.251002+0000","last_change":"2024-05-14T09:41:04.251002+0000","last_active":"2024-05-14T09:41:04.251002+0000","last_peered":"2024-05-14T09:41:04.251002+0000","last_clean":"2024-05-14T09:41:04.251002+0000","last_became_active":"2024-05-14T09:41:04.250037+0000","last_became_peered":"2024-05-14T09:41:04.250037+0000","last_unstale":"2024-05-14T09:41:04.251002+0000","last_undegraded":"2024-05-14T09:41:04.251002+0000","last_fullsized":"2024-05-14T09:41:04.251002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:42:35.669137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197833+0000","last_change":"2024-05-14T09:40:45.723956+0000","last_active":"2024-05-14T09:41:04.197833+0000","last_peered":"2024-05-14T09:41:04.197833+0000","last_clean":"2024-05-14T09:41:04.197833+0000","last_became_active":"2024-05-14T09:40:45.723040+0000","last_became_peered":"2024-05-14T09:40:45.723040+0000","last_unstale":"2024-05-14T09:41:04.197833+0000","last_undegraded":"2024-05-14T09:41:04.197833+0000","last_fullsized":"2024-05-14T09:41:04.197833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:45.690725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247145+0000","last_change":"2024-05-14T09:40:45.746942+0000","last_active":"2024-05-14T09:41:04.247145+0000","last_peered":"2024-05-14T09:41:04.247145+0000","last_clean":"2024-05-14T09:41:04.247145+0000","last_became_active":"2024-05-14T09:40:45.745393+0000","last_became_peered":"2024-05-14T09:40:45.745393+0000","last_unstale":"2024-05-14T09:41:04.247145+0000","last_undegraded":"2024-05-14T09:41:04.247145+0000","last_fullsized":"2024-05-14T09:41:04.247145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:37.377406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595966+0000","last_change":"2024-05-14T09:40:45.772238+0000","last_active":"2024-05-14T09:41:04.595966+0000","last_peered":"2024-05-14T09:41:04.595966+0000","last_clean":"2024-05-14T09:41:04.595966+0000","last_became_active":"2024-05-14T09:40:45.771838+0000","last_became_peered":"2024-05-14T09:40:45.771838+0000","last_unstale":"2024-05-14T09:41:04.595966+0000","last_undegraded":"2024-05-14T09:41:04.595966+0000","last_fullsized":"2024-05-14T09:41:04.595966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.198586+0000","last_change":"2024-05-14T09:40:45.727770+0000","last_active":"2024-05-14T09:41:04.198586+0000","last_peered":"2024-05-14T09:41:04.198586+0000","last_clean":"2024-05-14T09:41:04.198586+0000","last_became_active":"2024-05-14T09:40:45.725283+0000","last_became_peered":"2024-05-14T09:40:45.725283+0000","last_unstale":"2024-05-14T09:41:04.198586+0000","last_undegraded":"2024-05-14T09:41:04.198586+0000","last_fullsized":"2024-05-14T09:41:04.198586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:22.638700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203472+0000","last_change":"2024-05-14T09:40:45.749288+0000","last_active":"2024-05-14T09:41:04.203472+0000","last_peered":"2024-05-14T09:41:04.203472+0000","last_clean":"2024-05-14T09:41:04.203472+0000","last_became_active":"2024-05-14T09:40:45.748925+0000","last_became_peered":"2024-05-14T09:40:45.748925+0000","last_unstale":"2024-05-14T09:41:04.203472+0000","last_undegraded":"2024-05-14T09:41:04.203472+0000","last_fullsized":"2024-05-14T09:41:04.203472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:03.576418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.196797+0000","last_change":"2024-05-14T09:40:45.724197+0000","last_active":"2024-05-14T09:41:04.196797+0000","last_peered":"2024-05-14T09:41:04.196797+0000","last_clean":"2024-05-14T09:41:04.196797+0000","last_became_active":"2024-05-14T09:40:45.723317+0000","last_became_peered":"2024-05-14T09:40:45.723317+0000","last_unstale":"2024-05-14T09:41:04.196797+0000","last_undegraded":"2024-05-14T09:41:04.196797+0000","last_fullsized":"2024-05-14T09:41:04.196797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204963+0000","last_change":"2024-05-14T09:40:45.770723+0000","last_active":"2024-05-14T09:41:04.204963+0000","last_peered":"2024-05-14T09:41:04.204963+0000","last_clean":"2024-05-14T09:41:04.204963+0000","last_became_active":"2024-05-14T09:40:45.769772+0000","last_became_peered":"2024-05-14T09:40:45.769772+0000","last_unstale":"2024-05-14T09:41:04.204963+0000","last_undegraded":"2024-05-14T09:41:04.204963+0000","last_fullsized":"2024-05-14T09:41:04.204963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:44.852533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203481+0000","last_change":"2024-05-14T09:40:45.766217+0000","last_active":"2024-05-14T09:41:04.203481+0000","last_peered":"2024-05-14T09:41:04.203481+0000","last_clean":"2024-05-14T09:41:04.203481+0000","last_became_active":"2024-05-14T09:40:45.765830+0000","last_became_peered":"2024-05-14T09:40:45.765830+0000","last_unstale":"2024-05-14T09:41:04.203481+0000","last_undegraded":"2024-05-14T09:41:04.203481+0000","last_fullsized":"2024-05-14T09:41:04.203481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.594937+0000","last_change":"2024-05-14T09:40:45.760838+0000","last_active":"2024-05-14T09:41:04.594937+0000","last_peered":"2024-05-14T09:41:04.594937+0000","last_clean":"2024-05-14T09:41:04.594937+0000","last_became_active":"2024-05-14T09:40:45.760535+0000","last_became_peered":"2024-05-14T09:40:45.760535+0000","last_unstale":"2024-05-14T09:41:04.594937+0000","last_undegraded":"2024-05-14T09:41:04.594937+0000","last_fullsized":"2024-05-14T09:41:04.594937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.610853+0000","last_change":"2024-05-14T09:40:45.778218+0000","last_active":"2024-05-14T09:41:04.610853+0000","last_peered":"2024-05-14T09:41:04.610853+0000","last_clean":"2024-05-14T09:41:04.610853+0000","last_became_active":"2024-05-14T09:40:45.775602+0000","last_became_peered":"2024-05-14T09:40:45.775602+0000","last_unstale":"2024-05-14T09:41:04.610853+0000","last_undegraded":"2024-05-14T09:41:04.610853+0000","last_fullsized":"2024-05-14T09:41:04.610853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:40.574917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.211569+0000","last_change":"2024-05-14T09:40:45.748996+0000","last_active":"2024-05-14T09:41:04.211569+0000","last_peered":"2024-05-14T09:41:04.211569+0000","last_clean":"2024-05-14T09:41:04.211569+0000","last_became_active":"2024-05-14T09:40:45.748266+0000","last_became_peered":"2024-05-14T09:40:45.748266+0000","last_unstale":"2024-05-14T09:41:04.211569+0000","last_undegraded":"2024-05-14T09:41:04.211569+0000","last_fullsized":"2024-05-14T09:41:04.211569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.615498+0000","last_change":"2024-05-14T09:41:04.613266+0000","last_active":"2024-05-14T09:41:04.615498+0000","last_peered":"2024-05-14T09:41:04.615498+0000","last_clean":"2024-05-14T09:41:04.615498+0000","last_became_active":"2024-05-14T09:41:04.612160+0000","last_became_peered":"2024-05-14T09:41:04.612160+0000","last_unstale":"2024-05-14T09:41:04.615498+0000","last_undegraded":"2024-05-14T09:41:04.615498+0000","last_fullsized":"2024-05-14T09:41:04.615498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.203375+0000","last_change":"2024-05-14T09:40:45.757279+0000","last_active":"2024-05-14T09:41:04.203375+0000","last_peered":"2024-05-14T09:41:04.203375+0000","last_clean":"2024-05-14T09:41:04.203375+0000","last_became_active":"2024-05-14T09:40:45.749692+0000","last_became_peered":"2024-05-14T09:40:45.749692+0000","last_unstale":"2024-05-14T09:41:04.203375+0000","last_undegraded":"2024-05-14T09:41:04.203375+0000","last_fullsized":"2024-05-14T09:41:04.203375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:39:52.486187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.245774+0000","last_change":"2024-05-14T09:40:45.744802+0000","last_active":"2024-05-14T09:41:04.245774+0000","last_peered":"2024-05-14T09:41:04.245774+0000","last_clean":"2024-05-14T09:41:04.245774+0000","last_became_active":"2024-05-14T09:40:45.744011+0000","last_became_peered":"2024-05-14T09:40:45.744011+0000","last_unstale":"2024-05-14T09:41:04.245774+0000","last_undegraded":"2024-05-14T09:41:04.245774+0000","last_fullsized":"2024-05-14T09:41:04.245774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:20.468216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.205334+0000","last_change":"2024-05-14T09:40:45.757983+0000","last_active":"2024-05-14T09:41:04.205334+0000","last_peered":"2024-05-14T09:41:04.205334+0000","last_clean":"2024-05-14T09:41:04.205334+0000","last_became_active":"2024-05-14T09:40:45.757450+0000","last_became_peered":"2024-05-14T09:40:45.757450+0000","last_unstale":"2024-05-14T09:41:04.205334+0000","last_undegraded":"2024-05-14T09:41:04.205334+0000","last_fullsized":"2024-05-14T09:41:04.205334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:07.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.197114+0000","last_change":"2024-05-14T09:40:45.745021+0000","last_active":"2024-05-14T09:41:04.197114+0000","last_peered":"2024-05-14T09:41:04.197114+0000","last_clean":"2024-05-14T09:41:04.197114+0000","last_became_active":"2024-05-14T09:40:45.744550+0000","last_became_peered":"2024-05-14T09:40:45.744550+0000","last_unstale":"2024-05-14T09:41:04.197114+0000","last_undegraded":"2024-05-14T09:41:04.197114+0000","last_fullsized":"2024-05-14T09:41:04.197114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195987+0000","last_change":"2024-05-14T09:40:45.749109+0000","last_active":"2024-05-14T09:41:04.195987+0000","last_peered":"2024-05-14T09:41:04.195987+0000","last_clean":"2024-05-14T09:41:04.195987+0000","last_became_active":"2024-05-14T09:40:45.748419+0000","last_became_peered":"2024-05-14T09:40:45.748419+0000","last_unstale":"2024-05-14T09:41:04.195987+0000","last_undegraded":"2024-05-14T09:41:04.195987+0000","last_fullsized":"2024-05-14T09:41:04.195987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.597196+0000","last_change":"2024-05-14T09:40:45.753508+0000","last_active":"2024-05-14T09:41:04.597196+0000","last_peered":"2024-05-14T09:41:04.597196+0000","last_clean":"2024-05-14T09:41:04.597196+0000","last_became_active":"2024-05-14T09:40:45.752982+0000","last_became_peered":"2024-05-14T09:40:45.752982+0000","last_unstale":"2024-05-14T09:41:04.597196+0000","last_undegraded":"2024-05-14T09:41:04.597196+0000","last_fullsized":"2024-05-14T09:41:04.597196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.595663+0000","last_change":"2024-05-14T09:40:45.759266+0000","last_active":"2024-05-14T09:41:04.595663+0000","last_peered":"2024-05-14T09:41:04.595663+0000","last_clean":"2024-05-14T09:41:04.595663+0000","last_became_active":"2024-05-14T09:40:45.758912+0000","last_became_peered":"2024-05-14T09:40:45.758912+0000","last_unstale":"2024-05-14T09:41:04.595663+0000","last_undegraded":"2024-05-14T09:41:04.595663+0000","last_fullsized":"2024-05-14T09:41:04.595663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611324+0000","last_change":"2024-05-14T09:40:45.780527+0000","last_active":"2024-05-14T09:41:04.611324+0000","last_peered":"2024-05-14T09:41:04.611324+0000","last_clean":"2024-05-14T09:41:04.611324+0000","last_became_active":"2024-05-14T09:40:45.780197+0000","last_became_peered":"2024-05-14T09:40:45.780197+0000","last_unstale":"2024-05-14T09:41:04.611324+0000","last_undegraded":"2024-05-14T09:41:04.611324+0000","last_fullsized":"2024-05-14T09:41:04.611324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:38.220230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.195825+0000","last_change":"2024-05-14T09:40:45.761049+0000","last_active":"2024-05-14T09:41:04.195825+0000","last_peered":"2024-05-14T09:41:04.195825+0000","last_clean":"2024-05-14T09:41:04.195825+0000","last_became_active":"2024-05-14T09:40:45.760738+0000","last_became_peered":"2024-05-14T09:40:45.760738+0000","last_unstale":"2024-05-14T09:41:04.195825+0000","last_undegraded":"2024-05-14T09:41:04.195825+0000","last_fullsized":"2024-05-14T09:41:04.195825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609336+0000","last_change":"2024-05-14T09:40:45.776380+0000","last_active":"2024-05-14T09:41:04.609336+0000","last_peered":"2024-05-14T09:41:04.609336+0000","last_clean":"2024-05-14T09:41:04.609336+0000","last_became_active":"2024-05-14T09:40:45.776005+0000","last_became_peered":"2024-05-14T09:40:45.776005+0000","last_unstale":"2024-05-14T09:41:04.609336+0000","last_undegraded":"2024-05-14T09:41:04.609336+0000","last_fullsized":"2024-05-14T09:41:04.609336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:27.969792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.219398+0000","last_change":"2024-05-14T09:41:04.214552+0000","last_active":"2024-05-14T09:41:04.219398+0000","last_peered":"2024-05-14T09:41:04.219398+0000","last_clean":"2024-05-14T09:41:04.219398+0000","last_became_active":"2024-05-14T09:41:04.213721+0000","last_became_peered":"2024-05-14T09:41:04.213721+0000","last_unstale":"2024-05-14T09:41:04.219398+0000","last_undegraded":"2024-05-14T09:41:04.219398+0000","last_fullsized":"2024-05-14T09:41:04.219398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.609591+0000","last_change":"2024-05-14T09:40:45.776955+0000","last_active":"2024-05-14T09:41:04.609591+0000","last_peered":"2024-05-14T09:41:04.609591+0000","last_clean":"2024-05-14T09:41:04.609591+0000","last_became_active":"2024-05-14T09:40:45.775953+0000","last_became_peered":"2024-05-14T09:40:45.775953+0000","last_unstale":"2024-05-14T09:41:04.609591+0000","last_undegraded":"2024-05-14T09:41:04.609591+0000","last_fullsized":"2024-05-14T09:41:04.609591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:13.534273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204293+0000","last_change":"2024-05-14T09:40:45.750766+0000","last_active":"2024-05-14T09:41:04.204293+0000","last_peered":"2024-05-14T09:41:04.204293+0000","last_clean":"2024-05-14T09:41:04.204293+0000","last_became_active":"2024-05-14T09:40:45.750416+0000","last_became_peered":"2024-05-14T09:40:45.750416+0000","last_unstale":"2024-05-14T09:41:04.204293+0000","last_undegraded":"2024-05-14T09:41:04.204293+0000","last_fullsized":"2024-05-14T09:41:04.204293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:29:30.022171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.204845+0000","last_change":"2024-05-14T09:40:45.748573+0000","last_active":"2024-05-14T09:41:04.204845+0000","last_peered":"2024-05-14T09:41:04.204845+0000","last_clean":"2024-05-14T09:41:04.204845+0000","last_became_active":"2024-05-14T09:40:45.746640+0000","last_became_peered":"2024-05-14T09:40:45.746640+0000","last_unstale":"2024-05-14T09:41:04.204845+0000","last_undegraded":"2024-05-14T09:41:04.204845+0000","last_fullsized":"2024-05-14T09:41:04.204845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.247941+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T09:41:04.247941+0000","last_peered":"2024-05-14T09:41:04.247941+0000","last_clean":"2024-05-14T09:41:04.247941+0000","last_became_active":"2024-05-14T09:40:45.752589+0000","last_became_peered":"2024-05-14T09:40:45.752589+0000","last_unstale":"2024-05-14T09:41:04.247941+0000","last_undegraded":"2024-05-14T09:41:04.247941+0000","last_fullsized":"2024-05-14T09:41:04.247941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:43.043120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T09:41:04.611042+0000","last_change":"2024-05-14T09:40:45.771577+0000","last_active":"2024-05-14T09:41:04.611042+0000","last_peered":"2024-05-14T09:41:04.611042+0000","last_clean":"2024-05-14T09:41:04.611042+0000","last_became_active":"2024-05-14T09:40:45.771228+0000","last_became_peered":"2024-05-14T09:40:45.771228+0000","last_unstale":"2024-05-14T09:41:04.611042+0000","last_undegraded":"2024-05-14T09:41:04.611042+0000","last_fullsized":"2024-05-14T09:41:04.611042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:36.361964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476757,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":153123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476759,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":149317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":16,"seq":68719476760,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":153157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476756,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":149421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476756,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":962560,"data_stored":739631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":966656,"data_stored":740287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":149981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":149547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T09:41:44.384 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T09:41:44.384 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-14T09:41:44.384 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-14T09:41:44.384 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-14T09:41:44.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.690+0000 7fa65b000640 1 Processor -- start 2024-05-14T09:41:44.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.690+0000 7fa65b000640 1 -- start start 2024-05-14T09:41:44.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.693+0000 7fa65b000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa654071fe0 0x7fa654154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:44.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.693+0000 7fa65b000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa65415b160 con 0x7fa654074810 2024-05-14T09:41:44.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.693+0000 7fa65b000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa65415ae80 con 0x7fa6540c84d0 2024-05-14T09:41:44.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.693+0000 7fa65b000640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fa65415ac30 con 0x7fa654071fe0 2024-05-14T09:41:44.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.694+0000 7fa659000640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa6540c84d0 0x7fa6540c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:60000/0 (socket says 172.21.15.135:60000) 2024-05-14T09:41:44.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.694+0000 7fa659000640 1 -- 172.21.15.135:0/200937169 learned_addr learned my addr 172.21.15.135:0/200937169 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:44.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.694+0000 7fa653e00640 1 --2- 172.21.15.135:0/200937169 >> v2:172.21.15.135:3300/0 conn(0x7fa654071fe0 0x7fa654154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:44.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.699+0000 7fa653400640 1 -- 172.21.15.135:0/200937169 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 866385707 0 0) 0x7fa65415ae80 con 0x7fa6540c84d0 2024-05-14T09:41:44.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.699+0000 7fa653400640 1 -- 172.21.15.135:0/200937169 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa638003520 con 0x7fa6540c84d0 2024-05-14T09:41:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.702+0000 7fa653e00640 1 -- 172.21.15.135:0/200937169 >> v1:172.21.15.196:6789/0 conn(0x7fa6540c84d0 legacy=0x7fa6540c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.702+0000 7fa653e00640 1 -- 172.21.15.135:0/200937169 >> v1:172.21.15.135:6789/0 conn(0x7fa654074810 legacy=0x7fa6540c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.702+0000 7fa653e00640 1 -- 172.21.15.135:0/200937169 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6540c8ce0 con 0x7fa654071fe0 2024-05-14T09:41:44.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.708+0000 7fa653e00640 1 --2- 172.21.15.135:0/200937169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa654071fe0 0x7fa654154550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097a0 tx=0x7fa64402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e066b4fb6e95e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:44.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.717+0000 7fa653400640 1 -- 172.21.15.135:0/200937169 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa644037070 con 0x7fa654071fe0 2024-05-14T09:41:44.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.717+0000 7fa653400640 1 -- 172.21.15.135:0/200937169 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa644032440 con 0x7fa654071fe0 2024-05-14T09:41:44.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.717+0000 7fa653400640 1 -- 172.21.15.135:0/200937169 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa644032810 con 0x7fa654071fe0 2024-05-14T09:41:44.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.718+0000 7fa65b000640 1 -- 172.21.15.135:0/200937169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa654071fe0 msgr2=0x7fa654154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:44.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.718+0000 7fa65b000640 1 --2- 172.21.15.135:0/200937169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa654071fe0 0x7fa654154550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097a0 tx=0x7fa64402a230 comp rx=0 tx=0).stop 2024-05-14T09:41:44.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.719+0000 7fa65b000640 1 -- 172.21.15.135:0/200937169 shutdown_connections 2024-05-14T09:41:44.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.719+0000 7fa65b000640 1 --2- 172.21.15.135:0/200937169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa654071fe0 0x7fa654154550 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:44.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.719+0000 7fa65b000640 1 -- 172.21.15.135:0/200937169 >> 172.21.15.135:0/200937169 conn(0x7fa654073cf0 msgr2=0x7fa654074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:44.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.719+0000 7fa65b000640 1 -- 172.21.15.135:0/200937169 shutdown_connections 2024-05-14T09:41:44.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.719+0000 7fa65b000640 1 -- 172.21.15.135:0/200937169 wait complete. 2024-05-14T09:41:44.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.721+0000 7fa65b000640 1 Processor -- start 2024-05-14T09:41:44.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.722+0000 7fa65b000640 1 -- start start 2024-05-14T09:41:44.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.723+0000 7fa65b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa654071fe0 0x7fa65414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:44.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.723+0000 7fa65b000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa654074810 0x7fa65415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:44.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.723+0000 7fa65b000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6540c84d0 0x7fa6541e5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:44.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.723+0000 7fa65b000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa6540c88e0 con 0x7fa6540c84d0 2024-05-14T09:41:44.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.723+0000 7fa65b000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa6540c92a0 con 0x7fa654074810 2024-05-14T09:41:44.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.723+0000 7fa65b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fa6540c72a0 con 0x7fa654071fe0 2024-05-14T09:41:44.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.724+0000 7fa659000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6540c84d0 0x7fa6541e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:44.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.724+0000 7fa64be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa654074810 0x7fa65415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:44.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.724+0000 7fa659000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6540c84d0 0x7fa6541e5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39188/0 (socket says 172.21.15.135:39188) 2024-05-14T09:41:44.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.724+0000 7fa659000640 1 -- 172.21.15.135:0/1695590630 learned_addr learned my addr 172.21.15.135:0/1695590630 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:44.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.725+0000 7fa653e00640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa654071fe0 0x7fa65414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:44.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.729+0000 7fa659000640 1 -- 172.21.15.135:0/1695590630 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa654071fe0 msgr2=0x7fa65414f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:44.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.729+0000 7fa659000640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa654071fe0 0x7fa65414f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:44.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.729+0000 7fa659000640 1 -- 172.21.15.135:0/1695590630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa654074810 msgr2=0x7fa65415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:44.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.729+0000 7fa659000640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa654074810 0x7fa65415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:44.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.729+0000 7fa659000640 1 -- 172.21.15.135:0/1695590630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6540c50f0 con 0x7fa6540c84d0 2024-05-14T09:41:44.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.732+0000 7fa659000640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6540c84d0 0x7fa6541e5980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00cb00 tx=0x7fa64c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:44.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.738+0000 7fa650c00640 1 -- 172.21.15.135:0/1695590630 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c00aca0 con 0x7fa6540c84d0 2024-05-14T09:41:44.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.738+0000 7fa650c00640 1 -- 172.21.15.135:0/1695590630 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64c00ae40 con 0x7fa6540c84d0 2024-05-14T09:41:44.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.738+0000 7fa650c00640 1 -- 172.21.15.135:0/1695590630 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c012600 con 0x7fa6540c84d0 2024-05-14T09:41:44.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.738+0000 7fa65b000640 1 -- 172.21.15.135:0/1695590630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6540c6530 con 0x7fa6540c84d0 2024-05-14T09:41:44.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.738+0000 7fa65b000640 1 -- 172.21.15.135:0/1695590630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6540c4bd0 con 0x7fa6540c84d0 2024-05-14T09:41:44.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:44.740+0000 7fa65b000640 1 -- 172.21.15.135:0/1695590630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa654069a90 con 0x7fa6540c84d0 2024-05-14T09:41:45.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.068+0000 7fa650c00640 1 -- 172.21.15.135:0/1695590630 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa64c0127a0 con 0x7fa6540c84d0 2024-05-14T09:41:45.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.073+0000 7fa650c00640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa630076350 0x7fa630078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:45.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.074+0000 7fa653e00640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa630076350 0x7fa630078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:45.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.075+0000 7fa653e00640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa630076350 0x7fa630078860 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa644034000 tx=0x7fa64402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:45.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.111+0000 7fa650c00640 1 -- 172.21.15.135:0/1695590630 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fa64c05db30 con 0x7fa6540c84d0 2024-05-14T09:41:45.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.113+0000 7fa650c00640 1 -- 172.21.15.135:0/1695590630 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa64c0618a0 con 0x7fa6540c84d0 2024-05-14T09:41:45.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.363+0000 7fa65b000640 1 -- 172.21.15.135:0/1695590630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa654157bd0 con 0x7fa6540c84d0 2024-05-14T09:41:45.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.408+0000 7fa650c00640 1 -- 172.21.15.135:0/1695590630 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa64c065ba0 con 0x7fa6540c84d0 2024-05-14T09:41:45.409 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:45.409 INFO:teuthology.orchestra.run.smithi135.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-14T09:41:45.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 -- 172.21.15.135:0/1695590630 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa630076350 msgr2=0x7fa630078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:45.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa630076350 0x7fa630078860 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa644034000 tx=0x7fa64402e000 comp rx=0 tx=0).stop 2024-05-14T09:41:45.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 -- 172.21.15.135:0/1695590630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6540c84d0 msgr2=0x7fa6541e5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:45.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6540c84d0 0x7fa6541e5980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00cb00 tx=0x7fa64c00a060 comp rx=0 tx=0).stop 2024-05-14T09:41:45.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 -- 172.21.15.135:0/1695590630 shutdown_connections 2024-05-14T09:41:45.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fa630076350 0x7fa630078860 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:45.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa654074810 0x7fa65415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:45.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6540c84d0 0x7fa6541e5980 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:45.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 --2- 172.21.15.135:0/1695590630 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa654071fe0 0x7fa65414f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:45.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 -- 172.21.15.135:0/1695590630 >> 172.21.15.135:0/1695590630 conn(0x7fa654073cf0 msgr2=0x7fa654151e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:45.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 -- 172.21.15.135:0/1695590630 shutdown_connections 2024-05-14T09:41:45.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.412+0000 7fa65b000640 1 -- 172.21.15.135:0/1695590630 wait complete. 2024-05-14T09:41:45.454 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-14T09:41:45.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T09:41:45.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.707+0000 7f459bc00640 1 Processor -- start 2024-05-14T09:41:45.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.708+0000 7f459bc00640 1 -- start start 2024-05-14T09:41:45.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.710+0000 7f459bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f459415acb0 0x7f45940c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:45.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.710+0000 7f459bc00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4594074810 0x7f45940c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:45.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.710+0000 7f459bc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4594161830 con 0x7f4594164190 2024-05-14T09:41:45.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.710+0000 7f459bc00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f45941609d0 con 0x7f4594074810 2024-05-14T09:41:45.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.710+0000 7f459bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4594160cb0 con 0x7f459415acb0 2024-05-14T09:41:45.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.712+0000 7f4593e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4594074810 0x7f45940c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:45.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.712+0000 7f4599200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f459415acb0 0x7f45940c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:45.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.712+0000 7f4593e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f4594074810 0x7f45940c98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39204/0 (socket says 172.21.15.135:39204) 2024-05-14T09:41:45.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.712+0000 7f4593e00640 1 -- 172.21.15.135:0/416207714 learned_addr learned my addr 172.21.15.135:0/416207714 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:45.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.718+0000 7f4593e00640 1 -- 172.21.15.135:0/416207714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f459415acb0 msgr2=0x7f45940c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:45.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.718+0000 7f4593e00640 1 --2- 172.21.15.135:0/416207714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f459415acb0 0x7f45940c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:45.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.718+0000 7f4593e00640 1 -- 172.21.15.135:0/416207714 >> v1:172.21.15.196:6789/0 conn(0x7f4594164190 legacy=0x7f45941645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:45.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.718+0000 7f4593e00640 1 -- 172.21.15.135:0/416207714 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4594160f90 con 0x7f4594074810 2024-05-14T09:41:45.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.724+0000 7f4593e00640 1 --2- 172.21.15.135:0/416207714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4594074810 0x7f45940c98b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4580009870 tx=0x7f458002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66f1d0077f85b8e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:45.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.730+0000 7f4593400640 1 -- 172.21.15.135:0/416207714 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580037070 con 0x7f4594074810 2024-05-14T09:41:45.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.730+0000 7f4593400640 1 -- 172.21.15.135:0/416207714 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4580032440 con 0x7f4594074810 2024-05-14T09:41:45.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.730+0000 7f4593400640 1 -- 172.21.15.135:0/416207714 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580032810 con 0x7f4594074810 2024-05-14T09:41:45.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.731+0000 7f459bc00640 1 -- 172.21.15.135:0/416207714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4594074810 msgr2=0x7f45940c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:45.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.731+0000 7f459bc00640 1 --2- 172.21.15.135:0/416207714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4594074810 0x7f45940c98b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4580009870 tx=0x7f458002a1c0 comp rx=0 tx=0).stop 2024-05-14T09:41:45.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.731+0000 7f459bc00640 1 -- 172.21.15.135:0/416207714 shutdown_connections 2024-05-14T09:41:45.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.731+0000 7f459bc00640 1 --2- 172.21.15.135:0/416207714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4594074810 0x7f45940c98b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:45.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.731+0000 7f459bc00640 1 --2- 172.21.15.135:0/416207714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f459415acb0 0x7f45940c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:45.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.731+0000 7f459bc00640 1 -- 172.21.15.135:0/416207714 >> 172.21.15.135:0/416207714 conn(0x7f4594073cf0 msgr2=0x7f4594074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:45.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.731+0000 7f459bc00640 1 -- 172.21.15.135:0/416207714 shutdown_connections 2024-05-14T09:41:45.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.731+0000 7f459bc00640 1 -- 172.21.15.135:0/416207714 wait complete. 2024-05-14T09:41:45.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.735+0000 7f459bc00640 1 Processor -- start 2024-05-14T09:41:45.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.735+0000 7f459bc00640 1 -- start start 2024-05-14T09:41:45.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.737+0000 7f459bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4594074810 0x7f45941f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:45.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.737+0000 7f459bc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f459415acb0 0x7f4594070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:45.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.737+0000 7f459bc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4594164190 0x7f4594150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:45.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.737+0000 7f459bc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f45940c69b0 con 0x7f4594164190 2024-05-14T09:41:45.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.737+0000 7f459bc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4594161550 con 0x7f459415acb0 2024-05-14T09:41:45.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.737+0000 7f459bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f45940c85b0 con 0x7f4594074810 2024-05-14T09:41:45.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.738+0000 7f4599c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4594164190 0x7f4594150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:45.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.739+0000 7f4599c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4594164190 0x7f4594150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39208/0 (socket says 172.21.15.135:39208) 2024-05-14T09:41:45.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.739+0000 7f4599c00640 1 -- 172.21.15.135:0/3102355797 learned_addr learned my addr 172.21.15.135:0/3102355797 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:45.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.739+0000 7f4599200640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4594074810 0x7f45941f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:45.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.743+0000 7f4599c00640 1 -- 172.21.15.135:0/3102355797 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4594074810 msgr2=0x7f45941f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:45.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.743+0000 7f4599c00640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4594074810 0x7f45941f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:45.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.743+0000 7f4599c00640 1 -- 172.21.15.135:0/3102355797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f459415acb0 msgr2=0x7f4594070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:45.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.743+0000 7f4599c00640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f459415acb0 0x7f4594070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:45.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.743+0000 7f4599c00640 1 -- 172.21.15.135:0/3102355797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45941f77b0 con 0x7f4594164190 2024-05-14T09:41:45.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.745+0000 7f4599c00640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4594164190 0x7f4594150500 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f458c00b930 tx=0x7f458c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:45.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.749+0000 7f4590c00640 1 -- 172.21.15.135:0/3102355797 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c019070 con 0x7f4594164190 2024-05-14T09:41:45.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.749+0000 7f4590c00640 1 -- 172.21.15.135:0/3102355797 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c00cb60 con 0x7f4594164190 2024-05-14T09:41:45.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.749+0000 7f4590c00640 1 -- 172.21.15.135:0/3102355797 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c014440 con 0x7f4594164190 2024-05-14T09:41:45.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.749+0000 7f459bc00640 1 -- 172.21.15.135:0/3102355797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45941fa510 con 0x7f4594164190 2024-05-14T09:41:45.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.750+0000 7f459bc00640 1 -- 172.21.15.135:0/3102355797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45941faa90 con 0x7f4594164190 2024-05-14T09:41:45.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:45.751+0000 7f459bc00640 1 -- 172.21.15.135:0/3102355797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f459406a3d0 con 0x7f4594164190 2024-05-14T09:41:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.125+0000 7f4590c00640 1 -- 172.21.15.135:0/3102355797 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f458c01c070 con 0x7f4594164190 2024-05-14T09:41:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.127+0000 7f4590c00640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4574076320 0x7f4574078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.128+0000 7f4599200640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4574076320 0x7f4574078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.129+0000 7f4599200640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4574076320 0x7f4574078830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4588009aa0 tx=0x7f4588009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.153+0000 7f4590c00640 1 -- 172.21.15.135:0/3102355797 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f458c05d070 con 0x7f4594164190 2024-05-14T09:41:46.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.154+0000 7f4590c00640 1 -- 172.21.15.135:0/3102355797 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f459406a3d0 con 0x7f4594164190 2024-05-14T09:41:46.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.460+0000 7f459bc00640 1 -- 172.21.15.135:0/3102355797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45940c8390 con 0x7f4594164190 2024-05-14T09:41:46.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.480+0000 7f4590c00640 1 -- 172.21.15.135:0/3102355797 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6888 (secure 0 0 0) 0x7f458c060de0 con 0x7f4594164190 2024-05-14T09:41:46.480 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:46.480 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4032169993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4032169993},{"type":"v1","addr":"172.21.15.135:6837","nonce":4032169993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/1397919075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":1397919075},{"type":"v1","addr":"172.21.15.196:6833","nonce":1397919075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/4240420134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":4240420134},{"type":"v1","addr":"172.21.15.196:6835","nonce":4240420134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T09:40:45.555908+0000","modified":"2024-05-14T09:41:31.018579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4255,"mds_1":4252,"mds_2":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":15,"addr":"172.21.15.135:6835/3270089159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3270089159},{"type":"v1","addr":"172.21.15.135:6835","nonce":3270089159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4252":{"gid":4252,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":14,"addr":"172.21.15.135:6839/2302038485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2302038485},{"type":"v1","addr":"172.21.15.135:6839","nonce":2302038485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6837/3644723215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3644723215},{"type":"v1","addr":"172.21.15.196:6837","nonce":3644723215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4240,4252,4255]},"id":1}]} 2024-05-14T09:41:46.481 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 14 2024-05-14T09:41:46.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.483+0000 7f459bc00640 1 -- 172.21.15.135:0/3102355797 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4574076320 msgr2=0x7f4574078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:46.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.483+0000 7f459bc00640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4574076320 0x7f4574078830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4588009aa0 tx=0x7f4588009190 comp rx=0 tx=0).stop 2024-05-14T09:41:46.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.483+0000 7f459bc00640 1 -- 172.21.15.135:0/3102355797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4594164190 msgr2=0x7f4594150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:46.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.483+0000 7f459bc00640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4594164190 0x7f4594150500 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f458c00b930 tx=0x7f458c00bdf0 comp rx=0 tx=0).stop 2024-05-14T09:41:46.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.483+0000 7f459bc00640 1 -- 172.21.15.135:0/3102355797 shutdown_connections 2024-05-14T09:41:46.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.483+0000 7f459bc00640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4574076320 0x7f4574078830 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:46.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.483+0000 7f459bc00640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f459415acb0 0x7f4594070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:46.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.483+0000 7f459bc00640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4594164190 0x7f4594150500 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:46.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.483+0000 7f459bc00640 1 --2- 172.21.15.135:0/3102355797 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4594074810 0x7f45941f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:46.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.483+0000 7f459bc00640 1 -- 172.21.15.135:0/3102355797 >> 172.21.15.135:0/3102355797 conn(0x7f4594073cf0 msgr2=0x7f4594074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:46.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.484+0000 7f459bc00640 1 -- 172.21.15.135:0/3102355797 shutdown_connections 2024-05-14T09:41:46.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.484+0000 7f459bc00640 1 -- 172.21.15.135:0/3102355797 wait complete. 2024-05-14T09:41:46.509 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T09:41:46.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.777+0000 7fedc1400640 1 Processor -- start 2024-05-14T09:41:46.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.777+0000 7fedc1400640 1 -- start start 2024-05-14T09:41:46.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.779+0000 7fedc1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedbc1530b0 0x7fedbc06da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:46.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.779+0000 7fedc1400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fedbc0c8860 0x7fedbc0c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:46.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.779+0000 7fedc1400640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedbc06dfb0 con 0x7fedbc158e70 2024-05-14T09:41:46.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.779+0000 7fedc1400640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fedbc0c83d0 con 0x7fedbc0c8860 2024-05-14T09:41:46.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.780+0000 7fedc1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fedbc0c91b0 con 0x7fedbc1530b0 2024-05-14T09:41:46.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.780+0000 7fedc0a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fedbc0c8860 0x7fedbc0c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:46.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.781+0000 7fedc0a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fedbc0c8860 0x7fedbc0c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39220/0 (socket says 172.21.15.135:39220) 2024-05-14T09:41:46.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.781+0000 7fedc0a00640 1 -- 172.21.15.135:0/1739883129 learned_addr learned my addr 172.21.15.135:0/1739883129 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:46.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.782+0000 7fedbbe00640 1 --2- 172.21.15.135:0/1739883129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedbc1530b0 0x7fedbc06da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:46.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.785+0000 7fedc0a00640 1 -- 172.21.15.135:0/1739883129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedbc1530b0 msgr2=0x7fedbc06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:46.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.785+0000 7fedc0a00640 1 --2- 172.21.15.135:0/1739883129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedbc1530b0 0x7fedbc06da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:46.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.785+0000 7fedc0a00640 1 -- 172.21.15.135:0/1739883129 >> v1:172.21.15.135:6789/0 conn(0x7fedbc158e70 legacy=0x7fedbc0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:46.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.785+0000 7fedc0a00640 1 -- 172.21.15.135:0/1739883129 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc159720 con 0x7fedbc0c8860 2024-05-14T09:41:46.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.790+0000 7fedc0a00640 1 --2- 172.21.15.135:0/1739883129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedbc0c8860 0x7fedbc0c8c70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fedb400d150 tx=0x7fedb402c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434ade2ac3554368 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:46.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.797+0000 7fedbb400640 1 -- 172.21.15.135:0/1739883129 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4009600 con 0x7fedbc0c8860 2024-05-14T09:41:46.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.797+0000 7fedbb400640 1 -- 172.21.15.135:0/1739883129 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb4037070 con 0x7fedbc0c8860 2024-05-14T09:41:46.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.797+0000 7fedbb400640 1 -- 172.21.15.135:0/1739883129 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb40099c0 con 0x7fedbc0c8860 2024-05-14T09:41:46.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.798+0000 7fedc1400640 1 -- 172.21.15.135:0/1739883129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedbc0c8860 msgr2=0x7fedbc0c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:46.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.798+0000 7fedc1400640 1 --2- 172.21.15.135:0/1739883129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedbc0c8860 0x7fedbc0c8c70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fedb400d150 tx=0x7fedb402c910 comp rx=0 tx=0).stop 2024-05-14T09:41:46.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.798+0000 7fedc1400640 1 -- 172.21.15.135:0/1739883129 shutdown_connections 2024-05-14T09:41:46.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.798+0000 7fedc1400640 1 --2- 172.21.15.135:0/1739883129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedbc0c8860 0x7fedbc0c8c70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:46.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.798+0000 7fedc1400640 1 --2- 172.21.15.135:0/1739883129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedbc1530b0 0x7fedbc06da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:46.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.798+0000 7fedc1400640 1 -- 172.21.15.135:0/1739883129 >> 172.21.15.135:0/1739883129 conn(0x7fedbc074620 msgr2=0x7fedbc0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:46.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.799+0000 7fedc1400640 1 -- 172.21.15.135:0/1739883129 shutdown_connections 2024-05-14T09:41:46.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.799+0000 7fedc1400640 1 -- 172.21.15.135:0/1739883129 wait complete. 2024-05-14T09:41:46.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.801+0000 7fedc1400640 1 Processor -- start 2024-05-14T09:41:46.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.801+0000 7fedc1400640 1 -- start start 2024-05-14T09:41:46.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.803+0000 7fedc1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedbc0c8860 0x7fedbc1f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:46.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.803+0000 7fedc1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedbc1530b0 0x7fedbc0c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:46.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.803+0000 7fedc1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fedbc158e70 0x7fedbc148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:46.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.803+0000 7fedc1400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc0c7d80 con 0x7fedbc0c8860 2024-05-14T09:41:46.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.803+0000 7fedc1400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc159ce0 con 0x7fedbc158e70 2024-05-14T09:41:46.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.803+0000 7fedc1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fedbc0c8060 con 0x7fedbc1530b0 2024-05-14T09:41:46.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.804+0000 7fedbbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedbc0c8860 0x7fedbc1f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:46.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.805+0000 7fedb3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedbc1530b0 0x7fedbc0c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:46.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.805+0000 7fedc0a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fedbc158e70 0x7fedbc148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:46.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.805+0000 7fedbbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedbc0c8860 0x7fedbc1f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39222/0 (socket says 172.21.15.135:39222) 2024-05-14T09:41:46.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.805+0000 7fedbbe00640 1 -- 172.21.15.135:0/3728279921 learned_addr learned my addr 172.21.15.135:0/3728279921 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:46.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.809+0000 7fedbbe00640 1 -- 172.21.15.135:0/3728279921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedbc1530b0 msgr2=0x7fedbc0c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:46.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.809+0000 7fedbbe00640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedbc1530b0 0x7fedbc0c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:46.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.809+0000 7fedbbe00640 1 -- 172.21.15.135:0/3728279921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fedbc158e70 msgr2=0x7fedbc148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:46.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.809+0000 7fedbbe00640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fedbc158e70 0x7fedbc148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:46.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.809+0000 7fedbbe00640 1 -- 172.21.15.135:0/3728279921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc14eb30 con 0x7fedbc0c8860 2024-05-14T09:41:46.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.813+0000 7fedbbe00640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedbc0c8860 0x7fedbc1f5880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fedac00e8a0 tx=0x7fedac00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:46.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.821+0000 7fedb8c00640 1 -- 172.21.15.135:0/3728279921 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac017070 con 0x7fedbc0c8860 2024-05-14T09:41:46.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.821+0000 7fedb8c00640 1 -- 172.21.15.135:0/3728279921 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedac00c940 con 0x7fedbc0c8860 2024-05-14T09:41:46.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.821+0000 7fedc1400640 1 -- 172.21.15.135:0/3728279921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedbc14f0b0 con 0x7fedbc0c8860 2024-05-14T09:41:46.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.822+0000 7fedb8c00640 1 -- 172.21.15.135:0/3728279921 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac00cd30 con 0x7fedbc0c8860 2024-05-14T09:41:46.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.822+0000 7fedc1400640 1 -- 172.21.15.135:0/3728279921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedbc0cc8a0 con 0x7fedbc0c8860 2024-05-14T09:41:46.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.824+0000 7fedc1400640 1 -- 172.21.15.135:0/3728279921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedbc069980 con 0x7fedbc0c8860 2024-05-14T09:41:46.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.858+0000 7fedb8c00640 1 -- 172.21.15.135:0/3728279921 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fedac01a070 con 0x7fedbc0c8860 2024-05-14T09:41:46.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.861+0000 7fedb8c00640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fed98076320 0x7fed98078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:46.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.861+0000 7fedb3400640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fed98076320 0x7fed98078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:46.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:46.862+0000 7fedb3400640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fed98076320 0x7fed98078830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedbc151ea0 tx=0x7feda4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:47.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.213+0000 7fedb8c00640 1 -- 172.21.15.135:0/3728279921 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fedac05d1e0 con 0x7fedbc0c8860 2024-05-14T09:41:47.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.215+0000 7fedb8c00640 1 -- 172.21.15.135:0/3728279921 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fedac060f50 con 0x7fedbc0c8860 2024-05-14T09:41:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.483+0000 7fedc1400640 1 -- 172.21.15.135:0/3728279921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedbc06d3d0 con 0x7fedbc0c8860 2024-05-14T09:41:47.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.511+0000 7fedb8c00640 1 -- 172.21.15.135:0/3728279921 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6888 (secure 0 0 0) 0x7fedac065250 con 0x7fedbc0c8860 2024-05-14T09:41:47.511 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:47.511 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4032169993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4032169993},{"type":"v1","addr":"172.21.15.135:6837","nonce":4032169993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/1397919075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":1397919075},{"type":"v1","addr":"172.21.15.196:6833","nonce":1397919075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/4240420134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":4240420134},{"type":"v1","addr":"172.21.15.196:6835","nonce":4240420134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T09:40:45.555908+0000","modified":"2024-05-14T09:41:31.018579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4255,"mds_1":4252,"mds_2":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":15,"addr":"172.21.15.135:6835/3270089159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3270089159},{"type":"v1","addr":"172.21.15.135:6835","nonce":3270089159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4252":{"gid":4252,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":14,"addr":"172.21.15.135:6839/2302038485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2302038485},{"type":"v1","addr":"172.21.15.135:6839","nonce":2302038485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6837/3644723215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3644723215},{"type":"v1","addr":"172.21.15.196:6837","nonce":3644723215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4240,4252,4255]},"id":1}]} 2024-05-14T09:41:47.512 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 14 2024-05-14T09:41:47.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 -- 172.21.15.135:0/3728279921 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fed98076320 msgr2=0x7fed98078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:47.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fed98076320 0x7fed98078830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedbc151ea0 tx=0x7feda4009040 comp rx=0 tx=0).stop 2024-05-14T09:41:47.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 -- 172.21.15.135:0/3728279921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedbc0c8860 msgr2=0x7fedbc1f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:47.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedbc0c8860 0x7fedbc1f5880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fedac00e8a0 tx=0x7fedac00ed60 comp rx=0 tx=0).stop 2024-05-14T09:41:47.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 -- 172.21.15.135:0/3728279921 shutdown_connections 2024-05-14T09:41:47.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fed98076320 0x7fed98078830 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:47.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fedbc158e70 0x7fedbc148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:47.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedbc1530b0 0x7fedbc0c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:47.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 --2- 172.21.15.135:0/3728279921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedbc0c8860 0x7fedbc1f5880 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:47.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 -- 172.21.15.135:0/3728279921 >> 172.21.15.135:0/3728279921 conn(0x7fedbc074620 msgr2=0x7fedbc152100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:47.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 -- 172.21.15.135:0/3728279921 shutdown_connections 2024-05-14T09:41:47.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.514+0000 7fedc1400640 1 -- 172.21.15.135:0/3728279921 wait complete. 2024-05-14T09:41:47.540 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T09:41:47.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.808+0000 7f975b200640 1 Processor -- start 2024-05-14T09:41:47.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.808+0000 7f975b200640 1 -- start start 2024-05-14T09:41:47.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.810+0000 7f975b200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f975c0c66d0 0x7f975c0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:47.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.810+0000 7f975b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f975c156460 0x7f975c160080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:47.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.810+0000 7f975b200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f975c15ced0 con 0x7f975c1605c0 2024-05-14T09:41:47.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.810+0000 7f975b200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f975c0ce090 con 0x7f975c0c66d0 2024-05-14T09:41:47.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.810+0000 7f975b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f975c0cddb0 con 0x7f975c156460 2024-05-14T09:41:47.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.812+0000 7f9759e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f975c0c66d0 0x7f975c0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:47.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.812+0000 7f9751400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f975c156460 0x7f975c160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:47.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.813+0000 7f975a800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f975c1605c0 0x7f975c0cce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:60030/0 (socket says 172.21.15.135:60030) 2024-05-14T09:41:47.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.813+0000 7f975a800640 1 -- 172.21.15.135:0/2931412360 learned_addr learned my addr 172.21.15.135:0/2931412360 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:47.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.819+0000 7f9759e00640 1 -- 172.21.15.135:0/2931412360 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f975c156460 msgr2=0x7f975c160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:47.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.819+0000 7f9759e00640 1 --2- 172.21.15.135:0/2931412360 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f975c156460 0x7f975c160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:47.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.819+0000 7f9759e00640 1 -- 172.21.15.135:0/2931412360 >> v1:172.21.15.196:6789/0 conn(0x7f975c1605c0 legacy=0x7f975c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:47.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.819+0000 7f9759e00640 1 -- 172.21.15.135:0/2931412360 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c15d170 con 0x7f975c0c66d0 2024-05-14T09:41:47.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.828+0000 7f9759e00640 1 --2- 172.21.15.135:0/2931412360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f975c0c66d0 0x7f975c0c6eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f974c009d90 tx=0x7f974c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379fd4bede11f8a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.848+0000 7f9759400640 1 -- 172.21.15.135:0/2931412360 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c007740 con 0x7f975c0c66d0 2024-05-14T09:41:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.848+0000 7f9759400640 1 -- 172.21.15.135:0/2931412360 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974c0078e0 con 0x7f975c0c66d0 2024-05-14T09:41:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.848+0000 7f9759400640 1 -- 172.21.15.135:0/2931412360 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c007cb0 con 0x7f975c0c66d0 2024-05-14T09:41:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.850+0000 7f975b200640 1 -- 172.21.15.135:0/2931412360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f975c0c66d0 msgr2=0x7f975c0c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.850+0000 7f975b200640 1 --2- 172.21.15.135:0/2931412360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f975c0c66d0 0x7f975c0c6eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f974c009d90 tx=0x7f974c02a6f0 comp rx=0 tx=0).stop 2024-05-14T09:41:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.850+0000 7f975b200640 1 -- 172.21.15.135:0/2931412360 shutdown_connections 2024-05-14T09:41:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.850+0000 7f975b200640 1 --2- 172.21.15.135:0/2931412360 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f975c156460 0x7f975c160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.850+0000 7f975b200640 1 --2- 172.21.15.135:0/2931412360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f975c0c66d0 0x7f975c0c6eb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.850+0000 7f975b200640 1 -- 172.21.15.135:0/2931412360 >> 172.21.15.135:0/2931412360 conn(0x7f975c0d1970 msgr2=0x7f975c0d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.850+0000 7f975b200640 1 -- 172.21.15.135:0/2931412360 shutdown_connections 2024-05-14T09:41:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.850+0000 7f975b200640 1 -- 172.21.15.135:0/2931412360 wait complete. 2024-05-14T09:41:47.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.855+0000 7f975b200640 1 Processor -- start 2024-05-14T09:41:47.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.855+0000 7f975b200640 1 -- start start 2024-05-14T09:41:47.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.858+0000 7f975b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f975c0c66d0 0x7f975c1f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:47.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.858+0000 7f975b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c156460 0x7f975c1e8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:47.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.858+0000 7f975b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f975c1605c0 0x7f975c14f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:47.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.858+0000 7f975b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f975c06ca60 con 0x7f975c156460 2024-05-14T09:41:47.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.858+0000 7f975b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f975c15fb60 con 0x7f975c0c66d0 2024-05-14T09:41:47.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.858+0000 7f975b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f975c0c76b0 con 0x7f975c1605c0 2024-05-14T09:41:47.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.859+0000 7f9751400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c156460 0x7f975c1e8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:47.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.860+0000 7f9751400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c156460 0x7f975c1e8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39224/0 (socket says 172.21.15.135:39224) 2024-05-14T09:41:47.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.860+0000 7f9751400640 1 -- 172.21.15.135:0/495361771 learned_addr learned my addr 172.21.15.135:0/495361771 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:47.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.860+0000 7f9759e00640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f975c0c66d0 0x7f975c1f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:47.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.861+0000 7f975a800640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f975c1605c0 0x7f975c14f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:47.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.865+0000 7f9751400640 1 -- 172.21.15.135:0/495361771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f975c1605c0 msgr2=0x7f975c14f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:47.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.865+0000 7f9751400640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f975c1605c0 0x7f975c14f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:47.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.865+0000 7f9751400640 1 -- 172.21.15.135:0/495361771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f975c0c66d0 msgr2=0x7f975c1f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:47.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.865+0000 7f9751400640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f975c0c66d0 0x7f975c1f5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:47.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.865+0000 7f9751400640 1 -- 172.21.15.135:0/495361771 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c15ad60 con 0x7f975c156460 2024-05-14T09:41:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.871+0000 7f9751400640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c156460 0x7f975c1e8ff0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f974400e8a0 tx=0x7f974400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:47.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.878+0000 7f9752a00640 1 -- 172.21.15.135:0/495361771 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744017070 con 0x7f975c156460 2024-05-14T09:41:47.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.878+0000 7f9752a00640 1 -- 172.21.15.135:0/495361771 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974400ee90 con 0x7f975c156460 2024-05-14T09:41:47.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.878+0000 7f9752a00640 1 -- 172.21.15.135:0/495361771 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974400cb40 con 0x7f975c156460 2024-05-14T09:41:47.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.878+0000 7f975b200640 1 -- 172.21.15.135:0/495361771 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975c1f6360 con 0x7f975c156460 2024-05-14T09:41:47.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.879+0000 7f975b200640 1 -- 172.21.15.135:0/495361771 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975c15aa80 con 0x7f975c156460 2024-05-14T09:41:47.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:47.880+0000 7f975b200640 1 -- 172.21.15.135:0/495361771 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975c069980 con 0x7f975c156460 2024-05-14T09:41:48.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.225+0000 7f9752a00640 1 -- 172.21.15.135:0/495361771 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f974401a070 con 0x7f975c156460 2024-05-14T09:41:48.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.227+0000 7f9752a00640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9738076320 0x7f9738078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:48.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.228+0000 7f9759e00640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9738076320 0x7f9738078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:48.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.229+0000 7f9759e00640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9738076320 0x7f9738078830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f974c034000 tx=0x7f974c033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:48.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.254+0000 7f9752a00640 1 -- 172.21.15.135:0/495361771 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f974405d110 con 0x7f975c156460 2024-05-14T09:41:48.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.254+0000 7f9752a00640 1 -- 172.21.15.135:0/495361771 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f97440c5990 con 0x7f975c156460 2024-05-14T09:41:48.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.472+0000 7f975b200640 1 -- 172.21.15.135:0/495361771 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f975c0cd9a0 con 0x7f975c156460 2024-05-14T09:41:48.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.521+0000 7f9752a00640 1 -- 172.21.15.135:0/495361771 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+18997 (secure 0 0 0) 0x7f9744060e80 con 0x7f975c156460 2024-05-14T09:41:48.521 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:48.522 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":33,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:41:04.087625+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:40:40.770106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:40:43.375791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:40:51.210089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T09:41:48.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 -- 172.21.15.135:0/495361771 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9738076320 msgr2=0x7f9738078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:48.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9738076320 0x7f9738078830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f974c034000 tx=0x7f974c033040 comp rx=0 tx=0).stop 2024-05-14T09:41:48.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 -- 172.21.15.135:0/495361771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c156460 msgr2=0x7f975c1e8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:48.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c156460 0x7f975c1e8ff0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f974400e8a0 tx=0x7f974400ed60 comp rx=0 tx=0).stop 2024-05-14T09:41:48.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 -- 172.21.15.135:0/495361771 shutdown_connections 2024-05-14T09:41:48.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f9738076320 0x7f9738078830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:48.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f975c1605c0 0x7f975c14f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:48.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c156460 0x7f975c1e8ff0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:48.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 --2- 172.21.15.135:0/495361771 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f975c0c66d0 0x7f975c1f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:48.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 -- 172.21.15.135:0/495361771 >> 172.21.15.135:0/495361771 conn(0x7f975c0d1970 msgr2=0x7f975c0cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:48.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 -- 172.21.15.135:0/495361771 shutdown_connections 2024-05-14T09:41:48.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.524+0000 7f975b200640 1 -- 172.21.15.135:0/495361771 wait complete. 2024-05-14T09:41:48.550 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T09:41:48.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.810+0000 7f3100c00640 1 Processor -- start 2024-05-14T09:41:48.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.811+0000 7f3100c00640 1 -- start start 2024-05-14T09:41:48.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.813+0000 7f3100c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f30fc1530b0 0x7f30fc06da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:48.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.813+0000 7f3100c00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30fc06dfb0 con 0x7f30fc0c8860 2024-05-14T09:41:48.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.813+0000 7f3100c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30fc159720 con 0x7f30fc158e70 2024-05-14T09:41:48.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.813+0000 7f3100c00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f30fc0c83d0 con 0x7f30fc1530b0 2024-05-14T09:41:48.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.815+0000 7f30fb400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f30fc1530b0 0x7f30fc06da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:48.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.815+0000 7f30fb400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f30fc1530b0 0x7f30fc06da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39238/0 (socket says 172.21.15.135:39238) 2024-05-14T09:41:48.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.815+0000 7f30fb400640 1 -- 172.21.15.135:0/3419478193 learned_addr learned my addr 172.21.15.135:0/3419478193 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.927+0000 7f30fb400640 1 -- 172.21.15.135:0/3419478193 >> v1:172.21.15.196:6789/0 conn(0x7f30fc158e70 legacy=0x7f30fc0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.927+0000 7f30fb400640 1 -- 172.21.15.135:0/3419478193 >> v1:172.21.15.135:6789/0 conn(0x7f30fc0c8860 legacy=0x7f30fc0c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:48.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.927+0000 7f30fb400640 1 -- 172.21.15.135:0/3419478193 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc159a00 con 0x7f30fc1530b0 2024-05-14T09:41:48.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.935+0000 7f30fb400640 1 --2- 172.21.15.135:0/3419478193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30fc1530b0 0x7f30fc06da70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009870 tx=0x7f30ec02c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8512476ad20ee30 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:48.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.944+0000 7f30faa00640 1 -- 172.21.15.135:0/3419478193 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec038070 con 0x7f30fc1530b0 2024-05-14T09:41:48.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.944+0000 7f30faa00640 1 -- 172.21.15.135:0/3419478193 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec031710 con 0x7f30fc1530b0 2024-05-14T09:41:48.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.944+0000 7f30faa00640 1 -- 172.21.15.135:0/3419478193 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec031ae0 con 0x7f30fc1530b0 2024-05-14T09:41:48.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.946+0000 7f3100c00640 1 -- 172.21.15.135:0/3419478193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30fc1530b0 msgr2=0x7f30fc06da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:48.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.946+0000 7f3100c00640 1 --2- 172.21.15.135:0/3419478193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30fc1530b0 0x7f30fc06da70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009870 tx=0x7f30ec02c480 comp rx=0 tx=0).stop 2024-05-14T09:41:48.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.946+0000 7f3100c00640 1 -- 172.21.15.135:0/3419478193 shutdown_connections 2024-05-14T09:41:48.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.946+0000 7f3100c00640 1 --2- 172.21.15.135:0/3419478193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30fc1530b0 0x7f30fc06da70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:48.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.947+0000 7f3100c00640 1 -- 172.21.15.135:0/3419478193 >> 172.21.15.135:0/3419478193 conn(0x7f30fc074620 msgr2=0x7f30fc0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:48.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.947+0000 7f3100c00640 1 -- 172.21.15.135:0/3419478193 shutdown_connections 2024-05-14T09:41:48.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.947+0000 7f3100c00640 1 -- 172.21.15.135:0/3419478193 wait complete. 2024-05-14T09:41:48.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.952+0000 7f3100c00640 1 Processor -- start 2024-05-14T09:41:48.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.952+0000 7f3100c00640 1 -- start start 2024-05-14T09:41:48.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.956+0000 7f3100c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30fc0c8860 0x7f30fc0c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:48.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.956+0000 7f3100c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30fc1530b0 0x7f30fc14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:48.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.956+0000 7f3100c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30fc158e70 0x7f30fc1e24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:48.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.956+0000 7f3100c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc0c8060 con 0x7f30fc158e70 2024-05-14T09:41:48.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.956+0000 7f3100c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc0c7d80 con 0x7f30fc0c8860 2024-05-14T09:41:48.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.956+0000 7f3100c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f30fc1534c0 con 0x7f30fc1530b0 2024-05-14T09:41:48.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.957+0000 7f30fb400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30fc0c8860 0x7f30fc0c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.958+0000 7f30fb400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30fc0c8860 0x7f30fc0c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:38926/0 (socket says 172.21.15.135:38926) 2024-05-14T09:41:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.958+0000 7f30fb400640 1 -- 172.21.15.135:0/1585344856 learned_addr learned my addr 172.21.15.135:0/1585344856 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.958+0000 7f30f3e00640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30fc1530b0 0x7f30fc14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:48.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.960+0000 7f30fbe00640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30fc158e70 0x7f30fc1e24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:48.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.965+0000 7f30fb400640 1 -- 172.21.15.135:0/1585344856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30fc1530b0 msgr2=0x7f30fc14d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:48.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.965+0000 7f30fb400640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30fc1530b0 0x7f30fc14d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:48.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.965+0000 7f30fb400640 1 -- 172.21.15.135:0/1585344856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30fc158e70 msgr2=0x7f30fc1e24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:48.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.965+0000 7f30fb400640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30fc158e70 0x7f30fc1e24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:48.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.965+0000 7f30fb400640 1 -- 172.21.15.135:0/1585344856 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc14c410 con 0x7f30fc0c8860 2024-05-14T09:41:48.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.971+0000 7f30fb400640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30fc0c8860 0x7f30fc0c4720 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009990 tx=0x7f30ec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:48.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.980+0000 7f30f3400640 1 -- 172.21.15.135:0/1585344856 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec042020 con 0x7f30fc0c8860 2024-05-14T09:41:48.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.981+0000 7f30f3400640 1 -- 172.21.15.135:0/1585344856 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec033a30 con 0x7f30fc0c8860 2024-05-14T09:41:48.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.981+0000 7f30f3400640 1 -- 172.21.15.135:0/1585344856 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec038040 con 0x7f30fc0c8860 2024-05-14T09:41:48.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.981+0000 7f3100c00640 1 -- 172.21.15.135:0/1585344856 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30fc14c6b0 con 0x7f30fc0c8860 2024-05-14T09:41:48.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.981+0000 7f3100c00640 1 -- 172.21.15.135:0/1585344856 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30fc06d4e0 con 0x7f30fc0c8860 2024-05-14T09:41:48.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:48.982+0000 7f3100c00640 1 -- 172.21.15.135:0/1585344856 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30fc069980 con 0x7f30fc0c8860 2024-05-14T09:41:49.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.037+0000 7f30f3400640 1 -- 172.21.15.135:0/1585344856 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f30ec045020 con 0x7f30fc0c8860 2024-05-14T09:41:49.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.039+0000 7f30f3400640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f30d8076320 0x7f30d8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:49.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.040+0000 7f30f3e00640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f30d8076320 0x7f30d8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:49.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.042+0000 7f30f3e00640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f30d8076320 0x7f30d8078830 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f30e4000f60 tx=0x7f30e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:49.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.043+0000 7f30f3400640 1 -- 172.21.15.135:0/1585344856 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f30ec0315f0 con 0x7f30fc0c8860 2024-05-14T09:41:49.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.384+0000 7f30f3400640 1 -- 172.21.15.135:0/1585344856 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f30ec04c030 con 0x7f30fc0c8860 2024-05-14T09:41:49.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.648+0000 7f3100c00640 1 -- 172.21.15.135:0/1585344856 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30fc14fe30 con 0x7f30fc0c8860 2024-05-14T09:41:49.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.684+0000 7f30f3400640 1 -- 172.21.15.135:0/1585344856 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6888 (secure 0 0 0) 0x7f30ec033e20 con 0x7f30fc0c8860 2024-05-14T09:41:49.685 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T09:41:49.685 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4032169993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4032169993},{"type":"v1","addr":"172.21.15.135:6837","nonce":4032169993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/1397919075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":1397919075},{"type":"v1","addr":"172.21.15.196:6833","nonce":1397919075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/4240420134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":4240420134},{"type":"v1","addr":"172.21.15.196:6835","nonce":4240420134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T09:40:45.555908+0000","modified":"2024-05-14T09:41:31.018579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4255,"mds_1":4252,"mds_2":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":15,"addr":"172.21.15.135:6835/3270089159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3270089159},{"type":"v1","addr":"172.21.15.135:6835","nonce":3270089159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4252":{"gid":4252,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":14,"addr":"172.21.15.135:6839/2302038485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2302038485},{"type":"v1","addr":"172.21.15.135:6839","nonce":2302038485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6837/3644723215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3644723215},{"type":"v1","addr":"172.21.15.196:6837","nonce":3644723215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4240,4252,4255]},"id":1}]} 2024-05-14T09:41:49.685 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 14 2024-05-14T09:41:49.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.687+0000 7f3100c00640 1 -- 172.21.15.135:0/1585344856 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f30d8076320 msgr2=0x7f30d8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:49.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.687+0000 7f3100c00640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f30d8076320 0x7f30d8078830 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f30e4000f60 tx=0x7f30e4009040 comp rx=0 tx=0).stop 2024-05-14T09:41:49.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.687+0000 7f3100c00640 1 -- 172.21.15.135:0/1585344856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30fc0c8860 msgr2=0x7f30fc0c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:49.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.687+0000 7f3100c00640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30fc0c8860 0x7f30fc0c4720 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009990 tx=0x7f30ec0046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:49.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.687+0000 7f3100c00640 1 -- 172.21.15.135:0/1585344856 shutdown_connections 2024-05-14T09:41:49.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.688+0000 7f3100c00640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f30d8076320 0x7f30d8078830 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:49.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.688+0000 7f3100c00640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30fc158e70 0x7f30fc1e24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:49.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.688+0000 7f3100c00640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f30fc1530b0 0x7f30fc14d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:49.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.688+0000 7f3100c00640 1 --2- 172.21.15.135:0/1585344856 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f30fc0c8860 0x7f30fc0c4720 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:49.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.688+0000 7f3100c00640 1 -- 172.21.15.135:0/1585344856 >> 172.21.15.135:0/1585344856 conn(0x7f30fc074620 msgr2=0x7f30fc0c8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:49.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.688+0000 7f3100c00640 1 -- 172.21.15.135:0/1585344856 shutdown_connections 2024-05-14T09:41:49.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:49.688+0000 7f3100c00640 1 -- 172.21.15.135:0/1585344856 wait complete. 2024-05-14T09:41:50.319 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T09:40:45.555908+0000', 'modified': '2024-05-14T09:41:31.018579+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4255, 'mds_1': 4252, 'mds_2': 4240}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4240': {'gid': 4240, 'name': 'e', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.135:6835/3270089159', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 3270089159}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 3270089159}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4252': {'gid': 4252, 'name': 'a', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.135:6839/2302038485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 2302038485}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 2302038485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4255': {'gid': 4255, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.196:6837/3644723215', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 3644723215}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 3644723215}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4255, 'qdb_cluster': [4240, 4252, 4255]} 2024-05-14T09:41:50.319 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-14T09:41:50.319 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-14T09:41:50.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.601+0000 7ffbe2a00640 1 Processor -- start 2024-05-14T09:41:50.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.602+0000 7ffbe2a00640 1 -- start start 2024-05-14T09:41:50.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.604+0000 7ffbe2a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffbdc152ed0 0x7ffbdc1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.604+0000 7ffbe2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbdc0c60a0 0x7ffbdc0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.604+0000 7ffbe2a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffbdc15c610 0x7ffbdc15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.604+0000 7ffbe2a00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ffbdc15a510 con 0x7ffbdc152ed0 2024-05-14T09:41:50.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.604+0000 7ffbe2a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ffbdc06c6f0 con 0x7ffbdc15c610 2024-05-14T09:41:50.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.604+0000 7ffbe2a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffbdc0c5c10 con 0x7ffbdc0c60a0 2024-05-14T09:41:50.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.605+0000 7ffbdbe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffbdc152ed0 0x7ffbdc1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.605+0000 7ffbe0a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffbdc15c610 0x7ffbdc15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.605+0000 7ffbdbe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ffbdc152ed0 0x7ffbdc1532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39252/0 (socket says 172.21.15.135:39252) 2024-05-14T09:41:50.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.605+0000 7ffbdbe00640 1 -- 172.21.15.135:0/1923958888 learned_addr learned my addr 172.21.15.135:0/1923958888 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:50.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.606+0000 7ffbd3400640 1 --2- 172.21.15.135:0/1923958888 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbdc0c60a0 0x7ffbdc0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.609+0000 7ffbdbe00640 1 -- 172.21.15.135:0/1923958888 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbdc0c60a0 msgr2=0x7ffbdc0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:50.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.609+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/1923958888 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbdc0c60a0 0x7ffbdc0c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.609+0000 7ffbdbe00640 1 -- 172.21.15.135:0/1923958888 >> v2:172.21.15.196:3300/0 conn(0x7ffbdc15c610 msgr2=0x7ffbdc15ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:50.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.609+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/1923958888 >> v2:172.21.15.196:3300/0 conn(0x7ffbdc15c610 0x7ffbdc15ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.609+0000 7ffbdbe00640 1 -- 172.21.15.135:0/1923958888 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc0c5900 con 0x7ffbdc152ed0 2024-05-14T09:41:50.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.611+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/1923958888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbdc152ed0 0x7ffbdc1532e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc070510 tx=0x7ffbcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6846a9564d4cca8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:50.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.616+0000 7ffbdb400640 1 -- 172.21.15.135:0/1923958888 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc037070 con 0x7ffbdc152ed0 2024-05-14T09:41:50.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.616+0000 7ffbdb400640 1 -- 172.21.15.135:0/1923958888 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbcc032440 con 0x7ffbdc152ed0 2024-05-14T09:41:50.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.616+0000 7ffbdb400640 1 -- 172.21.15.135:0/1923958888 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc032810 con 0x7ffbdc152ed0 2024-05-14T09:41:50.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.617+0000 7ffbe2a00640 1 -- 172.21.15.135:0/1923958888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbdc152ed0 msgr2=0x7ffbdc1532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:50.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.617+0000 7ffbe2a00640 1 --2- 172.21.15.135:0/1923958888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbdc152ed0 0x7ffbdc1532e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc070510 tx=0x7ffbcc02a270 comp rx=0 tx=0).stop 2024-05-14T09:41:50.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.617+0000 7ffbe2a00640 1 -- 172.21.15.135:0/1923958888 shutdown_connections 2024-05-14T09:41:50.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.617+0000 7ffbe2a00640 1 --2- 172.21.15.135:0/1923958888 >> v2:172.21.15.196:3300/0 conn(0x7ffbdc15c610 0x7ffbdc15ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.617+0000 7ffbe2a00640 1 --2- 172.21.15.135:0/1923958888 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbdc0c60a0 0x7ffbdc0c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.617+0000 7ffbe2a00640 1 --2- 172.21.15.135:0/1923958888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbdc152ed0 0x7ffbdc1532e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.617+0000 7ffbe2a00640 1 -- 172.21.15.135:0/1923958888 >> 172.21.15.135:0/1923958888 conn(0x7ffbdc073d40 msgr2=0x7ffbdc074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:50.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.617+0000 7ffbe2a00640 1 -- 172.21.15.135:0/1923958888 shutdown_connections 2024-05-14T09:41:50.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.617+0000 7ffbe2a00640 1 -- 172.21.15.135:0/1923958888 wait complete. 2024-05-14T09:41:50.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.620+0000 7ffbe2a00640 1 Processor -- start 2024-05-14T09:41:50.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.620+0000 7ffbe2a00640 1 -- start start 2024-05-14T09:41:50.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.621+0000 7ffbe2a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbdc0c60a0 0x7ffbdc1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.621+0000 7ffbe2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbdc152ed0 0x7ffbdc157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.621+0000 7ffbe2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbdc15c610 0x7ffbdc14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.621+0000 7ffbe2a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc15d290 con 0x7ffbdc152ed0 2024-05-14T09:41:50.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.621+0000 7ffbe2a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc0c69f0 con 0x7ffbdc0c60a0 2024-05-14T09:41:50.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.621+0000 7ffbe2a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffbdc06cc20 con 0x7ffbdc15c610 2024-05-14T09:41:50.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.622+0000 7ffbd3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbdc152ed0 0x7ffbdc157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.623+0000 7ffbd3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbdc152ed0 0x7ffbdc157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39254/0 (socket says 172.21.15.135:39254) 2024-05-14T09:41:50.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.623+0000 7ffbd3400640 1 -- 172.21.15.135:0/4179061601 learned_addr learned my addr 172.21.15.135:0/4179061601 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:50.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.623+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbdc0c60a0 0x7ffbdc1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.623+0000 7ffbe0a00640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbdc15c610 0x7ffbdc14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.627+0000 7ffbd3400640 1 -- 172.21.15.135:0/4179061601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbdc15c610 msgr2=0x7ffbdc14efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.627+0000 7ffbd3400640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbdc15c610 0x7ffbdc14efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.627+0000 7ffbd3400640 1 -- 172.21.15.135:0/4179061601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbdc0c60a0 msgr2=0x7ffbdc1595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.627+0000 7ffbd3400640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbdc0c60a0 0x7ffbdc1595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.627+0000 7ffbd3400640 1 -- 172.21.15.135:0/4179061601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc159af0 con 0x7ffbdc152ed0 2024-05-14T09:41:50.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.630+0000 7ffbd3400640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbdc152ed0 0x7ffbdc157a90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4007e60 tx=0x7ffbc400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:50.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.635+0000 7ffbd8c00640 1 -- 172.21.15.135:0/4179061601 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4014420 con 0x7ffbdc152ed0 2024-05-14T09:41:50.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.635+0000 7ffbd8c00640 1 -- 172.21.15.135:0/4179061601 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc4019070 con 0x7ffbdc152ed0 2024-05-14T09:41:50.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.635+0000 7ffbd8c00640 1 -- 172.21.15.135:0/4179061601 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4014800 con 0x7ffbdc152ed0 2024-05-14T09:41:50.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.635+0000 7ffbe2a00640 1 -- 172.21.15.135:0/4179061601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbdc157fd0 con 0x7ffbdc152ed0 2024-05-14T09:41:50.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.635+0000 7ffbe2a00640 1 -- 172.21.15.135:0/4179061601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbdc0bda80 con 0x7ffbdc152ed0 2024-05-14T09:41:50.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.641+0000 7ffbe999e740 1 Processor -- start 2024-05-14T09:41:50.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.641+0000 7ffbe999e740 1 -- start start 2024-05-14T09:41:50.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.644+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af6b270 0x555e7b336a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.644+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b335880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.644+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b335dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.644+0000 7ffbe999e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555e7b271790 con 0x555e7af423b0 2024-05-14T09:41:50.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.644+0000 7ffbe999e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555e7b216f20 con 0x555e7af4a590 2024-05-14T09:41:50.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.644+0000 7ffbe999e740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x555e7b26d750 con 0x555e7af6b270 2024-05-14T09:41:50.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.645+0000 7ffbd3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b335dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.646+0000 7ffbd3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b335dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:38942/0 (socket says 172.21.15.135:38942) 2024-05-14T09:41:50.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.646+0000 7ffbd3400640 1 -- 172.21.15.135:0/55554984 learned_addr learned my addr 172.21.15.135:0/55554984 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:50.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.652+0000 7ffbe0a00640 1 --2- 172.21.15.135:0/55554984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af6b270 0x555e7b336a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.653+0000 7ffbd3400640 1 -- 172.21.15.135:0/55554984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af6b270 msgr2=0x555e7b336a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:50.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.653+0000 7ffbd3400640 1 --2- 172.21.15.135:0/55554984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af6b270 0x555e7b336a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.653+0000 7ffbd3400640 1 -- 172.21.15.135:0/55554984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 msgr2=0x555e7b335880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:50.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.653+0000 7ffbd3400640 1 --2- 172.21.15.135:0/55554984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b335880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.653+0000 7ffbd3400640 1 -- 172.21.15.135:0/55554984 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e7af832d0 con 0x555e7af4a590 2024-05-14T09:41:50.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.655+0000 7ffbd3400640 1 --2- 172.21.15.135:0/55554984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b335dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4016040 tx=0x7ffbc4013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=602907d4cadfabce server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:50.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.659+0000 7ffbcbe00640 1 -- 172.21.15.135:0/55554984 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4028640 con 0x555e7af4a590 2024-05-14T09:41:50.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.661+0000 7ffbcbe00640 1 -- 172.21.15.135:0/55554984 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc40287e0 con 0x555e7af4a590 2024-05-14T09:41:50.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.661+0000 7ffbcbe00640 1 -- 172.21.15.135:0/55554984 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4028b90 con 0x555e7af4a590 2024-05-14T09:41:50.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.662+0000 7ffbe999e740 1 -- 172.21.15.135:0/55554984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 msgr2=0x555e7b335dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:50.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.662+0000 7ffbe999e740 1 --2- 172.21.15.135:0/55554984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b335dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4016040 tx=0x7ffbc4013000 comp rx=0 tx=0).stop 2024-05-14T09:41:50.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.662+0000 7ffbe999e740 1 -- 172.21.15.135:0/55554984 shutdown_connections 2024-05-14T09:41:50.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.662+0000 7ffbe999e740 1 --2- 172.21.15.135:0/55554984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b335dc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.662+0000 7ffbe999e740 1 --2- 172.21.15.135:0/55554984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b335880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.662+0000 7ffbe999e740 1 --2- 172.21.15.135:0/55554984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af6b270 0x555e7b336a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.662+0000 7ffbe999e740 1 -- 172.21.15.135:0/55554984 >> 172.21.15.135:0/55554984 conn(0x555e7af5f3c0 msgr2=0x555e7b30cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:50.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.662+0000 7ffbe999e740 1 -- 172.21.15.135:0/55554984 shutdown_connections 2024-05-14T09:41:50.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.662+0000 7ffbe999e740 1 -- 172.21.15.135:0/55554984 wait complete. 2024-05-14T09:41:50.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.664+0000 7ffbe999e740 1 -- start start 2024-05-14T09:41:50.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.664+0000 7ffbe999e740 1 Processor -- start 2024-05-14T09:41:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.668+0000 7ffbd8c00640 1 -- 172.21.15.135:0/4179061601 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffbc4028440 con 0x7ffbdc152ed0 2024-05-14T09:41:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.668+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b334d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.668+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b3353e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.668+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af6b270 0x555e7b335920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.668+0000 7ffbe999e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555e7b22a9c0 con 0x555e7af423b0 2024-05-14T09:41:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.668+0000 7ffbe999e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555e7b30cce0 con 0x555e7af4a590 2024-05-14T09:41:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.668+0000 7ffbe999e740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x555e7b35e630 con 0x555e7af6b270 2024-05-14T09:41:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.669+0000 7ffbe999e740 10 client.0 _ll_register_callbacks cb 0x555e7b1f7120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.669+0000 7ffbd8c00640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffbb8076280 0x7ffbb8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.670+0000 7ffbe0a00640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffbb8076280 0x7ffbb8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.670+0000 7ffbdbe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b3353e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.670+0000 7ffbd8c00640 1 -- 172.21.15.135:0/4179061601 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7ffbc40991a0 con 0x7ffbdc152ed0 2024-05-14T09:41:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.670+0000 7ffbe0a00640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffbb8076280 0x7ffbb8078790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009500 tx=0x7ffbd4009490 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.671+0000 7ffbd3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af6b270 0x555e7b335920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.671+0000 7ffbdbe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b3353e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:38956/0 (socket says 172.21.15.135:38956) 2024-05-14T09:41:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.671+0000 7ffbdbe00640 1 -- 172.21.15.135:0/2257494909 learned_addr learned my addr 172.21.15.135:0/2257494909 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:50.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.673+0000 7ffbe0a00640 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b334d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.677+0000 7ffbe0a00640 1 -- 172.21.15.135:0/2257494909 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af6b270 msgr2=0x555e7b335920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:50.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.677+0000 7ffbe0a00640 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af6b270 0x555e7b335920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.678+0000 7ffbe0a00640 1 -- 172.21.15.135:0/2257494909 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 msgr2=0x555e7b3353e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:50.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.678+0000 7ffbe0a00640 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b3353e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:50.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.678+0000 7ffbe0a00640 1 -- 172.21.15.135:0/2257494909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e7b04d6b0 con 0x555e7af423b0 2024-05-14T09:41:50.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.680+0000 7ffbe0a00640 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b334d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4016a40 tx=0x7ffbd4018070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb632c746a6e4b2c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:50.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.680+0000 7ffbc8c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-14T09:41:50.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.685+0000 7ffbc8c00640 1 -- 172.21.15.135:0/2257494909 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4020c20 con 0x555e7af423b0 2024-05-14T09:41:50.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.685+0000 7ffbc8c00640 1 -- 172.21.15.135:0/2257494909 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7ffbd4020dc0 con 0x555e7af423b0 2024-05-14T09:41:50.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.685+0000 7ffbe999e740 1 -- 172.21.15.135:0/2257494909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbc40287e0 con 0x555e7af423b0 2024-05-14T09:41:50.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.688+0000 7ffbc8c00640 1 -- 172.21.15.135:0/2257494909 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ffbd4021440 con 0x555e7af423b0 2024-05-14T09:41:50.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.688+0000 7ffbe999e740 10 client.4548 fetch_fsmap learned FSMap version 14 2024-05-14T09:41:50.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.688+0000 7ffbe999e740 1 -- 172.21.15.135:0/2257494909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x555e7b337e50 con 0x555e7af423b0 2024-05-14T09:41:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.695+0000 7ffbc8c00640 1 -- 172.21.15.135:0/2257494909 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc40287e0 con 0x555e7af423b0 2024-05-14T09:41:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.695+0000 7ffbc8c00640 1 -- 172.21.15.135:0/2257494909 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7ffbd40215e0 con 0x555e7af423b0 2024-05-14T09:41:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.695+0000 7ffbe999e740 10 client.4548 fetch_fsmap finished waiting for FSMap version 14 2024-05-14T09:41:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.695+0000 7ffbe999e740 10 client.4548 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-14T09:41:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.695+0000 7ffbe999e740 20 client.4548 populate_metadata read hostname 'smithi135' 2024-05-14T09:41:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.695+0000 7ffbe999e740 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.135:6834/3270089159,v1:172.21.15.135:6835/3270089159] conn(0x555e7af29e40 0x555e7b36cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.695+0000 7ffbe999e740 4 client.4548 mds_command: new command op to 4240 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:41:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.695+0000 7ffbe999e740 1 -- 172.21.15.135:0/2257494909 --> [v2:172.21.15.135:6834/3270089159,v1:172.21.15.135:6835/3270089159] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e7b27f3a0 con 0x555e7af29e40 2024-05-14T09:41:50.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.712+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.135:6834/3270089159,v1:172.21.15.135:6835/3270089159] conn(0x555e7af29e40 0x555e7b36cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:50.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.876+0000 7ffbc8c00640 10 client.4548 ms_handle_connect on v2:172.21.15.135:6834/3270089159 2024-05-14T09:41:50.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:50.876+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.135:6834/3270089159,v1:172.21.15.135:6835/3270089159] conn(0x555e7af29e40 0x555e7b36cd60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=92196a183ca595fd server_cookie=2a5bcc9d383e2b21 in_seq=0 out_seq=0 2024-05-14T09:41:51.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.112+0000 7ffbc8c00640 1 -- 172.21.15.135:0/2257494909 <== mds.2 v2:172.21.15.135:6834/3270089159 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555e7b27f3a0 con 0x555e7af29e40 2024-05-14T09:41:51.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.112+0000 7ffbc8c00640 10 client.4548 handle_command_reply: tid=0 2024-05-14T09:41:51.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.112+0000 7ffbe999e740 1 client.4548 shutdown 2024-05-14T09:41:51.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.113+0000 7ffbe999e740 1 -- 172.21.15.135:0/2257494909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 msgr2=0x555e7b334d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.113+0000 7ffbe999e740 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b334d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4016a40 tx=0x7ffbd4018070 comp rx=0 tx=0).stop 2024-05-14T09:41:51.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.113+0000 7ffbe999e740 1 -- 172.21.15.135:0/2257494909 shutdown_connections 2024-05-14T09:41:51.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.113+0000 7ffbe999e740 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.135:6834/3270089159,v1:172.21.15.135:6835/3270089159] conn(0x555e7af29e40 0x555e7b36cd60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.113+0000 7ffbe999e740 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b3353e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.113+0000 7ffbe999e740 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af6b270 0x555e7b335920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.113+0000 7ffbe999e740 1 --2- 172.21.15.135:0/2257494909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b334d50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.113+0000 7ffbe999e740 1 -- 172.21.15.135:0/2257494909 >> 172.21.15.135:0/2257494909 conn(0x555e7af5f3c0 msgr2=0x555e7b336a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.113+0000 7ffbc8c00640 0 client.4548 ms_handle_reset on v2:172.21.15.135:6834/3270089159 2024-05-14T09:41:51.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.113+0000 7ffbe999e740 1 -- 172.21.15.135:0/2257494909 shutdown_connections 2024-05-14T09:41:51.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.113+0000 7ffbe999e740 1 -- 172.21.15.135:0/2257494909 wait complete. 2024-05-14T09:41:51.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.114+0000 7ffbe999e740 20 client.4548 trim_cache size 0 max 16384 2024-05-14T09:41:51.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.144+0000 7ffbe999e740 1 Processor -- start 2024-05-14T09:41:51.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.145+0000 7ffbe999e740 1 -- start start 2024-05-14T09:41:51.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.146+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b336c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.146+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af4a590 0x555e7b338d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.146+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af6b270 0x555e7b3392b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.146+0000 7ffbe999e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc1ff1a0 con 0x555e7af423b0 2024-05-14T09:41:51.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.146+0000 7ffbe999e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555e7b307d30 con 0x555e7af6b270 2024-05-14T09:41:51.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.146+0000 7ffbe999e740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x555e7b338830 con 0x555e7af4a590 2024-05-14T09:41:51.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.147+0000 7ffbdbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b336c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.148+0000 7ffbdbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b336c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39282/0 (socket says 172.21.15.135:39282) 2024-05-14T09:41:51.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.148+0000 7ffbdbe00640 1 -- 172.21.15.135:0/1673652034 learned_addr learned my addr 172.21.15.135:0/1673652034 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:51.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.148+0000 7ffbd3400640 1 --2- 172.21.15.135:0/1673652034 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af4a590 0x555e7b338d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.152+0000 7ffbdbe00640 1 -- 172.21.15.135:0/1673652034 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af4a590 msgr2=0x555e7b338d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.152+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/1673652034 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af4a590 0x555e7b338d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.152+0000 7ffbdbe00640 1 -- 172.21.15.135:0/1673652034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af6b270 msgr2=0x555e7b3392b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.152+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/1673652034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af6b270 0x555e7b3392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.152+0000 7ffbdbe00640 1 -- 172.21.15.135:0/1673652034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e7b2fa3a0 con 0x555e7af423b0 2024-05-14T09:41:51.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.155+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/1673652034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b336c40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009930 tx=0x7ffbcc02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4dc1ff76c00b158 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.180+0000 7ffbcb400640 1 -- 172.21.15.135:0/1673652034 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc037040 con 0x555e7af423b0 2024-05-14T09:41:51.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.180+0000 7ffbcb400640 1 -- 172.21.15.135:0/1673652034 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbcc0326c0 con 0x555e7af423b0 2024-05-14T09:41:51.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.180+0000 7ffbcb400640 1 -- 172.21.15.135:0/1673652034 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc032a70 con 0x555e7af423b0 2024-05-14T09:41:51.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.182+0000 7ffbe999e740 1 -- 172.21.15.135:0/1673652034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 msgr2=0x555e7b336c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.182+0000 7ffbe999e740 1 --2- 172.21.15.135:0/1673652034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b336c40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009930 tx=0x7ffbcc02c070 comp rx=0 tx=0).stop 2024-05-14T09:41:51.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.182+0000 7ffbe999e740 1 -- 172.21.15.135:0/1673652034 shutdown_connections 2024-05-14T09:41:51.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.182+0000 7ffbe999e740 1 --2- 172.21.15.135:0/1673652034 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af6b270 0x555e7b3392b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.182+0000 7ffbe999e740 1 --2- 172.21.15.135:0/1673652034 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af4a590 0x555e7b338d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.182+0000 7ffbe999e740 1 --2- 172.21.15.135:0/1673652034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af423b0 0x555e7b336c40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.182+0000 7ffbe999e740 1 -- 172.21.15.135:0/1673652034 >> 172.21.15.135:0/1673652034 conn(0x555e7af5f3c0 msgr2=0x555e7b308230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.182+0000 7ffbe999e740 1 -- 172.21.15.135:0/1673652034 shutdown_connections 2024-05-14T09:41:51.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.182+0000 7ffbe999e740 1 -- 172.21.15.135:0/1673652034 wait complete. 2024-05-14T09:41:51.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.184+0000 7ffbe999e740 1 -- start start 2024-05-14T09:41:51.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.184+0000 7ffbe999e740 1 Processor -- start 2024-05-14T09:41:51.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.187+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af423b0 0x555e7b3d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.188+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b3c6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.188+0000 7ffbe999e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af6b270 0x555e7b3c6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.188+0000 7ffbe999e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555e7b339800 con 0x555e7af6b270 2024-05-14T09:41:51.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.188+0000 7ffbe999e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555e7b33a710 con 0x555e7af4a590 2024-05-14T09:41:51.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.188+0000 7ffbe999e740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x555e7b3619d0 con 0x555e7af423b0 2024-05-14T09:41:51.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.188+0000 7ffbe999e740 10 client.0 _ll_register_callbacks cb 0x7ffbd4009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:51.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.189+0000 7ffbe0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af6b270 0x555e7b3c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.189+0000 7ffbe0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af6b270 0x555e7b3c6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39288/0 (socket says 172.21.15.135:39288) 2024-05-14T09:41:51.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.189+0000 7ffbe0a00640 1 -- 172.21.15.135:0/4040988833 learned_addr learned my addr 172.21.15.135:0/4040988833 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:51.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.189+0000 7ffbd3400640 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b3c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.189+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af423b0 0x555e7b3d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.193+0000 7ffbe0a00640 1 -- 172.21.15.135:0/4040988833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af423b0 msgr2=0x555e7b3d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.193+0000 7ffbe0a00640 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af423b0 0x555e7b3d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.193+0000 7ffbe0a00640 1 -- 172.21.15.135:0/4040988833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 msgr2=0x555e7b3c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.193+0000 7ffbe0a00640 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b3c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.193+0000 7ffbe0a00640 1 -- 172.21.15.135:0/4040988833 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e7b3373f0 con 0x555e7af6b270 2024-05-14T09:41:51.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.197+0000 7ffbe0a00640 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af6b270 0x555e7b3c6790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400a010 tx=0x7ffbd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c0dff7da5f0deb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.197+0000 7ffbc8c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-14T09:41:51.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.201+0000 7ffbc8c00640 1 -- 172.21.15.135:0/4040988833 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4000e60 con 0x555e7af6b270 2024-05-14T09:41:51.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.201+0000 7ffbc8c00640 1 -- 172.21.15.135:0/4040988833 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7ffbd4020e20 con 0x555e7af6b270 2024-05-14T09:41:51.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.201+0000 7ffbe999e740 1 -- 172.21.15.135:0/4040988833 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbcc0326c0 con 0x555e7af6b270 2024-05-14T09:41:51.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.203+0000 7ffbc8c00640 1 -- 172.21.15.135:0/4040988833 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ffbd4005990 con 0x555e7af6b270 2024-05-14T09:41:51.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.203+0000 7ffbe999e740 10 client.4554 fetch_fsmap learned FSMap version 14 2024-05-14T09:41:51.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.203+0000 7ffbe999e740 1 -- 172.21.15.135:0/4040988833 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x555e7b34b0d0 con 0x555e7af6b270 2024-05-14T09:41:51.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.210+0000 7ffbc8c00640 1 -- 172.21.15.135:0/4040988833 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbcc0326c0 con 0x555e7af6b270 2024-05-14T09:41:51.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.210+0000 7ffbc8c00640 1 -- 172.21.15.135:0/4040988833 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7ffbd4005b30 con 0x555e7af6b270 2024-05-14T09:41:51.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.210+0000 7ffbe999e740 10 client.4554 fetch_fsmap finished waiting for FSMap version 14 2024-05-14T09:41:51.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.210+0000 7ffbe999e740 10 client.4554 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-14T09:41:51.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.210+0000 7ffbe999e740 20 client.4554 populate_metadata read hostname 'smithi135' 2024-05-14T09:41:51.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.211+0000 7ffbe999e740 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.135:6834/3270089159,v1:172.21.15.135:6835/3270089159] conn(0x555e7b3cd320 0x555e7b3d9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.211+0000 7ffbe999e740 4 client.4554 mds_command: new command op to 4240 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:41:51.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.211+0000 7ffbe999e740 1 -- 172.21.15.135:0/4040988833 --> [v2:172.21.15.135:6834/3270089159,v1:172.21.15.135:6835/3270089159] -- command(tid 0: {"prefix": "status"}) -- 0x555e7b279210 con 0x555e7b3cd320 2024-05-14T09:41:51.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.212+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.135:6834/3270089159,v1:172.21.15.135:6835/3270089159] conn(0x555e7b3cd320 0x555e7b3d9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.218+0000 7ffbdbe00640 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.135:6834/3270089159,v1:172.21.15.135:6835/3270089159] conn(0x555e7b3cd320 0x555e7b3d9150 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=20c1b37d96d7bfad server_cookie=ba3e3bd0ae9c09a5 in_seq=0 out_seq=0 2024-05-14T09:41:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.218+0000 7ffbc8c00640 10 client.4554 ms_handle_connect on v2:172.21.15.135:6834/3270089159 2024-05-14T09:41:51.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.247+0000 7ffbc8c00640 1 -- 172.21.15.135:0/4040988833 <== mds.2 v2:172.21.15.135:6834/3270089159 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555e7b279210 con 0x555e7b3cd320 2024-05-14T09:41:51.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.247+0000 7ffbc8c00640 10 client.4554 handle_command_reply: tid=0 2024-05-14T09:41:51.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.247+0000 7ffbe999e740 1 client.4554 shutdown 2024-05-14T09:41:51.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.248+0000 7ffbe999e740 1 -- 172.21.15.135:0/4040988833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af6b270 msgr2=0x555e7b3c6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.248+0000 7ffbe999e740 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af6b270 0x555e7b3c6790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400a010 tx=0x7ffbd40046c0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.248+0000 7ffbe999e740 1 -- 172.21.15.135:0/4040988833 shutdown_connections 2024-05-14T09:41:51.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.248+0000 7ffbe999e740 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.135:6834/3270089159,v1:172.21.15.135:6835/3270089159] conn(0x555e7b3cd320 0x555e7b3d9150 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.248+0000 7ffbe999e740 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555e7af4a590 0x555e7b3c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.248+0000 7ffbe999e740 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e7af6b270 0x555e7b3c6790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.248+0000 7ffbe999e740 1 --2- 172.21.15.135:0/4040988833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x555e7af423b0 0x555e7b3d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.248+0000 7ffbc8c00640 0 client.4554 ms_handle_reset on v2:172.21.15.135:6834/3270089159 2024-05-14T09:41:51.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.248+0000 7ffbe999e740 1 -- 172.21.15.135:0/4040988833 >> 172.21.15.135:0/4040988833 conn(0x555e7af5f3c0 msgr2=0x555e7b336c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.248+0000 7ffbe999e740 1 -- 172.21.15.135:0/4040988833 shutdown_connections 2024-05-14T09:41:51.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.248+0000 7ffbe999e740 1 -- 172.21.15.135:0/4040988833 wait complete. 2024-05-14T09:41:51.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.249+0000 7ffbe999e740 20 client.4554 trim_cache size 0 max 16384 2024-05-14T09:41:51.250 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T09:41:51.250 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "3d7e4a56-2293-41af-9139-c92eede1b811", 2024-05-14T09:41:51.250 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 2, 2024-05-14T09:41:51.250 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4240, 2024-05-14T09:41:51.250 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-14T09:41:51.250 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-14T09:41:51.250 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-14T09:41:51.250 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 21.829973418000002, 2024-05-14T09:41:51.250 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 14, 2024-05-14T09:41:51.251 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 33, 2024-05-14T09:41:51.251 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 33, 2024-05-14T09:41:51.251 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 75.215025458 2024-05-14T09:41:51.251 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.250+0000 7ffbe2a00640 1 -- 172.21.15.135:0/4179061601 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffbb8076280 msgr2=0x7ffbb8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.250+0000 7ffbe2a00640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffbb8076280 0x7ffbb8078790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009500 tx=0x7ffbd4009490 comp rx=0 tx=0).stop 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.250+0000 7ffbe2a00640 1 -- 172.21.15.135:0/4179061601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbdc152ed0 msgr2=0x7ffbdc157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.250+0000 7ffbe2a00640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbdc152ed0 0x7ffbdc157a90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4007e60 tx=0x7ffbc400e4b0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.250+0000 7ffbe2a00640 1 -- 172.21.15.135:0/4179061601 shutdown_connections 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.250+0000 7ffbe2a00640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffbb8076280 0x7ffbb8078790 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.250+0000 7ffbe2a00640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbdc15c610 0x7ffbdc14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.250+0000 7ffbe2a00640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbdc152ed0 0x7ffbdc157a90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.250+0000 7ffbe2a00640 1 --2- 172.21.15.135:0/4179061601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbdc0c60a0 0x7ffbdc1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.250+0000 7ffbe2a00640 1 -- 172.21.15.135:0/4179061601 >> 172.21.15.135:0/4179061601 conn(0x7ffbdc073d40 msgr2=0x7ffbdc0716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.251+0000 7ffbe2a00640 1 -- 172.21.15.135:0/4179061601 shutdown_connections 2024-05-14T09:41:51.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.251+0000 7ffbe2a00640 1 -- 172.21.15.135:0/4179061601 wait complete. 2024-05-14T09:41:51.281 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-14T09:41:51.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.550+0000 7f3ab8600640 1 Processor -- start 2024-05-14T09:41:51.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.550+0000 7f3ab8600640 1 -- start start 2024-05-14T09:41:51.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.552+0000 7f3ab8600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ab015ab20 0x7f3ab0153f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.552+0000 7f3ab8600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3ab0071f70 0x7f3ab006d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.552+0000 7f3ab8600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ab0074ce0 con 0x7f3ab01544b0 2024-05-14T09:41:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.552+0000 7f3ab8600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f3ab006cde0 con 0x7f3ab0071f70 2024-05-14T09:41:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.552+0000 7f3ab8600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab0074a00 con 0x7f3ab015ab20 2024-05-14T09:41:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.555+0000 7f3ab6600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3ab0071f70 0x7f3ab006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.555+0000 7f3ab5c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ab015ab20 0x7f3ab0153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.555+0000 7f3ab5200640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f3ab01544b0 0x7f3ab00c6c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:60040/0 (socket says 172.21.15.135:60040) 2024-05-14T09:41:51.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.555+0000 7f3ab5200640 1 -- 172.21.15.135:0/3948438728 learned_addr learned my addr 172.21.15.135:0/3948438728 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.565+0000 7f3ab5c00640 1 -- 172.21.15.135:0/3948438728 >> v2:172.21.15.196:3300/0 conn(0x7f3ab0071f70 msgr2=0x7f3ab006d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.565+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/3948438728 >> v2:172.21.15.196:3300/0 conn(0x7f3ab0071f70 0x7f3ab006d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.565+0000 7f3ab5c00640 1 -- 172.21.15.135:0/3948438728 >> v1:172.21.15.196:6789/0 conn(0x7f3ab01544b0 legacy=0x7f3ab00c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.565+0000 7f3ab5c00640 1 -- 172.21.15.135:0/3948438728 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab006c790 con 0x7f3ab015ab20 2024-05-14T09:41:51.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.573+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/3948438728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ab015ab20 0x7f3ab0153f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40097a0 tx=0x7f3aa402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94bd0a993b1400fc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.588+0000 7f3aafe00640 1 -- 172.21.15.135:0/3948438728 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4037070 con 0x7f3ab015ab20 2024-05-14T09:41:51.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.591+0000 7f3aafe00640 1 -- 172.21.15.135:0/3948438728 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4032440 con 0x7f3ab015ab20 2024-05-14T09:41:51.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.591+0000 7f3aafe00640 1 -- 172.21.15.135:0/3948438728 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4032810 con 0x7f3ab015ab20 2024-05-14T09:41:51.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.592+0000 7f3ab8600640 1 -- 172.21.15.135:0/3948438728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ab015ab20 msgr2=0x7f3ab0153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.592+0000 7f3ab8600640 1 --2- 172.21.15.135:0/3948438728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ab015ab20 0x7f3ab0153f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40097a0 tx=0x7f3aa402a180 comp rx=0 tx=0).stop 2024-05-14T09:41:51.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.592+0000 7f3ab8600640 1 -- 172.21.15.135:0/3948438728 shutdown_connections 2024-05-14T09:41:51.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.592+0000 7f3ab8600640 1 --2- 172.21.15.135:0/3948438728 >> v2:172.21.15.196:3300/0 conn(0x7f3ab0071f70 0x7f3ab006d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.592+0000 7f3ab8600640 1 --2- 172.21.15.135:0/3948438728 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ab015ab20 0x7f3ab0153f70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.592+0000 7f3ab8600640 1 -- 172.21.15.135:0/3948438728 >> 172.21.15.135:0/3948438728 conn(0x7f3ab0073d40 msgr2=0x7f3ab0074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.592+0000 7f3ab8600640 1 -- 172.21.15.135:0/3948438728 shutdown_connections 2024-05-14T09:41:51.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.592+0000 7f3ab8600640 1 -- 172.21.15.135:0/3948438728 wait complete. 2024-05-14T09:41:51.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.595+0000 7f3ab8600640 1 Processor -- start 2024-05-14T09:41:51.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.595+0000 7f3ab8600640 1 -- start start 2024-05-14T09:41:51.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.596+0000 7f3ab8600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ab0071f70 0x7f3ab01584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.596+0000 7f3ab8600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ab01544b0 0x7f3ab015b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.597+0000 7f3ab8600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ab015ab20 0x7f3ab015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.597+0000 7f3ab8600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab00c7380 con 0x7f3ab015ab20 2024-05-14T09:41:51.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.597+0000 7f3ab8600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab00c4690 con 0x7f3ab01544b0 2024-05-14T09:41:51.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.597+0000 7f3ab8600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab00c7500 con 0x7f3ab0071f70 2024-05-14T09:41:51.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.598+0000 7f3ab6600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ab015ab20 0x7f3ab015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.598+0000 7f3ab6600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ab015ab20 0x7f3ab015a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39292/0 (socket says 172.21.15.135:39292) 2024-05-14T09:41:51.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.598+0000 7f3ab6600640 1 -- 172.21.15.135:0/4088180376 learned_addr learned my addr 172.21.15.135:0/4088180376 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:51.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.598+0000 7f3ab5200640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ab01544b0 0x7f3ab015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.601+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ab0071f70 0x7f3ab01584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.603+0000 7f3ab6600640 1 -- 172.21.15.135:0/4088180376 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ab0071f70 msgr2=0x7f3ab01584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.603+0000 7f3ab6600640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ab0071f70 0x7f3ab01584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.604+0000 7f3ab6600640 1 -- 172.21.15.135:0/4088180376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ab01544b0 msgr2=0x7f3ab015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.604+0000 7f3ab6600640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ab01544b0 0x7f3ab015b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.604+0000 7f3ab6600640 1 -- 172.21.15.135:0/4088180376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab0158a10 con 0x7f3ab015ab20 2024-05-14T09:41:51.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.607+0000 7f3ab6600640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ab015ab20 0x7f3ab015a020 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009cb0 tx=0x7f3aa800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.611+0000 7f3aad600640 1 -- 172.21.15.135:0/4088180376 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8018020 con 0x7f3ab015ab20 2024-05-14T09:41:51.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.611+0000 7f3aad600640 1 -- 172.21.15.135:0/4088180376 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa8014480 con 0x7f3ab015ab20 2024-05-14T09:41:51.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.611+0000 7f3aad600640 1 -- 172.21.15.135:0/4088180376 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8014870 con 0x7f3ab015ab20 2024-05-14T09:41:51.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.612+0000 7f3ab8600640 1 -- 172.21.15.135:0/4088180376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab015d5e0 con 0x7f3ab015ab20 2024-05-14T09:41:51.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.612+0000 7f3ab8600640 1 -- 172.21.15.135:0/4088180376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab015db60 con 0x7f3ab015ab20 2024-05-14T09:41:51.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.616+0000 7f3abf619740 1 Processor -- start 2024-05-14T09:41:51.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.616+0000 7f3abf619740 1 -- start start 2024-05-14T09:41:51.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.618+0000 7f3abf619740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5ff270 0x564c8a9caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.618+0000 7f3abf619740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 0x564c8a9c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.618+0000 7f3abf619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5de590 0x564c8a9c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.618+0000 7f3abf619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564c8a905790 con 0x564c8a5de590 2024-05-14T09:41:51.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.618+0000 7f3abf619740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x564c8a8aaf20 con 0x564c8a5d63b0 2024-05-14T09:41:51.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.618+0000 7f3abf619740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x564c8a901750 con 0x564c8a5ff270 2024-05-14T09:41:51.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.619+0000 7f3ab5c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 0x564c8a9c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.620+0000 7f3ab5200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5ff270 0x564c8a9caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.620+0000 7f3ab5c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 0x564c8a9c9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:39010/0 (socket says 172.21.15.135:39010) 2024-05-14T09:41:51.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.620+0000 7f3ab5c00640 1 -- 172.21.15.135:0/2441660047 learned_addr learned my addr 172.21.15.135:0/2441660047 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:51.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.627+0000 7f3ab5c00640 1 -- 172.21.15.135:0/2441660047 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5ff270 msgr2=0x564c8a9caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.627+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/2441660047 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5ff270 0x564c8a9caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.627+0000 7f3ab5c00640 1 -- 172.21.15.135:0/2441660047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5de590 msgr2=0x564c8a9c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.627+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/2441660047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5de590 0x564c8a9c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.627+0000 7f3ab5c00640 1 -- 172.21.15.135:0/2441660047 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c8a6172d0 con 0x564c8a5d63b0 2024-05-14T09:41:51.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.633+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/2441660047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 0x564c8a9c9880 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4000c00 tx=0x7f3aa402c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a5a35b8c7918f29 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.640+0000 7f3aad600640 1 -- 172.21.15.135:0/4088180376 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3aa8005d10 con 0x7f3ab015ab20 2024-05-14T09:41:51.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.641+0000 7f3aad600640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3a90076350 0x7f3a90078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.641+0000 7f3ab5200640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3a90076350 0x7f3a90078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.642+0000 7f3ab5200640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3a90076350 0x7f3a90078860 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ab015e680 tx=0x7f3a9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.643+0000 7f3aa2000640 1 -- 172.21.15.135:0/2441660047 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4041070 con 0x564c8a5d63b0 2024-05-14T09:41:51.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.643+0000 7f3aa2000640 1 -- 172.21.15.135:0/2441660047 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4032800 con 0x564c8a5d63b0 2024-05-14T09:41:51.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.643+0000 7f3aa2000640 1 -- 172.21.15.135:0/2441660047 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4037040 con 0x564c8a5d63b0 2024-05-14T09:41:51.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.643+0000 7f3aad600640 1 -- 172.21.15.135:0/4088180376 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f3aa805d710 con 0x7f3ab015ab20 2024-05-14T09:41:51.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.644+0000 7f3abf619740 1 -- 172.21.15.135:0/2441660047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 msgr2=0x564c8a9c9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:51.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.644+0000 7f3abf619740 1 --2- 172.21.15.135:0/2441660047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 0x564c8a9c9880 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4000c00 tx=0x7f3aa402c000 comp rx=0 tx=0).stop 2024-05-14T09:41:51.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.645+0000 7f3abf619740 1 -- 172.21.15.135:0/2441660047 shutdown_connections 2024-05-14T09:41:51.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.645+0000 7f3abf619740 1 --2- 172.21.15.135:0/2441660047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 0x564c8a9c9880 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.645+0000 7f3abf619740 1 --2- 172.21.15.135:0/2441660047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5de590 0x564c8a9c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.645+0000 7f3abf619740 1 --2- 172.21.15.135:0/2441660047 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5ff270 0x564c8a9caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.645+0000 7f3abf619740 1 -- 172.21.15.135:0/2441660047 >> 172.21.15.135:0/2441660047 conn(0x564c8a5f33c0 msgr2=0x564c8a9a0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:51.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.645+0000 7f3abf619740 1 -- 172.21.15.135:0/2441660047 shutdown_connections 2024-05-14T09:41:51.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.645+0000 7f3abf619740 1 -- 172.21.15.135:0/2441660047 wait complete. 2024-05-14T09:41:51.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.646+0000 7f3abf619740 1 -- start start 2024-05-14T09:41:51.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.647+0000 7f3abf619740 1 Processor -- start 2024-05-14T09:41:51.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.649+0000 7f3abf619740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5d63b0 0x564c8a9e54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.649+0000 7f3abf619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5de590 0x564c8a9e1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.649+0000 7f3abf619740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5ff270 0x564c8a9e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.649+0000 7f3abf619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564c8a8be9c0 con 0x564c8a5de590 2024-05-14T09:41:51.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.649+0000 7f3abf619740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x564c8a9a0ce0 con 0x564c8a5ff270 2024-05-14T09:41:51.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.649+0000 7f3abf619740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x564c8a9e1b20 con 0x564c8a5d63b0 2024-05-14T09:41:51.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.649+0000 7f3abf619740 10 client.0 _ll_register_callbacks cb 0x564c8a88b120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:51.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.650+0000 7f3ab5200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5de590 0x564c8a9e1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.650+0000 7f3ab5200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5de590 0x564c8a9e1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39310/0 (socket says 172.21.15.135:39310) 2024-05-14T09:41:51.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.650+0000 7f3ab5200640 1 -- 172.21.15.135:0/1314657028 learned_addr learned my addr 172.21.15.135:0/1314657028 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:51.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.651+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5d63b0 0x564c8a9e54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.654+0000 7f3ab5200640 1 -- 172.21.15.135:0/1314657028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5d63b0 msgr2=0x564c8a9e54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.654+0000 7f3ab5200640 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5d63b0 0x564c8a9e54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.654+0000 7f3ab5200640 1 -- 172.21.15.135:0/1314657028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5ff270 msgr2=0x564c8a9e2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:51.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.654+0000 7f3ab5200640 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5ff270 0x564c8a9e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:51.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.654+0000 7f3ab5200640 1 -- 172.21.15.135:0/1314657028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c8a6e16b0 con 0x564c8a5de590 2024-05-14T09:41:51.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.657+0000 7f3ab5200640 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5de590 0x564c8a9e1150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c005830 tx=0x7f3a9c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee434e4ed08ad65f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:51.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.657+0000 7f3a96a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-14T09:41:51.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.661+0000 7f3a96a00640 1 -- 172.21.15.135:0/1314657028 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c010040 con 0x564c8a5de590 2024-05-14T09:41:51.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.661+0000 7f3a96a00640 1 -- 172.21.15.135:0/1314657028 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f3a9c0157f0 con 0x564c8a5de590 2024-05-14T09:41:51.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.662+0000 7f3abf619740 1 -- 172.21.15.135:0/1314657028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aa4032800 con 0x564c8a5de590 2024-05-14T09:41:51.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.664+0000 7f3a96a00640 1 -- 172.21.15.135:0/1314657028 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f3a9c0159f0 con 0x564c8a5de590 2024-05-14T09:41:51.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.664+0000 7f3abf619740 10 client.4560 fetch_fsmap learned FSMap version 14 2024-05-14T09:41:51.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.664+0000 7f3abf619740 1 -- 172.21.15.135:0/1314657028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x564c8a9f2b60 con 0x564c8a5de590 2024-05-14T09:41:51.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.668+0000 7f3a96a00640 1 -- 172.21.15.135:0/1314657028 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4032800 con 0x564c8a5de590 2024-05-14T09:41:51.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.668+0000 7f3a96a00640 1 -- 172.21.15.135:0/1314657028 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f3a9c015b90 con 0x564c8a5de590 2024-05-14T09:41:51.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.668+0000 7f3abf619740 10 client.4560 fetch_fsmap finished waiting for FSMap version 14 2024-05-14T09:41:51.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.668+0000 7f3abf619740 10 client.4560 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-14T09:41:51.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.668+0000 7f3abf619740 20 client.4560 populate_metadata read hostname 'smithi135' 2024-05-14T09:41:51.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.668+0000 7f3abf619740 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.135:6838/2302038485,v1:172.21.15.135:6839/2302038485] conn(0x564c8a5bde40 0x564c8a9df410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:51.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.668+0000 7f3abf619740 4 client.4560 mds_command: new command op to 4252 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:41:51.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.668+0000 7f3abf619740 1 -- 172.21.15.135:0/1314657028 --> [v2:172.21.15.135:6838/2302038485,v1:172.21.15.135:6839/2302038485] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c8a9133a0 con 0x564c8a5bde40 2024-05-14T09:41:51.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.670+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.135:6838/2302038485,v1:172.21.15.135:6839/2302038485] conn(0x564c8a5bde40 0x564c8a9df410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:51.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.794+0000 7f3a96a00640 10 client.4560 ms_handle_connect on v2:172.21.15.135:6838/2302038485 2024-05-14T09:41:51.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:51.794+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.135:6838/2302038485,v1:172.21.15.135:6839/2302038485] conn(0x564c8a5bde40 0x564c8a9df410 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3381712220839f0 server_cookie=b8fe455116fb475c in_seq=0 out_seq=0 2024-05-14T09:41:52.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.018+0000 7f3a96a00640 1 -- 172.21.15.135:0/1314657028 <== mds.1 v2:172.21.15.135:6838/2302038485 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564c8a9133a0 con 0x564c8a5bde40 2024-05-14T09:41:52.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.018+0000 7f3a96a00640 10 client.4560 handle_command_reply: tid=0 2024-05-14T09:41:52.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.019+0000 7f3abf619740 1 client.4560 shutdown 2024-05-14T09:41:52.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.019+0000 7f3abf619740 1 -- 172.21.15.135:0/1314657028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5de590 msgr2=0x564c8a9e1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:52.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.019+0000 7f3abf619740 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5de590 0x564c8a9e1150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c005830 tx=0x7f3a9c007ea0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.019+0000 7f3abf619740 1 -- 172.21.15.135:0/1314657028 shutdown_connections 2024-05-14T09:41:52.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.020+0000 7f3abf619740 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.135:6838/2302038485,v1:172.21.15.135:6839/2302038485] conn(0x564c8a5bde40 0x564c8a9df410 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.020+0000 7f3abf619740 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5ff270 0x564c8a9e2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.020+0000 7f3abf619740 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5de590 0x564c8a9e1150 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.020+0000 7f3a96a00640 0 client.4560 ms_handle_reset on v2:172.21.15.135:6838/2302038485 2024-05-14T09:41:52.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.020+0000 7f3abf619740 1 --2- 172.21.15.135:0/1314657028 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5d63b0 0x564c8a9e54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.020+0000 7f3abf619740 1 -- 172.21.15.135:0/1314657028 >> 172.21.15.135:0/1314657028 conn(0x564c8a5f33c0 msgr2=0x564c8a99c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:52.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.020+0000 7f3abf619740 1 -- 172.21.15.135:0/1314657028 shutdown_connections 2024-05-14T09:41:52.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.020+0000 7f3abf619740 1 -- 172.21.15.135:0/1314657028 wait complete. 2024-05-14T09:41:52.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.020+0000 7f3abf619740 20 client.4560 trim_cache size 0 max 16384 2024-05-14T09:41:52.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.068+0000 7f3abf619740 1 Processor -- start 2024-05-14T09:41:52.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.069+0000 7f3abf619740 1 -- start start 2024-05-14T09:41:52.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.071+0000 7f3abf619740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 0x564c8a9dc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.071+0000 7f3abf619740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5de590 0x564c8a9ee950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.071+0000 7f3abf619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 0x564c8a9eee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.071+0000 7f3abf619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab01fea40 con 0x564c8a5ff270 2024-05-14T09:41:52.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.071+0000 7f3abf619740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab01ff080 con 0x564c8a5d63b0 2024-05-14T09:41:52.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.071+0000 7f3abf619740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x564c8a9dd430 con 0x564c8a5de590 2024-05-14T09:41:52.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.073+0000 7f3ab5c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 0x564c8a9dc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.074+0000 7f3ab5c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 0x564c8a9dc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:39024/0 (socket says 172.21.15.135:39024) 2024-05-14T09:41:52.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.074+0000 7f3ab5c00640 1 -- 172.21.15.135:0/3665097846 learned_addr learned my addr 172.21.15.135:0/3665097846 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:52.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.074+0000 7f3ab5200640 1 --2- 172.21.15.135:0/3665097846 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5de590 0x564c8a9ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.079+0000 7f3ab6600640 1 --2- 172.21.15.135:0/3665097846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 0x564c8a9eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.083+0000 7f3ab6600640 1 -- 172.21.15.135:0/3665097846 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5de590 msgr2=0x564c8a9ee950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:52.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.083+0000 7f3ab6600640 1 --2- 172.21.15.135:0/3665097846 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5de590 0x564c8a9ee950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.083+0000 7f3ab6600640 1 -- 172.21.15.135:0/3665097846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 msgr2=0x564c8a9dc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:52.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.083+0000 7f3ab6600640 1 --2- 172.21.15.135:0/3665097846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 0x564c8a9dc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.083+0000 7f3ab6600640 1 -- 172.21.15.135:0/3665097846 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c8a9a23c0 con 0x564c8a5ff270 2024-05-14T09:41:52.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.086+0000 7f3ab6600640 1 --2- 172.21.15.135:0/3665097846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 0x564c8a9eee90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8096720 tx=0x7f3aa805d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b28aacc49297921 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:52.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.092+0000 7f3aa1600640 1 -- 172.21.15.135:0/3665097846 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa807a020 con 0x564c8a5ff270 2024-05-14T09:41:52.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.092+0000 7f3aa1600640 1 -- 172.21.15.135:0/3665097846 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa8061480 con 0x564c8a5ff270 2024-05-14T09:41:52.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.092+0000 7f3aa1600640 1 -- 172.21.15.135:0/3665097846 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8068d60 con 0x564c8a5ff270 2024-05-14T09:41:52.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.093+0000 7f3abf619740 1 -- 172.21.15.135:0/3665097846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 msgr2=0x564c8a9eee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:52.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.093+0000 7f3abf619740 1 --2- 172.21.15.135:0/3665097846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 0x564c8a9eee90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8096720 tx=0x7f3aa805d470 comp rx=0 tx=0).stop 2024-05-14T09:41:52.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.093+0000 7f3abf619740 1 -- 172.21.15.135:0/3665097846 shutdown_connections 2024-05-14T09:41:52.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.093+0000 7f3abf619740 1 --2- 172.21.15.135:0/3665097846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 0x564c8a9eee90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.093+0000 7f3abf619740 1 --2- 172.21.15.135:0/3665097846 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5de590 0x564c8a9ee950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.093+0000 7f3abf619740 1 --2- 172.21.15.135:0/3665097846 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5d63b0 0x564c8a9dc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.094+0000 7f3abf619740 1 -- 172.21.15.135:0/3665097846 >> 172.21.15.135:0/3665097846 conn(0x564c8a5f33c0 msgr2=0x564c8a9e2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:52.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.094+0000 7f3abf619740 1 -- 172.21.15.135:0/3665097846 shutdown_connections 2024-05-14T09:41:52.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.094+0000 7f3abf619740 1 -- 172.21.15.135:0/3665097846 wait complete. 2024-05-14T09:41:52.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.096+0000 7f3abf619740 1 -- start start 2024-05-14T09:41:52.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.096+0000 7f3abf619740 1 Processor -- start 2024-05-14T09:41:52.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.100+0000 7f3abf619740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5d63b0 0x564c8a9e4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.100+0000 7f3abf619740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5de590 0x564c8aa62b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.100+0000 7f3abf619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 0x564c8aa06060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.100+0000 7f3abf619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564c8a9df960 con 0x564c8a5ff270 2024-05-14T09:41:52.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.100+0000 7f3abf619740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x564c8a9df290 con 0x564c8a5de590 2024-05-14T09:41:52.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.100+0000 7f3abf619740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x564c8a9f5940 con 0x564c8a5d63b0 2024-05-14T09:41:52.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.100+0000 7f3abf619740 10 client.0 _ll_register_callbacks cb 0x7f3a9c0017e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:52.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.101+0000 7f3ab6600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 0x564c8aa06060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.102+0000 7f3ab5200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5de590 0x564c8aa62b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.102+0000 7f3ab6600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 0x564c8aa06060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39324/0 (socket says 172.21.15.135:39324) 2024-05-14T09:41:52.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.102+0000 7f3ab6600640 1 -- 172.21.15.135:0/3724673448 learned_addr learned my addr 172.21.15.135:0/3724673448 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:52.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.102+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5d63b0 0x564c8a9e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.106+0000 7f3ab6600640 1 -- 172.21.15.135:0/3724673448 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5d63b0 msgr2=0x564c8a9e4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:52.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.106+0000 7f3ab6600640 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5d63b0 0x564c8a9e4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.106+0000 7f3ab6600640 1 -- 172.21.15.135:0/3724673448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5de590 msgr2=0x564c8aa62b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:52.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.106+0000 7f3ab6600640 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5de590 0x564c8aa62b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.106+0000 7f3ab6600640 1 -- 172.21.15.135:0/3724673448 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c8a9dae70 con 0x564c8a5ff270 2024-05-14T09:41:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.111+0000 7f3ab6600640 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 0x564c8aa06060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3aa805d500 tx=0x7f3aa8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786ecc1b827bdce server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.111+0000 7f3a96a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-14T09:41:52.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.117+0000 7f3a96a00640 1 -- 172.21.15.135:0/3724673448 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa807e070 con 0x564c8a5ff270 2024-05-14T09:41:52.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.117+0000 7f3a96a00640 1 -- 172.21.15.135:0/3724673448 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f3aa807ade0 con 0x564c8a5ff270 2024-05-14T09:41:52.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.117+0000 7f3abf619740 1 -- 172.21.15.135:0/3724673448 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aa8061480 con 0x564c8a5ff270 2024-05-14T09:41:52.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.121+0000 7f3a96a00640 1 -- 172.21.15.135:0/3724673448 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f3aa8065830 con 0x564c8a5ff270 2024-05-14T09:41:52.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.121+0000 7f3abf619740 10 client.4566 fetch_fsmap learned FSMap version 14 2024-05-14T09:41:52.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.121+0000 7f3abf619740 1 -- 172.21.15.135:0/3724673448 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x564c8a9dc830 con 0x564c8a5ff270 2024-05-14T09:41:52.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.128+0000 7f3a96a00640 1 -- 172.21.15.135:0/3724673448 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa8061480 con 0x564c8a5ff270 2024-05-14T09:41:52.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.128+0000 7f3a96a00640 1 -- 172.21.15.135:0/3724673448 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f3aa805cdf0 con 0x564c8a5ff270 2024-05-14T09:41:52.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.128+0000 7f3abf619740 10 client.4566 fetch_fsmap finished waiting for FSMap version 14 2024-05-14T09:41:52.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.128+0000 7f3abf619740 10 client.4566 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-14T09:41:52.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.128+0000 7f3abf619740 20 client.4566 populate_metadata read hostname 'smithi135' 2024-05-14T09:41:52.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.128+0000 7f3abf619740 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.135:6838/2302038485,v1:172.21.15.135:6839/2302038485] conn(0x564c8a99b340 0x564c8aa51a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.128+0000 7f3abf619740 4 client.4566 mds_command: new command op to 4252 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:41:52.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.128+0000 7f3abf619740 1 -- 172.21.15.135:0/3724673448 --> [v2:172.21.15.135:6838/2302038485,v1:172.21.15.135:6839/2302038485] -- command(tid 0: {"prefix": "status"}) -- 0x564c8a90d210 con 0x564c8a99b340 2024-05-14T09:41:52.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.129+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.135:6838/2302038485,v1:172.21.15.135:6839/2302038485] conn(0x564c8a99b340 0x564c8aa51a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.135+0000 7f3ab5c00640 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.135:6838/2302038485,v1:172.21.15.135:6839/2302038485] conn(0x564c8a99b340 0x564c8aa51a20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4d5cd8175f6bd33f server_cookie=a1a90a5f3b2e4f79 in_seq=0 out_seq=0 2024-05-14T09:41:52.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.135+0000 7f3a96a00640 10 client.4566 ms_handle_connect on v2:172.21.15.135:6838/2302038485 2024-05-14T09:41:52.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.166+0000 7f3a96a00640 1 -- 172.21.15.135:0/3724673448 <== mds.1 v2:172.21.15.135:6838/2302038485 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564c8a90d210 con 0x564c8a99b340 2024-05-14T09:41:52.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.166+0000 7f3a96a00640 10 client.4566 handle_command_reply: tid=0 2024-05-14T09:41:52.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.166+0000 7f3abf619740 1 client.4566 shutdown 2024-05-14T09:41:52.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.167+0000 7f3abf619740 1 -- 172.21.15.135:0/3724673448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 msgr2=0x564c8aa06060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:52.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.167+0000 7f3abf619740 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 0x564c8aa06060 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3aa805d500 tx=0x7f3aa8004ab0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.167+0000 7f3abf619740 1 -- 172.21.15.135:0/3724673448 shutdown_connections 2024-05-14T09:41:52.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.167+0000 7f3abf619740 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.135:6838/2302038485,v1:172.21.15.135:6839/2302038485] conn(0x564c8a99b340 0x564c8aa51a20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.167+0000 7f3abf619740 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564c8a5de590 0x564c8aa62b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.167+0000 7f3abf619740 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c8a5ff270 0x564c8aa06060 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.167+0000 7f3abf619740 1 --2- 172.21.15.135:0/3724673448 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x564c8a5d63b0 0x564c8a9e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.167+0000 7f3abf619740 1 -- 172.21.15.135:0/3724673448 >> 172.21.15.135:0/3724673448 conn(0x564c8a5f33c0 msgr2=0x564c8a9e0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:52.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.167+0000 7f3a96a00640 0 client.4566 ms_handle_reset on v2:172.21.15.135:6838/2302038485 2024-05-14T09:41:52.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.167+0000 7f3abf619740 1 -- 172.21.15.135:0/3724673448 shutdown_connections 2024-05-14T09:41:52.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.167+0000 7f3abf619740 1 -- 172.21.15.135:0/3724673448 wait complete. 2024-05-14T09:41:52.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.168+0000 7f3abf619740 20 client.4566 trim_cache size 0 max 16384 2024-05-14T09:41:52.169 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T09:41:52.169 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "3d7e4a56-2293-41af-9139-c92eede1b811", 2024-05-14T09:41:52.169 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 1, 2024-05-14T09:41:52.169 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4252, 2024-05-14T09:41:52.169 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-14T09:41:52.169 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-14T09:41:52.169 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-14T09:41:52.169 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 26.122641698999999, 2024-05-14T09:41:52.170 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 14, 2024-05-14T09:41:52.170 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 33, 2024-05-14T09:41:52.170 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 33, 2024-05-14T09:41:52.170 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 76.019826292000005 2024-05-14T09:41:52.170 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T09:41:52.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 -- 172.21.15.135:0/4088180376 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3a90076350 msgr2=0x7f3a90078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:52.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3a90076350 0x7f3a90078860 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ab015e680 tx=0x7f3a9c009040 comp rx=0 tx=0).stop 2024-05-14T09:41:52.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 -- 172.21.15.135:0/4088180376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ab015ab20 msgr2=0x7f3ab015a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:52.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ab015ab20 0x7f3ab015a020 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009cb0 tx=0x7f3aa800c490 comp rx=0 tx=0).stop 2024-05-14T09:41:52.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 -- 172.21.15.135:0/4088180376 shutdown_connections 2024-05-14T09:41:52.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3a90076350 0x7f3a90078860 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3ab01544b0 0x7f3ab015b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ab015ab20 0x7f3ab015a020 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 --2- 172.21.15.135:0/4088180376 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3ab0071f70 0x7f3ab01584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 -- 172.21.15.135:0/4088180376 >> 172.21.15.135:0/4088180376 conn(0x7f3ab0073d40 msgr2=0x7f3ab00cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:52.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 -- 172.21.15.135:0/4088180376 shutdown_connections 2024-05-14T09:41:52.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.169+0000 7f3ab8600640 1 -- 172.21.15.135:0/4088180376 wait complete. 2024-05-14T09:41:52.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-14T09:41:52.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.497+0000 7f669d400640 1 Processor -- start 2024-05-14T09:41:52.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.497+0000 7f669d400640 1 -- start start 2024-05-14T09:41:52.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.499+0000 7f669d400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6698152ed0 0x7f66981532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.499+0000 7f669d400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f669815cd20 0x7f66980c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.499+0000 7f669d400640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66980c5900 con 0x7f66980c60a0 2024-05-14T09:41:52.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.499+0000 7f669d400640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f669815a510 con 0x7f669815cd20 2024-05-14T09:41:52.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.499+0000 7f669d400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f669806c6f0 con 0x7f6698152ed0 2024-05-14T09:41:52.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.500+0000 7f6697200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f669815cd20 0x7f66980c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.500+0000 7f668fe00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f66980c60a0 0x7f669815c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:38316/0 (socket says 172.21.15.135:38316) 2024-05-14T09:41:52.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.500+0000 7f668fe00640 1 -- 172.21.15.135:0/3378864518 learned_addr learned my addr 172.21.15.135:0/3378864518 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T09:41:52.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.501+0000 7f6696800640 1 --2- 172.21.15.135:0/3378864518 >> v2:172.21.15.196:3300/0 conn(0x7f6698152ed0 0x7f66981532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.505+0000 7f6697200640 1 -- 172.21.15.135:0/3378864518 >> v2:172.21.15.196:3300/0 conn(0x7f6698152ed0 msgr2=0x7f66981532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:52.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.505+0000 7f6697200640 1 --2- 172.21.15.135:0/3378864518 >> v2:172.21.15.196:3300/0 conn(0x7f6698152ed0 0x7f66981532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.505+0000 7f6697200640 1 -- 172.21.15.135:0/3378864518 >> v1:172.21.15.135:6789/0 conn(0x7f66980c60a0 legacy=0x7f669815c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:52.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.505+0000 7f6697200640 1 -- 172.21.15.135:0/3378864518 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669815d290 con 0x7f669815cd20 2024-05-14T09:41:52.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.510+0000 7f6697200640 1 --2- 172.21.15.135:0/3378864518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f669815cd20 0x7f66980c64b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6690009d90 tx=0x7f669002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21a0cf9f02ec435 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:52.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.517+0000 7f6695e00640 1 -- 172.21.15.135:0/3378864518 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690007740 con 0x7f669815cd20 2024-05-14T09:41:52.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.517+0000 7f6695e00640 1 -- 172.21.15.135:0/3378864518 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66900078e0 con 0x7f669815cd20 2024-05-14T09:41:52.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.517+0000 7f6695e00640 1 -- 172.21.15.135:0/3378864518 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690007cb0 con 0x7f669815cd20 2024-05-14T09:41:52.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.518+0000 7f669d400640 1 -- 172.21.15.135:0/3378864518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f669815cd20 msgr2=0x7f66980c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:52.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.518+0000 7f669d400640 1 --2- 172.21.15.135:0/3378864518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f669815cd20 0x7f66980c64b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6690009d90 tx=0x7f669002a730 comp rx=0 tx=0).stop 2024-05-14T09:41:52.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.518+0000 7f669d400640 1 -- 172.21.15.135:0/3378864518 shutdown_connections 2024-05-14T09:41:52.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.518+0000 7f669d400640 1 --2- 172.21.15.135:0/3378864518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f669815cd20 0x7f66980c64b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.518+0000 7f669d400640 1 --2- 172.21.15.135:0/3378864518 >> v2:172.21.15.196:3300/0 conn(0x7f6698152ed0 0x7f66981532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.518+0000 7f669d400640 1 -- 172.21.15.135:0/3378864518 >> 172.21.15.135:0/3378864518 conn(0x7f6698073d40 msgr2=0x7f6698074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:52.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.518+0000 7f669d400640 1 -- 172.21.15.135:0/3378864518 shutdown_connections 2024-05-14T09:41:52.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.519+0000 7f669d400640 1 -- 172.21.15.135:0/3378864518 wait complete. 2024-05-14T09:41:52.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.522+0000 7f669d400640 1 Processor -- start 2024-05-14T09:41:52.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.523+0000 7f669d400640 1 -- start start 2024-05-14T09:41:52.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.525+0000 7f669d400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66980c60a0 0x7f66981f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.525+0000 7f669d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698152ed0 0x7f66980c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.525+0000 7f669d400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f669815cd20 0x7f669814de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.525+0000 7f669d400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f66980c69f0 con 0x7f6698152ed0 2024-05-14T09:41:52.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.525+0000 7f669d400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f66980c5c10 con 0x7f66980c60a0 2024-05-14T09:41:52.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.525+0000 7f669d400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f669806cc20 con 0x7f669815cd20 2024-05-14T09:41:52.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.526+0000 7f668fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698152ed0 0x7f66980c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.526+0000 7f668fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698152ed0 0x7f66980c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39344/0 (socket says 172.21.15.135:39344) 2024-05-14T09:41:52.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.526+0000 7f668fe00640 1 -- 172.21.15.135:0/3146272081 learned_addr learned my addr 172.21.15.135:0/3146272081 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:52.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.526+0000 7f6696800640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66980c60a0 0x7f66981f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.527+0000 7f6697200640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f669815cd20 0x7f669814de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.531+0000 7f668fe00640 1 -- 172.21.15.135:0/3146272081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f669815cd20 msgr2=0x7f669814de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:52.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.531+0000 7f668fe00640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f669815cd20 0x7f669814de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.531+0000 7f668fe00640 1 -- 172.21.15.135:0/3146272081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66980c60a0 msgr2=0x7f66981f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:52.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.531+0000 7f668fe00640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66980c60a0 0x7f66981f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.531+0000 7f668fe00640 1 -- 172.21.15.135:0/3146272081 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66981f4480 con 0x7f6698152ed0 2024-05-14T09:41:52.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.536+0000 7f668fe00640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698152ed0 0x7f66980c8710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f668000c3d0 tx=0x7f668000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:52.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.542+0000 7f668ea00640 1 -- 172.21.15.135:0/3146272081 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680017070 con 0x7f6698152ed0 2024-05-14T09:41:52.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.542+0000 7f668ea00640 1 -- 172.21.15.135:0/3146272081 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6680005ce0 con 0x7f6698152ed0 2024-05-14T09:41:52.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.542+0000 7f668ea00640 1 -- 172.21.15.135:0/3146272081 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680007310 con 0x7f6698152ed0 2024-05-14T09:41:52.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.542+0000 7f669d400640 1 -- 172.21.15.135:0/3146272081 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66980c82c0 con 0x7f6698152ed0 2024-05-14T09:41:52.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.543+0000 7f669d400640 1 -- 172.21.15.135:0/3146272081 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6698154680 con 0x7f6698152ed0 2024-05-14T09:41:52.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.549+0000 7f66a4582740 1 Processor -- start 2024-05-14T09:41:52.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.549+0000 7f66a4582740 1 -- start start 2024-05-14T09:41:52.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.551+0000 7f66a4582740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c042270 0x56300c3e4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.551+0000 7f66a4582740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c3e2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.551+0000 7f66a4582740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c40d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.551+0000 7f66a4582740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56300c348790 con 0x56300c042270 2024-05-14T09:41:52.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.551+0000 7f66a4582740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56300c2edf20 con 0x56300c021590 2024-05-14T09:41:52.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.551+0000 7f66a4582740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x56300c344750 con 0x56300c0193b0 2024-05-14T09:41:52.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.558+0000 7f668fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c40d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.559+0000 7f668fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c40d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:39066/0 (socket says 172.21.15.135:39066) 2024-05-14T09:41:52.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.559+0000 7f668fe00640 1 -- 172.21.15.135:0/319984819 learned_addr learned my addr 172.21.15.135:0/319984819 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:52.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.559+0000 7f6696800640 1 --2- 172.21.15.135:0/319984819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c3e2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.569+0000 7f668fe00640 1 -- 172.21.15.135:0/319984819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 msgr2=0x56300c3e2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:52.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.569+0000 7f668fe00640 1 --2- 172.21.15.135:0/319984819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c3e2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.569+0000 7f668fe00640 1 -- 172.21.15.135:0/319984819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c042270 msgr2=0x56300c3e4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:52.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.569+0000 7f668fe00640 1 --2- 172.21.15.135:0/319984819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c042270 0x56300c3e4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.569+0000 7f668fe00640 1 -- 172.21.15.135:0/319984819 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56300c05a2d0 con 0x56300c021590 2024-05-14T09:41:52.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.575+0000 7f668ea00640 1 -- 172.21.15.135:0/3146272081 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f668001a070 con 0x7f6698152ed0 2024-05-14T09:41:52.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.576+0000 7f668ea00640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6674076350 0x7f6674078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.576+0000 7f6697200640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6674076350 0x7f6674078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.577+0000 7f668fe00640 1 --2- 172.21.15.135:0/319984819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c40d950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6680011000 tx=0x7f668000f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7de64947bc12d033 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:52.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.577+0000 7f6697200640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6674076350 0x7f6674078860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6690034000 tx=0x7f669002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:52.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.580+0000 7f668ea00640 1 -- 172.21.15.135:0/3146272081 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f66800076c0 con 0x7f6698152ed0 2024-05-14T09:41:52.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.588+0000 7f6687000640 1 -- 172.21.15.135:0/319984819 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668005df80 con 0x56300c021590 2024-05-14T09:41:52.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.588+0000 7f6687000640 1 -- 172.21.15.135:0/319984819 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6680061440 con 0x56300c021590 2024-05-14T09:41:52.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.588+0000 7f6687000640 1 -- 172.21.15.135:0/319984819 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66800610a0 con 0x56300c021590 2024-05-14T09:41:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.589+0000 7f66a4582740 1 -- 172.21.15.135:0/319984819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 msgr2=0x56300c40d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.589+0000 7f66a4582740 1 --2- 172.21.15.135:0/319984819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c40d950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6680011000 tx=0x7f668000f000 comp rx=0 tx=0).stop 2024-05-14T09:41:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.590+0000 7f66a4582740 1 -- 172.21.15.135:0/319984819 shutdown_connections 2024-05-14T09:41:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.590+0000 7f66a4582740 1 --2- 172.21.15.135:0/319984819 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c40d950 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.590+0000 7f66a4582740 1 --2- 172.21.15.135:0/319984819 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c3e2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.590+0000 7f66a4582740 1 --2- 172.21.15.135:0/319984819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c042270 0x56300c3e4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.590+0000 7f66a4582740 1 -- 172.21.15.135:0/319984819 >> 172.21.15.135:0/319984819 conn(0x56300c0363c0 msgr2=0x56300c3e3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.590+0000 7f66a4582740 1 -- 172.21.15.135:0/319984819 shutdown_connections 2024-05-14T09:41:52.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.590+0000 7f66a4582740 1 -- 172.21.15.135:0/319984819 wait complete. 2024-05-14T09:41:52.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.591+0000 7f66a4582740 1 -- start start 2024-05-14T09:41:52.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.592+0000 7f66a4582740 1 Processor -- start 2024-05-14T09:41:52.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.594+0000 7f66a4582740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c0193b0 0x56300c408ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.594+0000 7f66a4582740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c40b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.594+0000 7f66a4582740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c042270 0x56300c43c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.594+0000 7f66a4582740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56300c2edf20 con 0x56300c0193b0 2024-05-14T09:41:52.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.594+0000 7f66a4582740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56300c3019c0 con 0x56300c021590 2024-05-14T09:41:52.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.594+0000 7f66a4582740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x56300c421f00 con 0x56300c042270 2024-05-14T09:41:52.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.594+0000 7f66a4582740 10 client.0 _ll_register_callbacks cb 0x56300c2ce120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:52.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.595+0000 7f6696800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c0193b0 0x56300c408ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.595+0000 7f6696800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c0193b0 0x56300c408ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39374/0 (socket says 172.21.15.135:39374) 2024-05-14T09:41:52.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.595+0000 7f6696800640 1 -- 172.21.15.135:0/3751232493 learned_addr learned my addr 172.21.15.135:0/3751232493 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:52.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.596+0000 7f668fe00640 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c40b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.596+0000 7f6697200640 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c042270 0x56300c43c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.600+0000 7f6696800640 1 -- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c042270 msgr2=0x56300c43c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.600+0000 7f6696800640 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c042270 0x56300c43c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.600+0000 7f6696800640 1 -- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 msgr2=0x56300c40b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.600+0000 7f6696800640 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c40b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:52.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.600+0000 7f6696800640 1 -- 172.21.15.135:0/3751232493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56300c1246b0 con 0x56300c0193b0 2024-05-14T09:41:52.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.603+0000 7f6696800640 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c0193b0 0x56300c408ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6688014750 tx=0x7f6688014c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaec2c0042cd81c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:52.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.603+0000 7f667b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-14T09:41:52.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.607+0000 7f667b400640 1 -- 172.21.15.135:0/3751232493 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688022060 con 0x56300c0193b0 2024-05-14T09:41:52.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.607+0000 7f66a4582740 1 -- 172.21.15.135:0/3751232493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6680061440 con 0x56300c0193b0 2024-05-14T09:41:52.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.610+0000 7f667b400640 1 -- 172.21.15.135:0/3751232493 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f6688012b20 con 0x56300c0193b0 2024-05-14T09:41:52.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.612+0000 7f667b400640 1 -- 172.21.15.135:0/3751232493 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f6688012d40 con 0x56300c0193b0 2024-05-14T09:41:52.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.613+0000 7f66a4582740 10 client.4578 fetch_fsmap learned FSMap version 14 2024-05-14T09:41:52.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.613+0000 7f66a4582740 1 -- 172.21.15.135:0/3751232493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56300c409770 con 0x56300c0193b0 2024-05-14T09:41:52.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.620+0000 7f667b400640 1 -- 172.21.15.135:0/3751232493 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6680061440 con 0x56300c0193b0 2024-05-14T09:41:52.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.620+0000 7f667b400640 1 -- 172.21.15.135:0/3751232493 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f668801d440 con 0x56300c0193b0 2024-05-14T09:41:52.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.620+0000 7f66a4582740 10 client.4578 fetch_fsmap finished waiting for FSMap version 14 2024-05-14T09:41:52.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.621+0000 7f66a4582740 10 client.4578 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-14T09:41:52.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.621+0000 7f66a4582740 20 client.4578 populate_metadata read hostname 'smithi135' 2024-05-14T09:41:52.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.621+0000 7f66a4582740 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x56300c000e40 0x56300c447cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:52.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.621+0000 7f66a4582740 4 client.4578 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T09:41:52.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.621+0000 7f66a4582740 1 -- 172.21.15.135:0/3751232493 --> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56300c3563a0 con 0x56300c000e40 2024-05-14T09:41:52.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.675+0000 7f668fe00640 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x56300c000e40 0x56300c447cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:52.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.691+0000 7f668fe00640 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x56300c000e40 0x56300c447cd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa2d133962094bc server_cookie=edd6c14824ff7ce9 in_seq=0 out_seq=0 2024-05-14T09:41:52.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:52.691+0000 7f667b400640 10 client.4578 ms_handle_connect on v2:172.21.15.196:6836/3644723215 2024-05-14T09:41:53.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:41:53.295 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:41:56.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.826+0000 7f667b400640 1 -- 172.21.15.135:0/3751232493 <== mds.0 v2:172.21.15.196:6836/3644723215 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56300c3563a0 con 0x56300c000e40 2024-05-14T09:41:56.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.826+0000 7f667b400640 10 client.4578 handle_command_reply: tid=0 2024-05-14T09:41:56.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.826+0000 7f66a4582740 1 client.4578 shutdown 2024-05-14T09:41:56.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.827+0000 7f66a4582740 1 -- 172.21.15.135:0/3751232493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c0193b0 msgr2=0x56300c408ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:56.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.827+0000 7f66a4582740 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c0193b0 0x56300c408ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6688014750 tx=0x7f6688014c10 comp rx=0 tx=0).stop 2024-05-14T09:41:56.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.827+0000 7f66a4582740 1 -- 172.21.15.135:0/3751232493 shutdown_connections 2024-05-14T09:41:56.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.827+0000 7f66a4582740 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x56300c000e40 0x56300c447cd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:56.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.827+0000 7f66a4582740 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c40b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:56.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.827+0000 7f66a4582740 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c042270 0x56300c43c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:56.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.827+0000 7f66a4582740 1 --2- 172.21.15.135:0/3751232493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c0193b0 0x56300c408ab0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:56.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.827+0000 7f667b400640 0 client.4578 ms_handle_reset on v2:172.21.15.196:6836/3644723215 2024-05-14T09:41:56.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.827+0000 7f66a4582740 1 -- 172.21.15.135:0/3751232493 >> 172.21.15.135:0/3751232493 conn(0x56300c0363c0 msgr2=0x56300c3e40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:56.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.828+0000 7f66a4582740 1 -- 172.21.15.135:0/3751232493 shutdown_connections 2024-05-14T09:41:56.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.828+0000 7f66a4582740 1 -- 172.21.15.135:0/3751232493 wait complete. 2024-05-14T09:41:56.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.828+0000 7f66a4582740 20 client.4578 trim_cache size 0 max 16384 2024-05-14T09:41:56.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.879+0000 7f66a4582740 1 Processor -- start 2024-05-14T09:41:56.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.879+0000 7f66a4582740 1 -- start start 2024-05-14T09:41:56.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.882+0000 7f66a4582740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c40d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:56.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.882+0000 7f66a4582740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c021590 0x56300c40db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:56.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.882+0000 7f66a4582740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c042270 0x56300c4281f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:56.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.882+0000 7f66a4582740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f66981f14a0 con 0x56300c021590 2024-05-14T09:41:56.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.882+0000 7f66a4582740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56300c40be20 con 0x56300c042270 2024-05-14T09:41:56.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.882+0000 7f66a4582740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x56300c424050 con 0x56300c0193b0 2024-05-14T09:41:56.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.883+0000 7f668fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c021590 0x56300c40db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:56.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.884+0000 7f6697200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c042270 0x56300c4281f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:56.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.884+0000 7f668fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c021590 0x56300c40db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45276/0 (socket says 172.21.15.135:45276) 2024-05-14T09:41:56.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.884+0000 7f668fe00640 1 -- 172.21.15.135:0/2507536973 learned_addr learned my addr 172.21.15.135:0/2507536973 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:56.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.884+0000 7f6696800640 1 --2- 172.21.15.135:0/2507536973 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c40d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.888+0000 7f668fe00640 1 -- 172.21.15.135:0/2507536973 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 msgr2=0x56300c40d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.888+0000 7f668fe00640 1 --2- 172.21.15.135:0/2507536973 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c40d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.888+0000 7f668fe00640 1 -- 172.21.15.135:0/2507536973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c042270 msgr2=0x56300c4281f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.888+0000 7f668fe00640 1 --2- 172.21.15.135:0/2507536973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c042270 0x56300c4281f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.888+0000 7f668fe00640 1 -- 172.21.15.135:0/2507536973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56300c3db0e0 con 0x56300c021590 2024-05-14T09:41:56.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.891+0000 7f668fe00640 1 --2- 172.21.15.135:0/2507536973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c021590 0x56300c40db20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f668005eba0 tx=0x7f6680082040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc7b41ba0e83c99 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.897+0000 7f6686600640 1 -- 172.21.15.135:0/2507536973 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680061280 con 0x56300c021590 2024-05-14T09:41:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.897+0000 7f6686600640 1 -- 172.21.15.135:0/2507536973 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6680065c30 con 0x56300c021590 2024-05-14T09:41:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.897+0000 7f6686600640 1 -- 172.21.15.135:0/2507536973 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680061700 con 0x56300c021590 2024-05-14T09:41:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.899+0000 7f66a4582740 1 -- 172.21.15.135:0/2507536973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c021590 msgr2=0x56300c40db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.899+0000 7f66a4582740 1 --2- 172.21.15.135:0/2507536973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c021590 0x56300c40db20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f668005eba0 tx=0x7f6680082040 comp rx=0 tx=0).stop 2024-05-14T09:41:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.899+0000 7f66a4582740 1 -- 172.21.15.135:0/2507536973 shutdown_connections 2024-05-14T09:41:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.899+0000 7f66a4582740 1 --2- 172.21.15.135:0/2507536973 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c042270 0x56300c4281f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.899+0000 7f66a4582740 1 --2- 172.21.15.135:0/2507536973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c021590 0x56300c40db20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.899+0000 7f66a4582740 1 --2- 172.21.15.135:0/2507536973 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c40d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.899+0000 7f66a4582740 1 -- 172.21.15.135:0/2507536973 >> 172.21.15.135:0/2507536973 conn(0x56300c0363c0 msgr2=0x56300c3da950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.900+0000 7f66a4582740 1 -- 172.21.15.135:0/2507536973 shutdown_connections 2024-05-14T09:41:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.900+0000 7f66a4582740 1 -- 172.21.15.135:0/2507536973 wait complete. 2024-05-14T09:41:56.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.903+0000 7f66a4582740 1 -- start start 2024-05-14T09:41:56.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.904+0000 7f66a4582740 1 Processor -- start 2024-05-14T09:41:56.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.908+0000 7f66a4582740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c4285f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:56.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.908+0000 7f66a4582740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c3ffba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:56.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.909+0000 7f66a4582740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c042270 0x56300c4000e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:56.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.909+0000 7f66a4582740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56300c43cfa0 con 0x56300c042270 2024-05-14T09:41:56.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.909+0000 7f66a4582740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56300c43c950 con 0x56300c021590 2024-05-14T09:41:56.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.909+0000 7f66a4582740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x56300c4033c0 con 0x56300c0193b0 2024-05-14T09:41:56.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.909+0000 7f66a4582740 10 client.0 _ll_register_callbacks cb 0x7f6688009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T09:41:56.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.910+0000 7f6697200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c042270 0x56300c4000e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:56.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.910+0000 7f668fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c3ffba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:56.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.911+0000 7f6696800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c4285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:56.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.911+0000 7f6697200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c042270 0x56300c4000e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45288/0 (socket says 172.21.15.135:45288) 2024-05-14T09:41:56.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.911+0000 7f6697200640 1 -- 172.21.15.135:0/2384535961 learned_addr learned my addr 172.21.15.135:0/2384535961 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:56.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.921+0000 7f6697200640 1 -- 172.21.15.135:0/2384535961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 msgr2=0x56300c4285f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:56.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.921+0000 7f6697200640 1 --2- 172.21.15.135:0/2384535961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c4285f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:56.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.921+0000 7f6697200640 1 -- 172.21.15.135:0/2384535961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 msgr2=0x56300c3ffba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:56.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.921+0000 7f6697200640 1 --2- 172.21.15.135:0/2384535961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c3ffba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:56.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.921+0000 7f6697200640 1 -- 172.21.15.135:0/2384535961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56300c42f4c0 con 0x56300c042270 2024-05-14T09:41:56.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.926+0000 7f6697200640 1 --2- 172.21.15.135:0/2384535961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c042270 0x56300c4000e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6690009e80 tx=0x7f6690004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ff03ed12bab3cd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:56.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.926+0000 7f667b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-14T09:41:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.932+0000 7f667b400640 1 -- 172.21.15.135:0/2384535961 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690046bd0 con 0x56300c042270 2024-05-14T09:41:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.932+0000 7f667b400640 1 -- 172.21.15.135:0/2384535961 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f6690046d70 con 0x56300c042270 2024-05-14T09:41:56.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.932+0000 7f66a4582740 1 -- 172.21.15.135:0/2384535961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6680065c30 con 0x56300c042270 2024-05-14T09:41:56.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.935+0000 7f667b400640 1 -- 172.21.15.135:0/2384535961 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f669003c420 con 0x56300c042270 2024-05-14T09:41:56.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.935+0000 7f66a4582740 10 client.4584 fetch_fsmap learned FSMap version 14 2024-05-14T09:41:56.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.935+0000 7f66a4582740 1 -- 172.21.15.135:0/2384535961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56300c443600 con 0x56300c042270 2024-05-14T09:41:56.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.941+0000 7f667b400640 1 -- 172.21.15.135:0/2384535961 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6680065c30 con 0x56300c042270 2024-05-14T09:41:56.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.941+0000 7f667b400640 1 -- 172.21.15.135:0/2384535961 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f669005d080 con 0x56300c042270 2024-05-14T09:41:56.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.941+0000 7f66a4582740 10 client.4584 fetch_fsmap finished waiting for FSMap version 14 2024-05-14T09:41:56.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.941+0000 7f66a4582740 10 client.4584 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-14T09:41:56.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.941+0000 7f66a4582740 20 client.4584 populate_metadata read hostname 'smithi135' 2024-05-14T09:41:56.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.941+0000 7f66a4582740 1 --2- 172.21.15.135:0/2384535961 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x56300c3df780 0x56300c4a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:56.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.941+0000 7f66a4582740 4 client.4584 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T09:41:56.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:56.941+0000 7f66a4582740 1 -- 172.21.15.135:0/2384535961 --> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] -- command(tid 0: {"prefix": "status"}) -- 0x56300c350210 con 0x56300c3df780 2024-05-14T09:41:57.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.840+0000 7f6696800640 1 --2- 172.21.15.135:0/2384535961 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x56300c3df780 0x56300c4a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:57.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.862+0000 7f6696800640 1 --2- 172.21.15.135:0/2384535961 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x56300c3df780 0x56300c4a45f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84b74b01a85fc69c server_cookie=9706c7dca03e01b2 in_seq=0 out_seq=0 2024-05-14T09:41:57.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.862+0000 7f667b400640 10 client.4584 ms_handle_connect on v2:172.21.15.196:6836/3644723215 2024-05-14T09:41:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f667b400640 1 -- 172.21.15.135:0/2384535961 <== mds.0 v2:172.21.15.196:6836/3644723215 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x56300c350210 con 0x56300c3df780 2024-05-14T09:41:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f667b400640 10 client.4584 handle_command_reply: tid=0 2024-05-14T09:41:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f66a4582740 1 client.4584 shutdown 2024-05-14T09:41:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f66a4582740 1 -- 172.21.15.135:0/2384535961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c042270 msgr2=0x56300c4000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f66a4582740 1 --2- 172.21.15.135:0/2384535961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c042270 0x56300c4000e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6690009e80 tx=0x7f6690004ab0 comp rx=0 tx=0).stop 2024-05-14T09:41:57.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f66a4582740 1 -- 172.21.15.135:0/2384535961 shutdown_connections 2024-05-14T09:41:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f66a4582740 1 --2- 172.21.15.135:0/2384535961 >> [v2:172.21.15.196:6836/3644723215,v1:172.21.15.196:6837/3644723215] conn(0x56300c3df780 0x56300c4a45f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f66a4582740 1 --2- 172.21.15.135:0/2384535961 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56300c021590 0x56300c3ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f66a4582740 1 --2- 172.21.15.135:0/2384535961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56300c042270 0x56300c4000e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f66a4582740 1 --2- 172.21.15.135:0/2384535961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56300c0193b0 0x56300c4285f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f66a4582740 1 -- 172.21.15.135:0/2384535961 >> 172.21.15.135:0/2384535961 conn(0x56300c0363c0 msgr2=0x56300c3e4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:57.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.891+0000 7f667b400640 0 client.4584 ms_handle_reset on v2:172.21.15.196:6836/3644723215 2024-05-14T09:41:57.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.892+0000 7f66a4582740 1 -- 172.21.15.135:0/2384535961 shutdown_connections 2024-05-14T09:41:57.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.892+0000 7f66a4582740 1 -- 172.21.15.135:0/2384535961 wait complete. 2024-05-14T09:41:57.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.892+0000 7f66a4582740 20 client.4584 trim_cache size 0 max 16384 2024-05-14T09:41:57.893 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T09:41:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "3d7e4a56-2293-41af-9139-c92eede1b811", 2024-05-14T09:41:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-05-14T09:41:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4255, 2024-05-14T09:41:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-14T09:41:57.893 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-14T09:41:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-14T09:41:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 70.43088994, 2024-05-14T09:41:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 14, 2024-05-14T09:41:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 33, 2024-05-14T09:41:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 33, 2024-05-14T09:41:57.894 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 81.431735321999994 2024-05-14T09:41:57.894 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T09:41:57.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.893+0000 7f669d400640 1 -- 172.21.15.135:0/3146272081 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6674076350 msgr2=0x7f6674078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:57.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.893+0000 7f669d400640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6674076350 0x7f6674078860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6690034000 tx=0x7f669002e000 comp rx=0 tx=0).stop 2024-05-14T09:41:57.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.893+0000 7f669d400640 1 -- 172.21.15.135:0/3146272081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698152ed0 msgr2=0x7f66980c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:57.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.893+0000 7f669d400640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698152ed0 0x7f66980c8710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f668000c3d0 tx=0x7f668000c890 comp rx=0 tx=0).stop 2024-05-14T09:41:57.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.894+0000 7f669d400640 1 -- 172.21.15.135:0/3146272081 shutdown_connections 2024-05-14T09:41:57.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.894+0000 7f669d400640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6674076350 0x7f6674078860 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:57.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.894+0000 7f669d400640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f669815cd20 0x7f669814de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:57.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.894+0000 7f669d400640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698152ed0 0x7f66980c8710 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:57.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.894+0000 7f669d400640 1 --2- 172.21.15.135:0/3146272081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66980c60a0 0x7f66981f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:57.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.894+0000 7f669d400640 1 -- 172.21.15.135:0/3146272081 >> 172.21.15.135:0/3146272081 conn(0x7f6698073d40 msgr2=0x7f6698074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:57.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.894+0000 7f669d400640 1 -- 172.21.15.135:0/3146272081 shutdown_connections 2024-05-14T09:41:57.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:57.894+0000 7f669d400640 1 -- 172.21.15.135:0/3146272081 wait complete. 2024-05-14T09:41:57.933 INFO:teuthology.run_tasks:Running task sequential... 2024-05-14T09:41:57.943 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-14T09:41:57.943 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-14T09:41:57.943 INFO:teuthology.task.print:Enabling mgr modules 2024-05-14T09:41:57.943 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-14T09:41:57.956 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-14T09:41:57.956 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-14T09:41:57.956 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-05-14T09:41:57.957 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T09:41:57.957 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T09:41:57.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:57.957 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-14T09:41:58.011 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-14T09:41:58.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:58.011 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T09:41:58.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:58.092 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-05-14T09:41:58.205 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-14T09:41:58.205 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T09:41:58.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.454+0000 7f07cea00640 1 Processor -- start 2024-05-14T09:41:58.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.455+0000 7f07cea00640 1 -- start start 2024-05-14T09:41:58.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.457+0000 7f07cea00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f07c80c7d80 0x7f07c81526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:58.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.457+0000 7f07cea00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07c8158c20 0x7f07c8159030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:58.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.457+0000 7f07cea00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07c80c7500 con 0x7f07c80c99f0 2024-05-14T09:41:58.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.457+0000 7f07cea00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f07c80c86f0 con 0x7f07c8158c20 2024-05-14T09:41:58.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.457+0000 7f07cea00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f07c8158790 con 0x7f07c80c7d80 2024-05-14T09:41:58.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.458+0000 7f07ce000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07c8158c20 0x7f07c8159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:58.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.458+0000 7f07ce000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07c8158c20 0x7f07c8159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45290/0 (socket says 172.21.15.135:45290) 2024-05-14T09:41:58.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.459+0000 7f07ce000640 1 -- 172.21.15.135:0/2845308429 learned_addr learned my addr 172.21.15.135:0/2845308429 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:58.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.460+0000 7f07ccc00640 1 --2- 172.21.15.135:0/2845308429 >> v2:172.21.15.196:3300/0 conn(0x7f07c80c7d80 0x7f07c81526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:58.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.461+0000 7f07ce000640 1 -- 172.21.15.135:0/2845308429 >> v2:172.21.15.196:3300/0 conn(0x7f07c80c7d80 msgr2=0x7f07c81526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:58.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.461+0000 7f07ce000640 1 --2- 172.21.15.135:0/2845308429 >> v2:172.21.15.196:3300/0 conn(0x7f07c80c7d80 0x7f07c81526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:58.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.461+0000 7f07ce000640 1 -- 172.21.15.135:0/2845308429 >> v1:172.21.15.196:6789/0 conn(0x7f07c80c99f0 legacy=0x7f07c80c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T09:41:58.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.462+0000 7f07ce000640 1 -- 172.21.15.135:0/2845308429 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c8159570 con 0x7f07c8158c20 2024-05-14T09:41:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.464+0000 7f07ce000640 1 --2- 172.21.15.135:0/2845308429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c8158c20 0x7f07c8159030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f07c8158700 tx=0x7f07c002c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbafec59470170e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:58.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.469+0000 7f07c7e00640 1 -- 172.21.15.135:0/2845308429 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0033770 con 0x7f07c8158c20 2024-05-14T09:41:58.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.469+0000 7f07c7e00640 1 -- 172.21.15.135:0/2845308429 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c0039070 con 0x7f07c8158c20 2024-05-14T09:41:58.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.469+0000 7f07c7e00640 1 -- 172.21.15.135:0/2845308429 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0033b30 con 0x7f07c8158c20 2024-05-14T09:41:58.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.470+0000 7f07cea00640 1 -- 172.21.15.135:0/2845308429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c8158c20 msgr2=0x7f07c8159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:58.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.470+0000 7f07cea00640 1 --2- 172.21.15.135:0/2845308429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c8158c20 0x7f07c8159030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f07c8158700 tx=0x7f07c002c900 comp rx=0 tx=0).stop 2024-05-14T09:41:58.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.470+0000 7f07cea00640 1 -- 172.21.15.135:0/2845308429 shutdown_connections 2024-05-14T09:41:58.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.470+0000 7f07cea00640 1 --2- 172.21.15.135:0/2845308429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c8158c20 0x7f07c8159030 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:58.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.470+0000 7f07cea00640 1 --2- 172.21.15.135:0/2845308429 >> v2:172.21.15.196:3300/0 conn(0x7f07c80c7d80 0x7f07c81526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:58.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.470+0000 7f07cea00640 1 -- 172.21.15.135:0/2845308429 >> 172.21.15.135:0/2845308429 conn(0x7f07c8074620 msgr2=0x7f07c80c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.470+0000 7f07cea00640 1 -- 172.21.15.135:0/2845308429 shutdown_connections 2024-05-14T09:41:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.470+0000 7f07cea00640 1 -- 172.21.15.135:0/2845308429 wait complete. 2024-05-14T09:41:58.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.472+0000 7f07cea00640 1 Processor -- start 2024-05-14T09:41:58.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.472+0000 7f07cea00640 1 -- start start 2024-05-14T09:41:58.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.474+0000 7f07cea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c80c7d80 0x7f07c81f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:58.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.474+0000 7f07cea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c80c99f0 0x7f07c81597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:58.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.474+0000 7f07cea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c8158c20 0x7f07c8146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:58.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.474+0000 7f07cea00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07c80c59a0 con 0x7f07c80c99f0 2024-05-14T09:41:58.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.474+0000 7f07cea00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f07c80c77a0 con 0x7f07c8158c20 2024-05-14T09:41:58.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.474+0000 7f07cea00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f07c80c5b20 con 0x7f07c80c7d80 2024-05-14T09:41:58.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.475+0000 7f07ccc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c80c99f0 0x7f07c81597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:58.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.475+0000 7f07ccc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c80c99f0 0x7f07c81597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:45306/0 (socket says 172.21.15.135:45306) 2024-05-14T09:41:58.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.475+0000 7f07ccc00640 1 -- 172.21.15.135:0/1942847765 learned_addr learned my addr 172.21.15.135:0/1942847765 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T09:41:58.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.476+0000 7f07ce000640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c8158c20 0x7f07c8146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:58.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.476+0000 7f07cd600640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c80c7d80 0x7f07c81f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:58.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.479+0000 7f07ccc00640 1 -- 172.21.15.135:0/1942847765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c80c7d80 msgr2=0x7f07c81f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:58.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.479+0000 7f07ccc00640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c80c7d80 0x7f07c81f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:58.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.479+0000 7f07ccc00640 1 -- 172.21.15.135:0/1942847765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c8158c20 msgr2=0x7f07c8146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:58.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.479+0000 7f07ccc00640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c8158c20 0x7f07c8146e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:58.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.479+0000 7f07ccc00640 1 -- 172.21.15.135:0/1942847765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c81f3640 con 0x7f07c80c99f0 2024-05-14T09:41:58.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.482+0000 7f07ccc00640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c80c99f0 0x7f07c81597b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c5c0 tx=0x7f07b400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:58.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.488+0000 7f07c5600640 1 -- 172.21.15.135:0/1942847765 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4004230 con 0x7f07c80c99f0 2024-05-14T09:41:58.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.488+0000 7f07c5600640 1 -- 172.21.15.135:0/1942847765 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b40043d0 con 0x7f07c80c99f0 2024-05-14T09:41:58.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.488+0000 7f07c5600640 1 -- 172.21.15.135:0/1942847765 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4003850 con 0x7f07c80c99f0 2024-05-14T09:41:58.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.488+0000 7f07cea00640 1 -- 172.21.15.135:0/1942847765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c8159cf0 con 0x7f07c80c99f0 2024-05-14T09:41:58.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.489+0000 7f07cea00640 1 -- 172.21.15.135:0/1942847765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c8154990 con 0x7f07c80c99f0 2024-05-14T09:41:58.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.490+0000 7f07cea00640 1 -- 172.21.15.135:0/1942847765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c80cab70 con 0x7f07c80c99f0 2024-05-14T09:41:58.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.847+0000 7f07c5600640 1 -- 172.21.15.135:0/1942847765 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f07b40039f0 con 0x7f07c80c99f0 2024-05-14T09:41:58.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.851+0000 7f07c5600640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a8076320 0x7f07a8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T09:41:58.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.852+0000 7f07cd600640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a8076320 0x7f07a8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T09:41:58.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.854+0000 7f07cd600640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a8076320 0x7f07a8078830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f07bc006fd0 tx=0x7f07bc009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T09:41:58.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.889+0000 7f07c5600640 1 -- 172.21.15.135:0/1942847765 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f07b405ce30 con 0x7f07c80c99f0 2024-05-14T09:41:58.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:58.890+0000 7f07c5600640 1 -- 172.21.15.135:0/1942847765 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f07c80cab70 con 0x7f07c80c99f0 2024-05-14T09:41:59.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.153+0000 7f07cea00640 1 -- 172.21.15.135:0/1942847765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f07c8069980 con 0x7f07c80c99f0 2024-05-14T09:41:59.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.172+0000 7f07c5600640 1 -- 172.21.15.135:0/1942847765 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+88 (secure 0 0 0) 0x7f07b4015020 con 0x7f07c80c99f0 2024-05-14T09:41:59.172 INFO:teuthology.orchestra.run.smithi135.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T09:41:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 -- 172.21.15.135:0/1942847765 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a8076320 msgr2=0x7f07a8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a8076320 0x7f07a8078830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f07bc006fd0 tx=0x7f07bc009060 comp rx=0 tx=0).stop 2024-05-14T09:41:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 -- 172.21.15.135:0/1942847765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c80c99f0 msgr2=0x7f07c81597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T09:41:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c80c99f0 0x7f07c81597b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c5c0 tx=0x7f07b400ca80 comp rx=0 tx=0).stop 2024-05-14T09:41:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 -- 172.21.15.135:0/1942847765 shutdown_connections 2024-05-14T09:41:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a8076320 0x7f07a8078830 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:59.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c8158c20 0x7f07c8146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:59.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c80c99f0 0x7f07c81597b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:59.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 --2- 172.21.15.135:0/1942847765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c80c7d80 0x7f07c81f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T09:41:59.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 -- 172.21.15.135:0/1942847765 >> 172.21.15.135:0/1942847765 conn(0x7f07c8074620 msgr2=0x7f07c806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T09:41:59.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 -- 172.21.15.135:0/1942847765 shutdown_connections 2024-05-14T09:41:59.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59.175+0000 7f07cea00640 1 -- 172.21.15.135:0/1942847765 wait complete. 2024-05-14T09:41:59.202 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T09:41:59.202 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T09:41:59.202 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-05-14T09:41:59.202 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-14T09:41:59.202 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T09:41:59.202 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T09:41:59.202 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T09:41:59.202 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T09:41:59.202 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-14T09:41:59.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:59.203 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-05-14T09:41:59.253 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T09:41:59.253 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T09:41:59.253 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T09:41:59.254 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:41:59.254 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-05-14T09:41:59.254 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:41:59.254 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:41:59.254 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:41:59.254 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-05-14T09:41:59.254 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:41:59.254 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:41:59.254 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-05-14T09:41:59.254 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T09:41:59.255 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:41:59.255 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T09:41:59.255 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-05-14T09:41:59.255 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T09:41:59.255 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42056sec preferred_lft 42056sec 2024-05-14T09:41:59.255 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link 2024-05-14T09:41:59.255 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-14T09:41:59.256 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T09:41:59.257 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:41:59.257 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-14T09:41:59.257 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-05-14T09:41:59.257 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-05-14T09:41:59.257 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-05-14T09:41:59.257 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T09:41:59.257 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-14T09:41:59.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:41:59.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:41:59.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:59.489 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T09:41:59.549 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-05-14T09:41:59.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:59.553 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-05-14T09:41:59.596 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-05-14T09:41:59.596 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T09:41:59.597 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T09:41:59.597 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T09:41:59.597 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T09:41:59.597 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:41:59.597 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-14T09:41:59.597 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T09:41:59.597 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T09:41:59.597 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T09:41:59.597 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-14T09:41:59.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:41:59.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:41:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:41:59.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:59.845 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-14T09:41:59.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:41:59.890 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-05-14T09:41:59.980 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:41:59.980 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-14T09:41:59.980 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:41:59.980 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-14T09:41:59.980 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-14T09:42:00.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:42:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:42:00.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:42:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:42:00.145 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-14T09:42:00.145 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:42:00.145 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-14T09:42:00.145 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-14T09:42:00.145 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T09:42:00.146 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-14T09:42:00.146 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-14T09:42:00.146 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-14T09:42:00.146 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-14T09:42:00.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:42:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:42:00.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:42:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:42:00.401 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T09:42:00.401 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-14T09:42:00.401 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-05-14T09:42:00.401 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T09:42:00.401 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-14T09:42:00.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:42:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T09:42:00.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:42:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:42:00.598 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-05-14T09:42:00.599 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T09:42:00.599 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-14T09:42:00.643 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-14T09:42:00.643 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T09:42:00.644 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-14T09:42:00.736 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-14T09:42:00.736 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:42:00.814 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:42:00.867 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:42:00.867 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:42:00.867 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:42:00.867 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:42:00.867 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:42:00.867 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:42:00.868 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:42:00.869 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:42:00.869 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:42:00.869 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:42:00.869 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:42:00.869 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:42:00.869 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:42:00.869 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:42:00.869 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:42:00.869 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:00.869 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:00.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:00.870 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:42:00.919 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T09:42:00.919 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-14T09:42:00.923 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:42:00.993 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:42:01.035 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:42:01.036 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:01.037 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:01.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:01.038 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:42:02.225 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:42:02.302 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:42:02.350 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:42:02.350 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:42:02.350 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:42:02.350 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:42:02.350 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:42:02.350 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:42:02.350 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:42:02.351 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:42:02.352 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:42:02.352 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:42:02.352 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:42:02.352 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:42:02.352 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:42:02.352 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:42:02.352 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:42:02.352 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:42:02.352 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:02.352 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:02.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:02.353 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:42:03.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:42:03.566 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:42:03.608 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:42:03.608 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:42:03.608 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:42:03.608 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:42:03.608 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:42:03.608 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:42:03.608 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:42:03.609 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:42:03.610 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:42:03.610 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:42:03.610 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:42:03.610 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:42:03.610 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:42:03.610 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:42:03.610 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:42:03.610 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:03.610 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:03.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:03.611 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:42:04.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:42:04.874 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:42:04.920 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:42:04.920 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:42:04.920 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:42:04.920 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:42:04.920 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:42:04.920 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:42:04.921 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:04.922 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:04.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:04.923 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:42:06.068 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:42:06.142 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:42:06.184 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:42:06.185 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:42:06.186 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:42:06.187 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:42:06.187 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:06.187 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:06.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:06.188 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:42:07.376 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:42:07.453 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:42:07.501 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:42:07.501 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:42:07.501 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:42:07.502 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:42:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:42:07.504 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:07.504 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:07.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:07.505 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:42:08.405 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi135.stderr:ceph-fuse[45699]: starting ceph client 2024-05-14T09:42:08.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi135.stderr:2024-05-14T09:42:08.276+0000 6782280 -1 init, newargv = 0xbcecd50 newargc=15 2024-05-14T09:42:08.649 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:42:08.729 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:42:08.778 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:42:08.778 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:42:08.778 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:42:08.778 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:42:08.778 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:42:08.778 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:42:08.778 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:42:08.778 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:42:08.778 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:42:08.778 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:42:08.778 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:42:08.779 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:42:08.780 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:42:08.780 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:42:08.780 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:42:08.780 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:08.780 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:08.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:08.781 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:42:09.922 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-14T09:42:09.997 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T09:42:10.047 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T09:42:10.048 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-05-14T09:42:10.049 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:10.049 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T09:42:10.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:10.050 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-14T09:42:10.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi135.stderr:ceph-fuse[45699]: starting fuse 2024-05-14T09:42:10.088 INFO:teuthology.orchestra.run.smithi135.stdout:41 2024-05-14T09:42:10.088 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo stdin-killer -- python3 -c ' 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> import glob 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> import re 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> import os 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> import subprocess 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> def _find_admin_socket(client_name): 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> files = glob.glob(asok_path) 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> # Given a non-glob path, it better be there 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> if "*" not in asok_path: 2024-05-14T09:42:10.089 DEBUG:teuthology.orchestra.run.smithi135:> assert(len(files) == 1) 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> return files[0] 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> for f in files: 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> contents = proc_f.read() 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> if mountpoint in contents: 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> return f 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> print(_find_admin_socket("client.0")) 2024-05-14T09:42:10.090 DEBUG:teuthology.orchestra.run.smithi135:> ' 2024-05-14T09:42:10.277 INFO:teuthology.orchestra.run.smithi135.stdout:/var/run/ceph/ceph-client.0.45699.asok 2024-05-14T09:42:10.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T09:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T09:42:10.294 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45699.asok 2024-05-14T09:42:10.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:10.294 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45699.asok status 2024-05-14T09:42:10.757 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T09:42:10.759 INFO:teuthology.orchestra.run.smithi135.stdout: "metadata": { 2024-05-14T09:42:10.759 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T09:42:10.759 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T09:42:10.759 INFO:teuthology.orchestra.run.smithi135.stdout: "entity_id": "0", 2024-05-14T09:42:10.759 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": "smithi135", 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "pid": "45699", 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "root": "/" 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_count": 0, 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_pinned_count": 0, 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4593, 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "inst": { 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "name": { 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "client", 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "num": 4593 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2024-05-14T09:42:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 197285930 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 197285930 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "inst_str": "client.4593 192.168.0.1:0/197285930", 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "addr_str": "192.168.0.1:0/197285930", 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "inode_count": 1, 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_epoch": 14, 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch": 33, 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch_barrier": 0, 2024-05-14T09:42:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "blocklisted": false, 2024-05-14T09:42:10.762 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs" 2024-05-14T09:42:10.762 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T09:42:10.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:10.787 DEBUG:teuthology.orchestra.run.smithi135:> stat --file-system '--printf=%T 2024-05-14T09:42:10.787 DEBUG:teuthology.orchestra.run.smithi135:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-14T09:42:11.030 INFO:teuthology.orchestra.run.smithi135.stdout:fuseblk 2024-05-14T09:42:11.030 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-14T09:42:11.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T09:42:11.031 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-14T09:42:11.195 INFO:teuthology.run_tasks:Running task workunit... 2024-05-14T09:42:11.208 INFO:tasks.workunit:Pulling workunits from ref e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:42:11.208 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-14T09:42:11.208 INFO:tasks.workunit:timeout=3h 2024-05-14T09:42:11.209 INFO:tasks.workunit:cleanup=True 2024-05-14T09:42:11.209 DEBUG:teuthology.orchestra.run.smithi135:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-14T09:42:11.266 INFO:teuthology.orchestra.run.smithi135.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-14T09:42:11.266 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-14T09:42:11.266 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-05-14T09:42:11.266 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T09:42:11.266 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-14T09:42:11.266 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-14T09:42:11.266 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-14 09:40:47.911310893 +0000 2024-05-14T09:42:11.266 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-14 09:41:10.524433990 +0000 2024-05-14T09:42:11.266 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-14T09:42:11.266 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-14T09:42:11.267 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-14T09:42:12.696 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T09:42:12.753 INFO:tasks.workunit.client.0.smithi135.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-14T09:42:23.405 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:42:23.413 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:42:53.691 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:42:53.700 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:43:23.838 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:43:23.846 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:43:45.733 INFO:tasks.workunit.client.0.smithi135.stderr:Updating files: 61% (7575/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-14T09:43:46.736 INFO:tasks.workunit.client.0.smithi135.stderr:Note: switching to 'e2b755a64f0d72176b57299d02e880cf0620d780'. 2024-05-14T09:43:46.736 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-14T09:43:46.736 INFO:tasks.workunit.client.0.smithi135.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-14T09:43:46.736 INFO:tasks.workunit.client.0.smithi135.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-14T09:43:46.736 INFO:tasks.workunit.client.0.smithi135.stderr:state without impacting any branches by switching back to a branch. 2024-05-14T09:43:46.736 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-14T09:43:46.736 INFO:tasks.workunit.client.0.smithi135.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-14T09:43:46.736 INFO:tasks.workunit.client.0.smithi135.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-14T09:43:46.736 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-14T09:43:46.736 INFO:tasks.workunit.client.0.smithi135.stderr: git switch -c 2024-05-14T09:43:46.736 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-14T09:43:46.737 INFO:tasks.workunit.client.0.smithi135.stderr:Or undo this operation with: 2024-05-14T09:43:46.737 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-14T09:43:46.737 INFO:tasks.workunit.client.0.smithi135.stderr: git switch - 2024-05-14T09:43:46.737 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-14T09:43:46.737 INFO:tasks.workunit.client.0.smithi135.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-14T09:43:46.737 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-14T09:43:46.737 INFO:tasks.workunit.client.0.smithi135.stderr:HEAD is now at e2b755a64f0 Merge PR #53755 into wip-vshankar-testing-20240509.053109-debug 2024-05-14T09:43:46.749 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-14T09:43:46.801 INFO:tasks.workunit.client.0.smithi135.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-14T09:43:46.808 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-14T09:43:46.808 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-14T09:43:47.573 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-14T09:43:47.675 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-14T09:43:47.762 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-14T09:43:47.768 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-14T09:43:47.768 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-14T09:43:47.859 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-14T09:43:47.867 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T09:43:47.867 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-14T09:43:47.914 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-05-14T09:43:47.915 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-05-14T09:43:47.916 DEBUG:teuthology.orchestra.run.smithi135:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e2b755a64f0d72176b57299d02e880cf0620d780 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-05-14T09:43:48.630 INFO:tasks.workunit.client.0.smithi135.stderr:+ dbench 1 2024-05-14T09:43:48.640 INFO:tasks.workunit.client.0.smithi135.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-14T09:43:48.641 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-14T09:43:48.641 INFO:tasks.workunit.client.0.smithi135.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-14T09:43:48.644 INFO:tasks.workunit.client.0.smithi135.stdout:0 of 1 processes prepared for launch 0 sec 2024-05-14T09:43:48.744 INFO:tasks.workunit.client.0.smithi135.stdout:1 of 1 processes prepared for launch 0 sec 2024-05-14T09:43:48.745 INFO:tasks.workunit.client.0.smithi135.stdout:releasing clients 2024-05-14T09:43:49.745 INFO:tasks.workunit.client.0.smithi135.stdout: 0 7 0.00 MB/sec warmup 1 sec latency 10.820 ms 2024-05-14T09:43:50.745 INFO:tasks.workunit.client.0.smithi135.stdout: 0 10 0.00 MB/sec warmup 2 sec latency 497.652 ms 2024-05-14T09:43:51.745 INFO:tasks.workunit.client.0.smithi135.stdout: 1 31 0.35 MB/sec warmup 3 sec latency 70.673 ms 2024-05-14T09:43:52.745 INFO:tasks.workunit.client.0.smithi135.stdout: 1 51 0.52 MB/sec warmup 4 sec latency 673.063 ms 2024-05-14T09:43:53.746 INFO:tasks.workunit.client.0.smithi135.stdout: 1 71 0.63 MB/sec warmup 5 sec latency 532.348 ms 2024-05-14T09:43:53.949 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:43:53.959 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:43:54.746 INFO:tasks.workunit.client.0.smithi135.stdout: 1 111 0.87 MB/sec warmup 6 sec latency 506.220 ms 2024-05-14T09:43:55.746 INFO:tasks.workunit.client.0.smithi135.stdout: 1 121 0.79 MB/sec warmup 7 sec latency 394.258 ms 2024-05-14T09:43:56.746 INFO:tasks.workunit.client.0.smithi135.stdout: 1 137 0.75 MB/sec warmup 8 sec latency 620.071 ms 2024-05-14T09:43:57.746 INFO:tasks.workunit.client.0.smithi135.stdout: 1 147 0.70 MB/sec warmup 9 sec latency 443.062 ms 2024-05-14T09:43:58.746 INFO:tasks.workunit.client.0.smithi135.stdout: 1 157 0.65 MB/sec warmup 10 sec latency 604.972 ms 2024-05-14T09:43:59.746 INFO:tasks.workunit.client.0.smithi135.stdout: 1 165 0.62 MB/sec warmup 11 sec latency 685.517 ms 2024-05-14T09:44:00.746 INFO:tasks.workunit.client.0.smithi135.stdout: 1 178 0.60 MB/sec warmup 12 sec latency 611.067 ms 2024-05-14T09:44:01.746 INFO:tasks.workunit.client.0.smithi135.stdout: 1 189 0.58 MB/sec warmup 13 sec latency 595.373 ms 2024-05-14T09:44:02.747 INFO:tasks.workunit.client.0.smithi135.stdout: 1 199 0.56 MB/sec warmup 14 sec latency 588.472 ms 2024-05-14T09:44:03.747 INFO:tasks.workunit.client.0.smithi135.stdout: 1 215 0.56 MB/sec warmup 15 sec latency 618.159 ms 2024-05-14T09:44:04.747 INFO:tasks.workunit.client.0.smithi135.stdout: 1 223 0.54 MB/sec warmup 16 sec latency 628.768 ms 2024-05-14T09:44:05.747 INFO:tasks.workunit.client.0.smithi135.stdout: 1 239 0.54 MB/sec warmup 17 sec latency 588.848 ms 2024-05-14T09:44:06.747 INFO:tasks.workunit.client.0.smithi135.stdout: 1 255 0.54 MB/sec warmup 18 sec latency 492.440 ms 2024-05-14T09:44:07.747 INFO:tasks.workunit.client.0.smithi135.stdout: 1 263 0.52 MB/sec warmup 19 sec latency 538.195 ms 2024-05-14T09:44:08.748 INFO:tasks.workunit.client.0.smithi135.stdout: 1 279 0.52 MB/sec warmup 20 sec latency 569.735 ms 2024-05-14T09:44:09.748 INFO:tasks.workunit.client.0.smithi135.stdout: 1 287 0.51 MB/sec warmup 21 sec latency 754.979 ms 2024-05-14T09:44:10.748 INFO:tasks.workunit.client.0.smithi135.stdout: 1 297 0.50 MB/sec warmup 22 sec latency 530.913 ms 2024-05-14T09:44:11.748 INFO:tasks.workunit.client.0.smithi135.stdout: 1 313 0.50 MB/sec warmup 23 sec latency 678.953 ms 2024-05-14T09:44:12.748 INFO:tasks.workunit.client.0.smithi135.stdout: 1 323 0.49 MB/sec warmup 24 sec latency 466.250 ms 2024-05-14T09:44:13.748 INFO:tasks.workunit.client.0.smithi135.stdout: 1 331 0.48 MB/sec warmup 25 sec latency 779.989 ms 2024-05-14T09:44:14.748 INFO:tasks.workunit.client.0.smithi135.stdout: 1 345 0.47 MB/sec warmup 26 sec latency 557.372 ms 2024-05-14T09:44:15.748 INFO:tasks.workunit.client.0.smithi135.stdout: 1 357 0.47 MB/sec warmup 27 sec latency 504.269 ms 2024-05-14T09:44:16.748 INFO:tasks.workunit.client.0.smithi135.stdout: 1 373 0.48 MB/sec warmup 28 sec latency 570.577 ms 2024-05-14T09:44:17.748 INFO:tasks.workunit.client.0.smithi135.stdout: 1 381 0.47 MB/sec warmup 29 sec latency 589.717 ms 2024-05-14T09:44:18.749 INFO:tasks.workunit.client.0.smithi135.stdout: 1 397 0.47 MB/sec warmup 30 sec latency 566.997 ms 2024-05-14T09:44:19.749 INFO:tasks.workunit.client.0.smithi135.stdout: 1 413 0.47 MB/sec warmup 31 sec latency 584.351 ms 2024-05-14T09:44:20.749 INFO:tasks.workunit.client.0.smithi135.stdout: 1 421 0.46 MB/sec warmup 32 sec latency 690.610 ms 2024-05-14T09:44:21.749 INFO:tasks.workunit.client.0.smithi135.stdout: 1 430 0.46 MB/sec warmup 33 sec latency 642.442 ms 2024-05-14T09:44:22.749 INFO:tasks.workunit.client.0.smithi135.stdout: 1 445 0.46 MB/sec warmup 34 sec latency 690.919 ms 2024-05-14T09:44:23.749 INFO:tasks.workunit.client.0.smithi135.stdout: 1 453 0.45 MB/sec warmup 35 sec latency 584.036 ms 2024-05-14T09:44:24.073 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:44:24.082 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:44:24.749 INFO:tasks.workunit.client.0.smithi135.stdout: 1 465 0.45 MB/sec warmup 36 sec latency 874.823 ms 2024-05-14T09:44:25.749 INFO:tasks.workunit.client.0.smithi135.stdout: 1 477 0.45 MB/sec warmup 37 sec latency 677.485 ms 2024-05-14T09:44:26.750 INFO:tasks.workunit.client.0.smithi135.stdout: 1 485 0.45 MB/sec warmup 38 sec latency 668.323 ms 2024-05-14T09:44:27.750 INFO:tasks.workunit.client.0.smithi135.stdout: 1 501 0.45 MB/sec warmup 39 sec latency 772.371 ms 2024-05-14T09:44:28.750 INFO:tasks.workunit.client.0.smithi135.stdout: 1 511 0.44 MB/sec warmup 40 sec latency 561.056 ms 2024-05-14T09:44:29.750 INFO:tasks.workunit.client.0.smithi135.stdout: 1 513 0.43 MB/sec warmup 41 sec latency 775.815 ms 2024-05-14T09:44:30.750 INFO:tasks.workunit.client.0.smithi135.stdout: 1 542 0.45 MB/sec warmup 42 sec latency 539.270 ms 2024-05-14T09:44:31.750 INFO:tasks.workunit.client.0.smithi135.stdout: 1 602 0.49 MB/sec warmup 43 sec latency 589.646 ms 2024-05-14T09:44:32.750 INFO:tasks.workunit.client.0.smithi135.stdout: 1 606 0.48 MB/sec warmup 44 sec latency 950.298 ms 2024-05-14T09:44:33.750 INFO:tasks.workunit.client.0.smithi135.stdout: 1 609 0.47 MB/sec warmup 45 sec latency 413.454 ms 2024-05-14T09:44:34.750 INFO:tasks.workunit.client.0.smithi135.stdout: 1 609 0.46 MB/sec warmup 46 sec latency 1413.586 ms 2024-05-14T09:44:35.751 INFO:tasks.workunit.client.0.smithi135.stdout: 1 614 0.45 MB/sec warmup 47 sec latency 1586.305 ms 2024-05-14T09:44:36.751 INFO:tasks.workunit.client.0.smithi135.stdout: 1 644 0.44 MB/sec warmup 48 sec latency 1311.519 ms 2024-05-14T09:44:37.751 INFO:tasks.workunit.client.0.smithi135.stdout: 1 644 0.43 MB/sec warmup 49 sec latency 1020.463 ms 2024-05-14T09:44:38.751 INFO:tasks.workunit.client.0.smithi135.stdout: 1 645 0.42 MB/sec warmup 50 sec latency 1251.462 ms 2024-05-14T09:44:39.751 INFO:tasks.workunit.client.0.smithi135.stdout: 1 649 0.41 MB/sec warmup 51 sec latency 1348.533 ms 2024-05-14T09:44:40.751 INFO:tasks.workunit.client.0.smithi135.stdout: 1 653 0.41 MB/sec warmup 52 sec latency 592.026 ms 2024-05-14T09:44:41.751 INFO:tasks.workunit.client.0.smithi135.stdout: 1 654 0.40 MB/sec warmup 53 sec latency 1152.618 ms 2024-05-14T09:44:42.752 INFO:tasks.workunit.client.0.smithi135.stdout: 1 669 0.39 MB/sec warmup 54 sec latency 544.380 ms 2024-05-14T09:44:43.752 INFO:tasks.workunit.client.0.smithi135.stdout: 1 680 0.39 MB/sec warmup 55 sec latency 393.073 ms 2024-05-14T09:44:44.752 INFO:tasks.workunit.client.0.smithi135.stdout: 1 680 0.38 MB/sec warmup 56 sec latency 1393.290 ms 2024-05-14T09:44:45.752 INFO:tasks.workunit.client.0.smithi135.stdout: 1 682 0.37 MB/sec warmup 57 sec latency 1673.847 ms 2024-05-14T09:44:46.753 INFO:tasks.workunit.client.0.smithi135.stdout: 1 695 0.37 MB/sec warmup 58 sec latency 1141.535 ms 2024-05-14T09:44:47.752 INFO:tasks.workunit.client.0.smithi135.stdout: 1 708 0.36 MB/sec warmup 59 sec latency 426.367 ms 2024-05-14T09:44:48.752 INFO:tasks.workunit.client.0.smithi135.stdout: 1 711 0.35 MB/sec warmup 60 sec latency 818.135 ms 2024-05-14T09:44:49.752 INFO:tasks.workunit.client.0.smithi135.stdout: 1 723 0.35 MB/sec warmup 61 sec latency 350.122 ms 2024-05-14T09:44:50.753 INFO:tasks.workunit.client.0.smithi135.stdout: 1 743 0.34 MB/sec warmup 62 sec latency 185.392 ms 2024-05-14T09:44:51.753 INFO:tasks.workunit.client.0.smithi135.stdout: 1 744 0.34 MB/sec warmup 63 sec latency 826.030 ms 2024-05-14T09:44:52.753 INFO:tasks.workunit.client.0.smithi135.stdout: 1 746 0.33 MB/sec warmup 64 sec latency 1091.424 ms 2024-05-14T09:44:53.753 INFO:tasks.workunit.client.0.smithi135.stdout: 1 769 0.33 MB/sec warmup 65 sec latency 1029.386 ms 2024-05-14T09:44:54.235 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:44:54.244 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:44:54.753 INFO:tasks.workunit.client.0.smithi135.stdout: 1 778 0.32 MB/sec warmup 66 sec latency 459.796 ms 2024-05-14T09:44:55.753 INFO:tasks.workunit.client.0.smithi135.stdout: 1 780 0.32 MB/sec warmup 67 sec latency 540.349 ms 2024-05-14T09:44:56.753 INFO:tasks.workunit.client.0.smithi135.stdout: 1 798 0.32 MB/sec warmup 68 sec latency 347.052 ms 2024-05-14T09:44:57.754 INFO:tasks.workunit.client.0.smithi135.stdout: 1 812 0.31 MB/sec warmup 69 sec latency 204.344 ms 2024-05-14T09:44:58.754 INFO:tasks.workunit.client.0.smithi135.stdout: 1 813 0.31 MB/sec warmup 70 sec latency 1107.892 ms 2024-05-14T09:44:59.754 INFO:tasks.workunit.client.0.smithi135.stdout: 1 813 0.30 MB/sec warmup 71 sec latency 1073.352 ms 2024-05-14T09:45:00.754 INFO:tasks.workunit.client.0.smithi135.stdout: 1 818 0.30 MB/sec warmup 72 sec latency 1296.762 ms 2024-05-14T09:45:01.754 INFO:tasks.workunit.client.0.smithi135.stdout: 1 821 0.29 MB/sec warmup 73 sec latency 1158.390 ms 2024-05-14T09:45:02.754 INFO:tasks.workunit.client.0.smithi135.stdout: 1 823 0.29 MB/sec warmup 74 sec latency 995.752 ms 2024-05-14T09:45:03.754 INFO:tasks.workunit.client.0.smithi135.stdout: 1 853 0.29 MB/sec warmup 75 sec latency 1129.856 ms 2024-05-14T09:45:04.754 INFO:tasks.workunit.client.0.smithi135.stdout: 1 853 0.28 MB/sec warmup 76 sec latency 1509.661 ms 2024-05-14T09:45:05.754 INFO:tasks.workunit.client.0.smithi135.stdout: 1 854 0.28 MB/sec warmup 77 sec latency 1569.359 ms 2024-05-14T09:45:06.755 INFO:tasks.workunit.client.0.smithi135.stdout: 1 862 0.28 MB/sec warmup 78 sec latency 1101.215 ms 2024-05-14T09:45:07.755 INFO:tasks.workunit.client.0.smithi135.stdout: 1 862 0.27 MB/sec warmup 79 sec latency 1079.380 ms 2024-05-14T09:45:08.755 INFO:tasks.workunit.client.0.smithi135.stdout: 1 872 0.27 MB/sec warmup 80 sec latency 1143.256 ms 2024-05-14T09:45:09.755 INFO:tasks.workunit.client.0.smithi135.stdout: 1 880 0.27 MB/sec warmup 81 sec latency 554.497 ms 2024-05-14T09:45:10.755 INFO:tasks.workunit.client.0.smithi135.stdout: 1 892 0.26 MB/sec warmup 82 sec latency 1125.061 ms 2024-05-14T09:45:11.755 INFO:tasks.workunit.client.0.smithi135.stdout: 1 902 0.26 MB/sec warmup 83 sec latency 457.757 ms 2024-05-14T09:45:12.755 INFO:tasks.workunit.client.0.smithi135.stdout: 1 904 0.26 MB/sec warmup 84 sec latency 812.780 ms 2024-05-14T09:45:13.755 INFO:tasks.workunit.client.0.smithi135.stdout: 1 921 0.26 MB/sec warmup 85 sec latency 312.672 ms 2024-05-14T09:45:14.755 INFO:tasks.workunit.client.0.smithi135.stdout: 1 927 0.25 MB/sec warmup 86 sec latency 616.478 ms 2024-05-14T09:45:15.756 INFO:tasks.workunit.client.0.smithi135.stdout: 1 928 0.25 MB/sec warmup 87 sec latency 1506.005 ms 2024-05-14T09:45:16.756 INFO:tasks.workunit.client.0.smithi135.stdout: 1 928 0.25 MB/sec warmup 88 sec latency 1111.511 ms 2024-05-14T09:45:17.757 INFO:tasks.workunit.client.0.smithi135.stdout: 1 930 0.24 MB/sec warmup 89 sec latency 1183.845 ms 2024-05-14T09:45:18.757 INFO:tasks.workunit.client.0.smithi135.stdout: 1 931 0.24 MB/sec warmup 90 sec latency 666.219 ms 2024-05-14T09:45:19.757 INFO:tasks.workunit.client.0.smithi135.stdout: 1 934 0.24 MB/sec warmup 91 sec latency 1319.132 ms 2024-05-14T09:45:20.757 INFO:tasks.workunit.client.0.smithi135.stdout: 1 937 0.24 MB/sec warmup 92 sec latency 642.854 ms 2024-05-14T09:45:21.757 INFO:tasks.workunit.client.0.smithi135.stdout: 1 942 0.23 MB/sec warmup 93 sec latency 1058.435 ms 2024-05-14T09:45:22.757 INFO:tasks.workunit.client.0.smithi135.stdout: 1 959 0.23 MB/sec warmup 94 sec latency 1082.187 ms 2024-05-14T09:45:23.757 INFO:tasks.workunit.client.0.smithi135.stdout: 1 969 0.23 MB/sec warmup 95 sec latency 361.175 ms 2024-05-14T09:45:24.350 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:45:24.358 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:45:24.757 INFO:tasks.workunit.client.0.smithi135.stdout: 1 971 0.23 MB/sec warmup 96 sec latency 692.120 ms 2024-05-14T09:45:25.758 INFO:tasks.workunit.client.0.smithi135.stdout: 1 992 0.23 MB/sec warmup 97 sec latency 313.947 ms 2024-05-14T09:45:26.758 INFO:tasks.workunit.client.0.smithi135.stdout: 1 994 0.22 MB/sec warmup 98 sec latency 753.907 ms 2024-05-14T09:45:27.758 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1009 0.23 MB/sec warmup 99 sec latency 1066.165 ms 2024-05-14T09:45:28.758 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1027 0.23 MB/sec warmup 100 sec latency 671.219 ms 2024-05-14T09:45:29.758 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1029 0.23 MB/sec warmup 101 sec latency 1360.381 ms 2024-05-14T09:45:30.758 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1033 0.22 MB/sec warmup 102 sec latency 500.554 ms 2024-05-14T09:45:31.759 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1038 0.22 MB/sec warmup 103 sec latency 1148.948 ms 2024-05-14T09:45:32.759 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1046 0.22 MB/sec warmup 104 sec latency 552.760 ms 2024-05-14T09:45:33.759 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1047 0.22 MB/sec warmup 105 sec latency 1181.523 ms 2024-05-14T09:45:34.759 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1048 0.22 MB/sec warmup 106 sec latency 1346.226 ms 2024-05-14T09:45:35.759 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1048 0.21 MB/sec warmup 107 sec latency 1025.352 ms 2024-05-14T09:45:36.759 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1060 0.21 MB/sec warmup 108 sec latency 1094.046 ms 2024-05-14T09:45:37.759 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1063 0.21 MB/sec warmup 109 sec latency 429.892 ms 2024-05-14T09:45:38.759 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1084 0.21 MB/sec warmup 110 sec latency 425.562 ms 2024-05-14T09:45:39.759 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1088 0.21 MB/sec warmup 111 sec latency 561.357 ms 2024-05-14T09:45:40.760 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1091 0.20 MB/sec warmup 112 sec latency 1336.057 ms 2024-05-14T09:45:41.760 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1100 0.20 MB/sec warmup 113 sec latency 323.214 ms 2024-05-14T09:45:42.760 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1102 0.20 MB/sec warmup 114 sec latency 1252.725 ms 2024-05-14T09:45:43.760 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1114 0.20 MB/sec warmup 115 sec latency 459.090 ms 2024-05-14T09:45:44.760 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1117 0.20 MB/sec warmup 116 sec latency 1244.893 ms 2024-05-14T09:45:45.760 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1128 0.20 MB/sec warmup 117 sec latency 370.143 ms 2024-05-14T09:45:46.760 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1143 0.19 MB/sec warmup 118 sec latency 407.629 ms 2024-05-14T09:45:47.760 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1153 0.19 MB/sec warmup 119 sec latency 696.308 ms 2024-05-14T09:45:49.760 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1159 0.00 MB/sec execute 1 sec latency 1331.379 ms 2024-05-14T09:45:50.761 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1168 0.00 MB/sec execute 2 sec latency 445.165 ms 2024-05-14T09:45:51.761 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1169 0.00 MB/sec execute 3 sec latency 1067.957 ms 2024-05-14T09:45:52.761 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1170 0.00 MB/sec execute 4 sec latency 1220.464 ms 2024-05-14T09:45:53.761 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1170 0.00 MB/sec execute 5 sec latency 1157.184 ms 2024-05-14T09:45:54.472 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:45:54.480 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:45:54.761 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1176 0.00 MB/sec execute 6 sec latency 1185.905 ms 2024-05-14T09:45:55.761 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1180 0.00 MB/sec execute 7 sec latency 405.823 ms 2024-05-14T09:45:56.761 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1200 0.00 MB/sec execute 8 sec latency 430.623 ms 2024-05-14T09:45:57.761 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1204 0.00 MB/sec execute 9 sec latency 472.015 ms 2024-05-14T09:45:58.762 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1211 0.00 MB/sec execute 10 sec latency 1068.561 ms 2024-05-14T09:45:59.762 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1215 0.00 MB/sec execute 11 sec latency 429.032 ms 2024-05-14T09:46:00.762 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1231 0.01 MB/sec execute 12 sec latency 366.296 ms 2024-05-14T09:46:01.763 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1244 0.01 MB/sec execute 13 sec latency 410.548 ms 2024-05-14T09:46:02.762 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1248 0.01 MB/sec execute 14 sec latency 721.319 ms 2024-05-14T09:46:03.762 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1251 0.01 MB/sec execute 15 sec latency 1047.446 ms 2024-05-14T09:46:04.762 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1263 0.01 MB/sec execute 16 sec latency 422.155 ms 2024-05-14T09:46:05.763 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1278 0.01 MB/sec execute 17 sec latency 341.586 ms 2024-05-14T09:46:06.763 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1280 0.01 MB/sec execute 18 sec latency 1098.613 ms 2024-05-14T09:46:07.763 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1281 0.01 MB/sec execute 19 sec latency 1056.083 ms 2024-05-14T09:46:08.763 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1284 0.01 MB/sec execute 20 sec latency 1125.976 ms 2024-05-14T09:46:09.763 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1284 0.01 MB/sec execute 21 sec latency 1002.521 ms 2024-05-14T09:46:10.763 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1296 0.02 MB/sec execute 22 sec latency 1672.314 ms 2024-05-14T09:46:11.763 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1376 0.13 MB/sec execute 23 sec latency 861.013 ms 2024-05-14T09:46:12.763 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1377 0.12 MB/sec execute 24 sec latency 1112.333 ms 2024-05-14T09:46:13.766 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1380 0.12 MB/sec execute 25 sec latency 1159.721 ms 2024-05-14T09:46:14.764 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1381 0.11 MB/sec execute 26 sec latency 971.598 ms 2024-05-14T09:46:15.764 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1385 0.11 MB/sec execute 27 sec latency 1196.304 ms 2024-05-14T09:46:16.764 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1391 0.11 MB/sec execute 28 sec latency 1092.316 ms 2024-05-14T09:46:17.764 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1397 0.10 MB/sec execute 29 sec latency 348.488 ms 2024-05-14T09:46:18.764 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1397 0.10 MB/sec execute 30 sec latency 1017.538 ms 2024-05-14T09:46:19.764 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1410 0.10 MB/sec execute 31 sec latency 1026.521 ms 2024-05-14T09:46:20.764 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1417 0.09 MB/sec execute 32 sec latency 821.814 ms 2024-05-14T09:46:21.765 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1419 0.09 MB/sec execute 33 sec latency 1147.171 ms 2024-05-14T09:46:22.765 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1438 0.09 MB/sec execute 34 sec latency 436.109 ms 2024-05-14T09:46:23.765 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1446 0.09 MB/sec execute 35 sec latency 439.714 ms 2024-05-14T09:46:24.602 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:46:24.610 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:46:24.765 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1448 0.08 MB/sec execute 36 sec latency 800.683 ms 2024-05-14T09:46:25.765 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1462 0.08 MB/sec execute 37 sec latency 1008.804 ms 2024-05-14T09:46:26.765 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1466 0.08 MB/sec execute 38 sec latency 342.206 ms 2024-05-14T09:46:27.765 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1469 0.08 MB/sec execute 39 sec latency 1062.172 ms 2024-05-14T09:46:28.765 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1485 0.08 MB/sec execute 40 sec latency 469.653 ms 2024-05-14T09:46:29.766 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1485 0.07 MB/sec execute 41 sec latency 1469.784 ms 2024-05-14T09:46:30.766 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1489 0.07 MB/sec execute 42 sec latency 1593.961 ms 2024-05-14T09:46:31.766 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1490 0.07 MB/sec execute 43 sec latency 662.455 ms 2024-05-14T09:46:32.766 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1499 0.07 MB/sec execute 44 sec latency 1152.207 ms 2024-05-14T09:46:33.766 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1502 0.07 MB/sec execute 45 sec latency 583.477 ms 2024-05-14T09:46:34.766 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1516 0.07 MB/sec execute 46 sec latency 539.039 ms 2024-05-14T09:46:35.766 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1525 0.07 MB/sec execute 47 sec latency 487.719 ms 2024-05-14T09:46:36.766 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1526 0.06 MB/sec execute 48 sec latency 992.996 ms 2024-05-14T09:46:37.767 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1530 0.06 MB/sec execute 49 sec latency 1091.069 ms 2024-05-14T09:46:38.767 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1551 0.06 MB/sec execute 50 sec latency 1100.861 ms 2024-05-14T09:46:39.767 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1555 0.06 MB/sec execute 51 sec latency 393.751 ms 2024-05-14T09:46:40.767 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1555 0.06 MB/sec execute 52 sec latency 1273.138 ms 2024-05-14T09:46:41.767 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1568 0.06 MB/sec execute 53 sec latency 1279.848 ms 2024-05-14T09:46:42.767 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1580 0.06 MB/sec execute 54 sec latency 213.161 ms 2024-05-14T09:46:43.767 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1587 0.06 MB/sec execute 55 sec latency 218.670 ms 2024-05-14T09:46:44.768 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1589 0.06 MB/sec execute 56 sec latency 490.046 ms 2024-05-14T09:46:45.768 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1591 0.06 MB/sec execute 57 sec latency 1391.073 ms 2024-05-14T09:46:46.768 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1606 0.05 MB/sec execute 58 sec latency 373.387 ms 2024-05-14T09:46:47.768 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1607 0.05 MB/sec execute 59 sec latency 1187.647 ms 2024-05-14T09:46:48.768 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1610 0.05 MB/sec execute 60 sec latency 783.420 ms 2024-05-14T09:46:49.768 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1613 0.05 MB/sec execute 61 sec latency 1237.833 ms 2024-05-14T09:46:50.768 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1617 0.05 MB/sec execute 62 sec latency 442.709 ms 2024-05-14T09:46:51.768 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1625 0.05 MB/sec execute 63 sec latency 1052.136 ms 2024-05-14T09:46:52.769 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1641 0.05 MB/sec execute 64 sec latency 339.116 ms 2024-05-14T09:46:53.769 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1643 0.05 MB/sec execute 65 sec latency 1046.631 ms 2024-05-14T09:46:54.769 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1644 0.05 MB/sec execute 66 sec latency 738.557 ms 2024-05-14T09:46:54.802 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:46:54.810 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:46:55.769 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1653 0.05 MB/sec execute 67 sec latency 1095.822 ms 2024-05-14T09:46:56.769 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1669 0.05 MB/sec execute 68 sec latency 568.326 ms 2024-05-14T09:46:57.769 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1686 0.05 MB/sec execute 69 sec latency 545.878 ms 2024-05-14T09:46:58.769 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1689 0.05 MB/sec execute 70 sec latency 791.962 ms 2024-05-14T09:46:59.770 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1699 0.05 MB/sec execute 71 sec latency 652.827 ms 2024-05-14T09:47:00.770 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1701 0.04 MB/sec execute 72 sec latency 608.783 ms 2024-05-14T09:47:01.770 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1707 0.04 MB/sec execute 73 sec latency 1157.241 ms 2024-05-14T09:47:02.770 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1707 0.04 MB/sec execute 74 sec latency 1241.498 ms 2024-05-14T09:47:03.770 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1715 0.04 MB/sec execute 75 sec latency 1558.688 ms 2024-05-14T09:47:04.770 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1727 0.04 MB/sec execute 76 sec latency 177.467 ms 2024-05-14T09:47:05.770 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1758 0.04 MB/sec execute 77 sec latency 237.379 ms 2024-05-14T09:47:06.770 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1770 0.04 MB/sec execute 78 sec latency 440.468 ms 2024-05-14T09:47:07.771 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1772 0.04 MB/sec execute 79 sec latency 799.368 ms 2024-05-14T09:47:08.771 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1789 0.04 MB/sec execute 80 sec latency 1064.438 ms 2024-05-14T09:47:09.771 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1803 0.04 MB/sec execute 81 sec latency 233.536 ms 2024-05-14T09:47:10.771 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1806 0.04 MB/sec execute 82 sec latency 381.140 ms 2024-05-14T09:47:11.771 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1817 0.04 MB/sec execute 83 sec latency 1118.905 ms 2024-05-14T09:47:12.771 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1822 0.04 MB/sec execute 84 sec latency 481.745 ms 2024-05-14T09:47:13.771 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1823 0.04 MB/sec execute 85 sec latency 1144.236 ms 2024-05-14T09:47:14.771 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1826 0.04 MB/sec execute 86 sec latency 883.240 ms 2024-05-14T09:47:15.772 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1836 0.04 MB/sec execute 87 sec latency 1105.299 ms 2024-05-14T09:47:16.772 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1840 0.04 MB/sec execute 88 sec latency 310.408 ms 2024-05-14T09:47:17.772 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1841 0.04 MB/sec execute 89 sec latency 944.340 ms 2024-05-14T09:47:18.772 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1855 0.04 MB/sec execute 90 sec latency 1120.255 ms 2024-05-14T09:47:19.772 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1858 0.04 MB/sec execute 91 sec latency 896.968 ms 2024-05-14T09:47:20.772 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1862 0.04 MB/sec execute 92 sec latency 1334.729 ms 2024-05-14T09:47:21.772 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1865 0.04 MB/sec execute 93 sec latency 1109.396 ms 2024-05-14T09:47:22.772 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1869 0.04 MB/sec execute 94 sec latency 345.447 ms 2024-05-14T09:47:23.773 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1869 0.04 MB/sec execute 95 sec latency 1026.167 ms 2024-05-14T09:47:24.773 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1893 0.04 MB/sec execute 96 sec latency 1094.897 ms 2024-05-14T09:47:24.946 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:47:24.954 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:47:25.773 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1898 0.03 MB/sec execute 97 sec latency 909.617 ms 2024-05-14T09:47:26.773 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1903 0.03 MB/sec execute 98 sec latency 1081.074 ms 2024-05-14T09:47:27.773 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1910 0.03 MB/sec execute 99 sec latency 1085.564 ms 2024-05-14T09:47:28.773 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1912 0.03 MB/sec execute 100 sec latency 668.687 ms 2024-05-14T09:47:29.773 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1920 0.03 MB/sec execute 101 sec latency 1126.833 ms 2024-05-14T09:47:30.773 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1920 0.03 MB/sec execute 102 sec latency 1178.434 ms 2024-05-14T09:47:31.774 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1952 0.03 MB/sec execute 103 sec latency 1428.896 ms 2024-05-14T09:47:32.774 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1973 0.03 MB/sec execute 104 sec latency 233.725 ms 2024-05-14T09:47:33.774 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1975 0.03 MB/sec execute 105 sec latency 619.662 ms 2024-05-14T09:47:34.774 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1976 0.03 MB/sec execute 106 sec latency 1102.217 ms 2024-05-14T09:47:35.774 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1996 0.03 MB/sec execute 107 sec latency 181.602 ms 2024-05-14T09:47:36.774 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1997 0.03 MB/sec execute 108 sec latency 965.002 ms 2024-05-14T09:47:37.774 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2002 0.03 MB/sec execute 109 sec latency 1397.580 ms 2024-05-14T09:47:38.774 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2012 0.03 MB/sec execute 110 sec latency 346.789 ms 2024-05-14T09:47:39.775 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2024 0.03 MB/sec execute 111 sec latency 223.801 ms 2024-05-14T09:47:40.775 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2034 0.03 MB/sec execute 112 sec latency 266.238 ms 2024-05-14T09:47:41.775 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2034 0.03 MB/sec execute 113 sec latency 1139.890 ms 2024-05-14T09:47:42.775 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2043 0.03 MB/sec execute 114 sec latency 1275.786 ms 2024-05-14T09:47:43.775 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2051 0.03 MB/sec execute 115 sec latency 1128.578 ms 2024-05-14T09:47:44.775 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2052 0.03 MB/sec execute 116 sec latency 1108.662 ms 2024-05-14T09:47:45.775 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2053 0.03 MB/sec execute 117 sec latency 985.389 ms 2024-05-14T09:47:46.776 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2059 0.03 MB/sec execute 118 sec latency 1072.026 ms 2024-05-14T09:47:47.776 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2061 0.03 MB/sec execute 119 sec latency 564.495 ms 2024-05-14T09:47:48.776 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2076 0.03 MB/sec execute 120 sec latency 1174.467 ms 2024-05-14T09:47:49.776 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2079 0.03 MB/sec execute 121 sec latency 930.411 ms 2024-05-14T09:47:50.776 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2081 0.03 MB/sec execute 122 sec latency 1557.101 ms 2024-05-14T09:47:51.776 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2087 0.03 MB/sec execute 123 sec latency 1074.904 ms 2024-05-14T09:47:52.776 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2093 0.03 MB/sec execute 124 sec latency 397.956 ms 2024-05-14T09:47:53.776 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2096 0.03 MB/sec execute 125 sec latency 1060.291 ms 2024-05-14T09:47:54.777 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2096 0.03 MB/sec execute 126 sec latency 1193.951 ms 2024-05-14T09:47:55.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:47:55.098 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:47:55.777 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2137 0.03 MB/sec execute 127 sec latency 1258.357 ms 2024-05-14T09:47:56.777 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2140 0.03 MB/sec execute 128 sec latency 502.919 ms 2024-05-14T09:47:57.777 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2145 0.03 MB/sec execute 129 sec latency 1061.938 ms 2024-05-14T09:47:58.777 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2146 0.03 MB/sec execute 130 sec latency 948.311 ms 2024-05-14T09:47:59.777 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2168 0.03 MB/sec execute 131 sec latency 1175.100 ms 2024-05-14T09:48:00.777 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2173 0.03 MB/sec execute 132 sec latency 876.284 ms 2024-05-14T09:48:01.777 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2175 0.03 MB/sec execute 133 sec latency 1362.386 ms 2024-05-14T09:48:02.777 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2176 0.03 MB/sec execute 134 sec latency 1247.045 ms 2024-05-14T09:48:03.778 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2181 0.03 MB/sec execute 135 sec latency 222.943 ms 2024-05-14T09:48:04.778 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2183 0.03 MB/sec execute 136 sec latency 601.370 ms 2024-05-14T09:48:05.778 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2191 0.03 MB/sec execute 137 sec latency 1411.125 ms 2024-05-14T09:48:06.778 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2200 0.03 MB/sec execute 138 sec latency 403.018 ms 2024-05-14T09:48:07.778 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2218 0.03 MB/sec execute 139 sec latency 359.551 ms 2024-05-14T09:48:08.778 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2221 0.03 MB/sec execute 140 sec latency 927.413 ms 2024-05-14T09:48:09.778 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2253 0.03 MB/sec execute 141 sec latency 1128.827 ms 2024-05-14T09:48:10.779 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2273 0.03 MB/sec execute 142 sec latency 209.920 ms 2024-05-14T09:48:11.779 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2292 0.03 MB/sec execute 143 sec latency 729.610 ms 2024-05-14T09:48:12.779 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2297 0.03 MB/sec execute 144 sec latency 1124.810 ms 2024-05-14T09:48:13.779 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2303 0.03 MB/sec execute 145 sec latency 313.139 ms 2024-05-14T09:48:14.779 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2306 0.03 MB/sec execute 146 sec latency 1118.481 ms 2024-05-14T09:48:15.779 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2306 0.03 MB/sec execute 147 sec latency 1149.915 ms 2024-05-14T09:48:16.779 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2307 0.03 MB/sec execute 148 sec latency 1917.219 ms 2024-05-14T09:48:17.779 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2321 0.03 MB/sec execute 149 sec latency 1102.770 ms 2024-05-14T09:48:18.780 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2321 0.03 MB/sec execute 150 sec latency 1130.164 ms 2024-05-14T09:48:19.780 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2324 0.03 MB/sec execute 151 sec latency 1211.415 ms 2024-05-14T09:48:20.780 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2327 0.03 MB/sec execute 152 sec latency 1395.586 ms 2024-05-14T09:48:21.780 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2335 0.03 MB/sec execute 153 sec latency 396.214 ms 2024-05-14T09:48:22.780 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2337 0.03 MB/sec execute 154 sec latency 1129.962 ms 2024-05-14T09:48:23.780 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2340 0.03 MB/sec execute 155 sec latency 673.810 ms 2024-05-14T09:48:24.780 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2350 0.03 MB/sec execute 156 sec latency 1217.874 ms 2024-05-14T09:48:25.230 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:48:25.238 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:48:25.781 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2359 0.03 MB/sec execute 157 sec latency 413.906 ms 2024-05-14T09:48:26.781 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2361 0.03 MB/sec execute 158 sec latency 962.663 ms 2024-05-14T09:48:27.781 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2362 0.03 MB/sec execute 159 sec latency 1186.335 ms 2024-05-14T09:48:28.781 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2364 0.03 MB/sec execute 160 sec latency 1025.982 ms 2024-05-14T09:48:29.781 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2366 0.03 MB/sec execute 161 sec latency 1049.670 ms 2024-05-14T09:48:30.781 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2368 0.03 MB/sec execute 162 sec latency 1328.008 ms 2024-05-14T09:48:31.781 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2371 0.03 MB/sec execute 163 sec latency 744.759 ms 2024-05-14T09:48:32.782 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2383 0.03 MB/sec execute 164 sec latency 1118.875 ms 2024-05-14T09:48:33.782 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2389 0.03 MB/sec execute 165 sec latency 604.618 ms 2024-05-14T09:48:34.782 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2391 0.03 MB/sec execute 166 sec latency 976.771 ms 2024-05-14T09:48:35.782 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2396 0.03 MB/sec execute 167 sec latency 1437.835 ms 2024-05-14T09:48:36.782 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2401 0.03 MB/sec execute 168 sec latency 443.205 ms 2024-05-14T09:48:37.782 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2410 0.03 MB/sec execute 169 sec latency 334.401 ms 2024-05-14T09:48:38.782 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2412 0.03 MB/sec execute 170 sec latency 1116.611 ms 2024-05-14T09:48:39.782 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2428 0.03 MB/sec execute 171 sec latency 303.110 ms 2024-05-14T09:48:40.782 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2431 0.03 MB/sec execute 172 sec latency 629.732 ms 2024-05-14T09:48:41.783 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2432 0.03 MB/sec execute 173 sec latency 1104.953 ms 2024-05-14T09:48:42.784 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2434 0.03 MB/sec execute 174 sec latency 1203.835 ms 2024-05-14T09:48:43.783 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2438 0.03 MB/sec execute 175 sec latency 457.012 ms 2024-05-14T09:48:44.783 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2441 0.03 MB/sec execute 176 sec latency 450.405 ms 2024-05-14T09:48:45.783 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2449 0.03 MB/sec execute 177 sec latency 433.388 ms 2024-05-14T09:48:46.783 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2454 0.03 MB/sec execute 178 sec latency 408.790 ms 2024-05-14T09:48:47.783 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2470 0.03 MB/sec execute 179 sec latency 384.126 ms 2024-05-14T09:48:48.783 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2476 0.03 MB/sec execute 180 sec latency 1039.221 ms 2024-05-14T09:48:49.665 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:09:11.131 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:48:49.784 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2489 0.03 MB/sec execute 181 sec latency 292.614 ms 2024-05-14T09:48:49.868 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:09:11.334 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:48:49.884 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:09:11.360 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:48:49.928 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:09:11.407 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:48:50.010 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:09:11.487 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:48:50.095 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:09:11.574 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:48:50.434 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:09:11.900 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:48:50.571 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:09:12.048 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:48:50.665 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:09:12.144 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:48:50.784 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2492 0.03 MB/sec execute 182 sec latency 670.359 ms 2024-05-14T09:48:51.784 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2494 0.03 MB/sec execute 183 sec latency 1109.989 ms 2024-05-14T09:48:52.784 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2497 0.03 MB/sec execute 184 sec latency 1204.745 ms 2024-05-14T09:48:53.784 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2502 0.03 MB/sec execute 185 sec latency 464.808 ms 2024-05-14T09:48:54.784 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2506 0.03 MB/sec execute 186 sec latency 557.937 ms 2024-05-14T09:48:55.347 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:48:55.356 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:48:55.784 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2549 0.03 MB/sec execute 187 sec latency 1279.076 ms 2024-05-14T09:48:56.784 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2551 0.03 MB/sec execute 188 sec latency 1101.591 ms 2024-05-14T09:48:57.785 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2553 0.03 MB/sec execute 189 sec latency 1018.029 ms 2024-05-14T09:48:58.785 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2559 0.03 MB/sec execute 190 sec latency 378.424 ms 2024-05-14T09:48:59.785 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2560 0.03 MB/sec execute 191 sec latency 933.310 ms 2024-05-14T09:49:00.785 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2571 0.03 MB/sec execute 192 sec latency 1174.650 ms 2024-05-14T09:49:01.785 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2577 0.03 MB/sec execute 193 sec latency 432.876 ms 2024-05-14T09:49:02.785 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2580 0.03 MB/sec execute 194 sec latency 945.641 ms 2024-05-14T09:49:03.785 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2581 0.03 MB/sec execute 195 sec latency 1099.157 ms 2024-05-14T09:49:04.785 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2583 0.03 MB/sec execute 196 sec latency 1156.045 ms 2024-05-14T09:49:05.786 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2596 0.03 MB/sec execute 197 sec latency 418.537 ms 2024-05-14T09:49:06.786 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2600 0.03 MB/sec execute 198 sec latency 743.908 ms 2024-05-14T09:49:07.786 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2602 0.03 MB/sec execute 199 sec latency 1220.600 ms 2024-05-14T09:49:08.786 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2607 0.03 MB/sec execute 200 sec latency 460.895 ms 2024-05-14T09:49:09.786 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2615 0.03 MB/sec execute 201 sec latency 458.398 ms 2024-05-14T09:49:10.786 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2615 0.03 MB/sec execute 202 sec latency 1068.650 ms 2024-05-14T09:49:11.786 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2617 0.03 MB/sec execute 203 sec latency 1269.151 ms 2024-05-14T09:49:12.787 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2618 0.03 MB/sec execute 204 sec latency 1067.129 ms 2024-05-14T09:49:13.787 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2621 0.03 MB/sec execute 205 sec latency 1138.203 ms 2024-05-14T09:49:14.787 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2655 0.03 MB/sec execute 206 sec latency 1045.605 ms 2024-05-14T09:49:15.787 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2718 0.04 MB/sec execute 207 sec latency 574.984 ms 2024-05-14T09:49:16.787 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2720 0.04 MB/sec execute 208 sec latency 1195.375 ms 2024-05-14T09:49:17.787 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2745 0.04 MB/sec execute 209 sec latency 984.172 ms 2024-05-14T09:49:18.787 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2752 0.04 MB/sec execute 210 sec latency 1137.169 ms 2024-05-14T09:49:19.788 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2760 0.04 MB/sec execute 211 sec latency 742.642 ms 2024-05-14T09:49:20.788 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2763 0.04 MB/sec execute 212 sec latency 1195.657 ms 2024-05-14T09:49:21.788 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2773 0.04 MB/sec execute 213 sec latency 343.557 ms 2024-05-14T09:49:22.788 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2780 0.04 MB/sec execute 214 sec latency 435.555 ms 2024-05-14T09:49:23.788 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2780 0.04 MB/sec execute 215 sec latency 1031.760 ms 2024-05-14T09:49:24.788 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2872 0.04 MB/sec execute 216 sec latency 1064.409 ms 2024-05-14T09:49:25.477 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:49:25.487 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:49:25.788 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2872 0.04 MB/sec execute 217 sec latency 1093.254 ms 2024-05-14T09:49:26.789 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2876 0.04 MB/sec execute 218 sec latency 1559.641 ms 2024-05-14T09:49:27.789 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2881 0.04 MB/sec execute 219 sec latency 446.904 ms 2024-05-14T09:49:28.789 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2898 0.04 MB/sec execute 220 sec latency 321.313 ms 2024-05-14T09:49:29.789 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2903 0.04 MB/sec execute 221 sec latency 419.122 ms 2024-05-14T09:49:30.789 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2922 0.05 MB/sec execute 222 sec latency 361.683 ms 2024-05-14T09:49:31.789 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2931 0.05 MB/sec execute 223 sec latency 464.970 ms 2024-05-14T09:49:32.789 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2938 0.05 MB/sec execute 224 sec latency 652.600 ms 2024-05-14T09:49:33.789 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2938 0.05 MB/sec execute 225 sec latency 1077.872 ms 2024-05-14T09:49:34.789 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2966 0.05 MB/sec execute 226 sec latency 1216.945 ms 2024-05-14T09:49:35.790 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2967 0.05 MB/sec execute 227 sec latency 1486.923 ms 2024-05-14T09:49:36.790 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2974 0.05 MB/sec execute 228 sec latency 290.805 ms 2024-05-14T09:49:37.790 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2975 0.05 MB/sec execute 229 sec latency 1089.098 ms 2024-05-14T09:49:38.790 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2978 0.05 MB/sec execute 230 sec latency 403.041 ms 2024-05-14T09:49:39.790 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2989 0.05 MB/sec execute 231 sec latency 365.289 ms 2024-05-14T09:49:40.790 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2994 0.05 MB/sec execute 232 sec latency 443.158 ms 2024-05-14T09:49:41.791 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2995 0.05 MB/sec execute 233 sec latency 1134.038 ms 2024-05-14T09:49:42.791 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3010 0.04 MB/sec execute 234 sec latency 348.350 ms 2024-05-14T09:49:43.791 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3015 0.04 MB/sec execute 235 sec latency 677.378 ms 2024-05-14T09:49:44.794 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3019 0.04 MB/sec execute 236 sec latency 358.763 ms 2024-05-14T09:49:45.791 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3024 0.04 MB/sec execute 237 sec latency 696.620 ms 2024-05-14T09:49:46.791 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3031 0.04 MB/sec execute 238 sec latency 696.844 ms 2024-05-14T09:49:47.791 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3167 0.05 MB/sec execute 239 sec latency 1077.860 ms 2024-05-14T09:49:48.792 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3170 0.05 MB/sec execute 240 sec latency 1084.092 ms 2024-05-14T09:49:49.791 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3176 0.05 MB/sec execute 241 sec latency 329.359 ms 2024-05-14T09:49:50.792 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3188 0.05 MB/sec execute 242 sec latency 502.088 ms 2024-05-14T09:49:51.792 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3189 0.05 MB/sec execute 243 sec latency 1182.588 ms 2024-05-14T09:49:52.792 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3202 0.05 MB/sec execute 244 sec latency 457.361 ms 2024-05-14T09:49:53.792 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3209 0.05 MB/sec execute 245 sec latency 591.529 ms 2024-05-14T09:49:54.792 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3237 0.05 MB/sec execute 246 sec latency 680.435 ms 2024-05-14T09:49:55.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:49:55.624 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:49:55.792 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3266 0.05 MB/sec execute 247 sec latency 211.713 ms 2024-05-14T09:49:56.792 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3268 0.05 MB/sec execute 248 sec latency 1055.311 ms 2024-05-14T09:49:57.792 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3268 0.05 MB/sec execute 249 sec latency 1088.631 ms 2024-05-14T09:49:58.793 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3277 0.05 MB/sec execute 250 sec latency 1155.550 ms 2024-05-14T09:49:59.793 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3280 0.05 MB/sec execute 251 sec latency 956.632 ms 2024-05-14T09:50:00.793 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3281 0.05 MB/sec execute 252 sec latency 1014.134 ms 2024-05-14T09:50:01.793 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3282 0.05 MB/sec execute 253 sec latency 1382.464 ms 2024-05-14T09:50:02.793 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3283 0.05 MB/sec execute 254 sec latency 1153.069 ms 2024-05-14T09:50:03.793 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3285 0.05 MB/sec execute 255 sec latency 1125.434 ms 2024-05-14T09:50:04.793 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3285 0.05 MB/sec execute 256 sec latency 1117.375 ms 2024-05-14T09:50:05.793 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3286 0.05 MB/sec execute 257 sec latency 1218.576 ms 2024-05-14T09:50:06.794 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3287 0.05 MB/sec execute 258 sec latency 1617.250 ms 2024-05-14T09:50:07.794 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3290 0.05 MB/sec execute 259 sec latency 1114.024 ms 2024-05-14T09:50:08.794 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3290 0.05 MB/sec execute 260 sec latency 1138.653 ms 2024-05-14T09:50:09.794 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3291 0.05 MB/sec execute 261 sec latency 1156.787 ms 2024-05-14T09:50:10.794 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3292 0.05 MB/sec execute 262 sec latency 1052.559 ms 2024-05-14T09:50:11.794 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3293 0.05 MB/sec execute 263 sec latency 1102.048 ms 2024-05-14T09:50:12.795 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3294 0.05 MB/sec execute 264 sec latency 1132.546 ms 2024-05-14T09:50:13.794 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3295 0.05 MB/sec execute 265 sec latency 1136.024 ms 2024-05-14T09:50:14.795 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3298 0.05 MB/sec execute 266 sec latency 1080.161 ms 2024-05-14T09:50:15.795 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3299 0.05 MB/sec execute 267 sec latency 1243.221 ms 2024-05-14T09:50:16.795 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3299 0.05 MB/sec execute 268 sec latency 1041.608 ms 2024-05-14T09:50:17.795 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3303 0.05 MB/sec execute 269 sec latency 1060.492 ms 2024-05-14T09:50:18.795 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3306 0.05 MB/sec execute 270 sec latency 1107.560 ms 2024-05-14T09:50:19.795 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3307 0.05 MB/sec execute 271 sec latency 1011.101 ms 2024-05-14T09:50:20.795 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3308 0.05 MB/sec execute 272 sec latency 1119.538 ms 2024-05-14T09:50:21.796 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3309 0.05 MB/sec execute 273 sec latency 1095.738 ms 2024-05-14T09:50:22.796 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3310 0.05 MB/sec execute 274 sec latency 1149.944 ms 2024-05-14T09:50:23.796 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3311 0.04 MB/sec execute 275 sec latency 1106.501 ms 2024-05-14T09:50:24.796 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3311 0.04 MB/sec execute 276 sec latency 1054.365 ms 2024-05-14T09:50:25.746 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:50:25.754 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:50:25.796 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3312 0.04 MB/sec execute 277 sec latency 1133.733 ms 2024-05-14T09:50:26.796 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3313 0.04 MB/sec execute 278 sec latency 1073.134 ms 2024-05-14T09:50:27.796 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3314 0.04 MB/sec execute 279 sec latency 1051.851 ms 2024-05-14T09:50:28.796 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3316 0.04 MB/sec execute 280 sec latency 1073.973 ms 2024-05-14T09:50:29.796 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3317 0.04 MB/sec execute 281 sec latency 1102.219 ms 2024-05-14T09:50:30.797 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3318 0.04 MB/sec execute 282 sec latency 1129.569 ms 2024-05-14T09:50:31.797 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3319 0.04 MB/sec execute 283 sec latency 1137.189 ms 2024-05-14T09:50:32.797 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3320 0.04 MB/sec execute 284 sec latency 1068.126 ms 2024-05-14T09:50:33.797 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3322 0.04 MB/sec execute 285 sec latency 1077.713 ms 2024-05-14T09:50:34.797 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3323 0.04 MB/sec execute 286 sec latency 1105.078 ms 2024-05-14T09:50:35.797 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3323 0.04 MB/sec execute 287 sec latency 1005.410 ms 2024-05-14T09:50:36.797 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3324 0.04 MB/sec execute 288 sec latency 1106.522 ms 2024-05-14T09:50:37.797 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3325 0.04 MB/sec execute 289 sec latency 1057.262 ms 2024-05-14T09:50:38.798 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3326 0.04 MB/sec execute 290 sec latency 1073.676 ms 2024-05-14T09:50:39.798 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3327 0.04 MB/sec execute 291 sec latency 1068.029 ms 2024-05-14T09:50:40.798 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3330 0.04 MB/sec execute 292 sec latency 1120.968 ms 2024-05-14T09:50:41.798 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3331 0.04 MB/sec execute 293 sec latency 1063.806 ms 2024-05-14T09:50:42.798 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3332 0.04 MB/sec execute 294 sec latency 1110.450 ms 2024-05-14T09:50:43.798 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3333 0.04 MB/sec execute 295 sec latency 1130.062 ms 2024-05-14T09:50:44.799 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3333 0.04 MB/sec execute 296 sec latency 1089.240 ms 2024-05-14T09:50:45.799 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3334 0.04 MB/sec execute 297 sec latency 1090.717 ms 2024-05-14T09:50:46.799 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3335 0.04 MB/sec execute 298 sec latency 1153.159 ms 2024-05-14T09:50:47.799 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3336 0.04 MB/sec execute 299 sec latency 1122.019 ms 2024-05-14T09:50:48.799 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3337 0.04 MB/sec execute 300 sec latency 1131.626 ms 2024-05-14T09:50:49.799 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3342 0.04 MB/sec execute 301 sec latency 1061.645 ms 2024-05-14T09:50:50.799 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3352 0.04 MB/sec execute 302 sec latency 325.072 ms 2024-05-14T09:50:51.800 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3360 0.04 MB/sec execute 303 sec latency 460.708 ms 2024-05-14T09:50:52.800 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3365 0.04 MB/sec execute 304 sec latency 369.854 ms 2024-05-14T09:50:53.800 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3373 0.04 MB/sec execute 305 sec latency 431.384 ms 2024-05-14T09:50:54.800 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3378 0.04 MB/sec execute 306 sec latency 394.628 ms 2024-05-14T09:50:55.800 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3391 0.04 MB/sec execute 307 sec latency 403.140 ms 2024-05-14T09:50:55.883 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:50:55.891 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:50:56.800 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3393 0.04 MB/sec execute 308 sec latency 1155.791 ms 2024-05-14T09:50:57.800 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3393 0.04 MB/sec execute 309 sec latency 1089.750 ms 2024-05-14T09:50:58.800 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3395 0.04 MB/sec execute 310 sec latency 1233.911 ms 2024-05-14T09:50:59.801 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3398 0.04 MB/sec execute 311 sec latency 1174.086 ms 2024-05-14T09:51:00.801 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3410 0.04 MB/sec execute 312 sec latency 1101.328 ms 2024-05-14T09:51:01.801 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3496 0.05 MB/sec execute 313 sec latency 352.534 ms 2024-05-14T09:51:02.801 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3507 0.05 MB/sec execute 314 sec latency 307.736 ms 2024-05-14T09:51:03.801 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3516 0.05 MB/sec execute 315 sec latency 314.066 ms 2024-05-14T09:51:04.801 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3531 0.05 MB/sec execute 316 sec latency 271.133 ms 2024-05-14T09:51:05.801 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3531 0.05 MB/sec execute 317 sec latency 1210.034 ms 2024-05-14T09:51:06.801 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3540 0.05 MB/sec execute 318 sec latency 1427.326 ms 2024-05-14T09:51:07.802 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3550 0.05 MB/sec execute 319 sec latency 445.768 ms 2024-05-14T09:51:08.802 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3557 0.05 MB/sec execute 320 sec latency 360.098 ms 2024-05-14T09:51:09.802 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3557 0.05 MB/sec execute 321 sec latency 1247.128 ms 2024-05-14T09:51:10.802 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3560 0.05 MB/sec execute 322 sec latency 1264.083 ms 2024-05-14T09:51:11.802 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3572 0.05 MB/sec execute 323 sec latency 337.366 ms 2024-05-14T09:51:12.802 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3573 0.05 MB/sec execute 324 sec latency 736.706 ms 2024-05-14T09:51:13.802 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3582 0.05 MB/sec execute 325 sec latency 1203.175 ms 2024-05-14T09:51:14.803 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3588 0.05 MB/sec execute 326 sec latency 460.386 ms 2024-05-14T09:51:15.803 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3617 0.05 MB/sec execute 327 sec latency 1027.435 ms 2024-05-14T09:51:16.803 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3627 0.05 MB/sec execute 328 sec latency 401.390 ms 2024-05-14T09:51:17.803 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3633 0.05 MB/sec execute 329 sec latency 484.369 ms 2024-05-14T09:51:18.258 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:11:39.724 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:51:18.290 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:11:39.756 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:51:18.327 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:11:39.803 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:51:18.327 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:11:39.806 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:51:18.334 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:11:39.811 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:51:18.341 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:11:39.820 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:51:18.466 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:11:39.943 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:51:18.545 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:11:40.024 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:51:18.646 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:11:40.112 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:51:18.803 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3642 0.05 MB/sec execute 330 sec latency 436.720 ms 2024-05-14T09:51:19.803 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3642 0.05 MB/sec execute 331 sec latency 1001.495 ms 2024-05-14T09:51:20.803 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3650 0.05 MB/sec execute 332 sec latency 1032.742 ms 2024-05-14T09:51:21.803 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3666 0.05 MB/sec execute 333 sec latency 398.470 ms 2024-05-14T09:51:22.804 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3672 0.05 MB/sec execute 334 sec latency 423.889 ms 2024-05-14T09:51:23.804 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3673 0.05 MB/sec execute 335 sec latency 1211.719 ms 2024-05-14T09:51:24.804 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3677 0.05 MB/sec execute 336 sec latency 551.165 ms 2024-05-14T09:51:25.804 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3686 0.05 MB/sec execute 337 sec latency 429.916 ms 2024-05-14T09:51:26.102 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:51:26.110 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:51:26.804 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3689 0.05 MB/sec execute 338 sec latency 1183.837 ms 2024-05-14T09:51:27.804 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3696 0.05 MB/sec execute 339 sec latency 436.561 ms 2024-05-14T09:51:28.804 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3702 0.05 MB/sec execute 340 sec latency 491.677 ms 2024-05-14T09:51:29.805 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3709 0.05 MB/sec execute 341 sec latency 449.160 ms 2024-05-14T09:51:30.805 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3720 0.05 MB/sec execute 342 sec latency 346.847 ms 2024-05-14T09:51:31.805 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3738 0.05 MB/sec execute 343 sec latency 219.873 ms 2024-05-14T09:51:32.805 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3758 0.05 MB/sec execute 344 sec latency 798.855 ms 2024-05-14T09:51:33.805 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3767 0.05 MB/sec execute 345 sec latency 1239.722 ms 2024-05-14T09:51:34.805 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3771 0.05 MB/sec execute 346 sec latency 601.211 ms 2024-05-14T09:51:35.805 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3776 0.05 MB/sec execute 347 sec latency 417.888 ms 2024-05-14T09:51:36.805 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3781 0.05 MB/sec execute 348 sec latency 446.716 ms 2024-05-14T09:51:37.806 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3785 0.05 MB/sec execute 349 sec latency 505.106 ms 2024-05-14T09:51:38.806 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3790 0.05 MB/sec execute 350 sec latency 561.281 ms 2024-05-14T09:51:39.806 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3791 0.05 MB/sec execute 351 sec latency 694.384 ms 2024-05-14T09:51:40.806 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3795 0.05 MB/sec execute 352 sec latency 778.017 ms 2024-05-14T09:51:41.806 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3797 0.05 MB/sec execute 353 sec latency 568.351 ms 2024-05-14T09:51:42.807 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3804 0.05 MB/sec execute 354 sec latency 594.020 ms 2024-05-14T09:51:43.806 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3808 0.05 MB/sec execute 355 sec latency 413.899 ms 2024-05-14T09:51:44.806 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3812 0.05 MB/sec execute 356 sec latency 459.246 ms 2024-05-14T09:51:45.807 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3816 0.05 MB/sec execute 357 sec latency 523.155 ms 2024-05-14T09:51:46.807 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3821 0.05 MB/sec execute 358 sec latency 626.556 ms 2024-05-14T09:51:47.807 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3828 0.05 MB/sec execute 359 sec latency 348.406 ms 2024-05-14T09:51:48.807 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3832 0.05 MB/sec execute 360 sec latency 451.795 ms 2024-05-14T09:51:49.807 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3837 0.05 MB/sec execute 361 sec latency 401.814 ms 2024-05-14T09:51:50.807 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3843 0.05 MB/sec execute 362 sec latency 329.656 ms 2024-05-14T09:51:51.807 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3847 0.05 MB/sec execute 363 sec latency 442.266 ms 2024-05-14T09:51:52.807 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3853 0.05 MB/sec execute 364 sec latency 376.567 ms 2024-05-14T09:51:53.808 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3859 0.05 MB/sec execute 365 sec latency 326.343 ms 2024-05-14T09:51:54.808 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3863 0.05 MB/sec execute 366 sec latency 458.189 ms 2024-05-14T09:51:55.808 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3868 0.05 MB/sec execute 367 sec latency 391.119 ms 2024-05-14T09:51:56.274 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:51:56.283 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:51:56.808 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3870 0.05 MB/sec execute 368 sec latency 757.790 ms 2024-05-14T09:51:57.808 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3874 0.05 MB/sec execute 369 sec latency 1030.738 ms 2024-05-14T09:51:58.808 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3876 0.05 MB/sec execute 370 sec latency 837.949 ms 2024-05-14T09:51:59.808 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3880 0.05 MB/sec execute 371 sec latency 1142.426 ms 2024-05-14T09:52:00.809 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3885 0.05 MB/sec execute 372 sec latency 452.481 ms 2024-05-14T09:52:01.809 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3896 0.05 MB/sec execute 373 sec latency 572.818 ms 2024-05-14T09:52:02.809 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3898 0.05 MB/sec execute 374 sec latency 1064.102 ms 2024-05-14T09:52:03.809 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3899 0.05 MB/sec execute 375 sec latency 1095.795 ms 2024-05-14T09:52:04.809 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3905 0.05 MB/sec execute 376 sec latency 202.630 ms 2024-05-14T09:52:05.809 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3914 0.05 MB/sec execute 377 sec latency 626.848 ms 2024-05-14T09:52:06.809 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3915 0.05 MB/sec execute 378 sec latency 1240.025 ms 2024-05-14T09:52:07.809 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3922 0.04 MB/sec execute 379 sec latency 477.830 ms 2024-05-14T09:52:08.809 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3927 0.04 MB/sec execute 380 sec latency 408.172 ms 2024-05-14T09:52:09.810 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3932 0.04 MB/sec execute 381 sec latency 466.143 ms 2024-05-14T09:52:10.810 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3936 0.04 MB/sec execute 382 sec latency 595.329 ms 2024-05-14T09:52:11.810 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3938 0.04 MB/sec execute 383 sec latency 699.697 ms 2024-05-14T09:52:12.810 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3942 0.04 MB/sec execute 384 sec latency 655.783 ms 2024-05-14T09:52:13.810 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3944 0.04 MB/sec execute 385 sec latency 628.903 ms 2024-05-14T09:52:14.810 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3949 0.04 MB/sec execute 386 sec latency 647.261 ms 2024-05-14T09:52:15.810 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3953 0.04 MB/sec execute 387 sec latency 397.565 ms 2024-05-14T09:52:16.811 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3959 0.04 MB/sec execute 388 sec latency 395.526 ms 2024-05-14T09:52:17.811 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3963 0.04 MB/sec execute 389 sec latency 434.120 ms 2024-05-14T09:52:18.811 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3969 0.04 MB/sec execute 390 sec latency 450.401 ms 2024-05-14T09:52:19.811 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3975 0.04 MB/sec execute 391 sec latency 359.417 ms 2024-05-14T09:52:20.812 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3979 0.04 MB/sec execute 392 sec latency 460.253 ms 2024-05-14T09:52:21.811 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3984 0.04 MB/sec execute 393 sec latency 444.939 ms 2024-05-14T09:52:22.811 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3990 0.04 MB/sec execute 394 sec latency 341.067 ms 2024-05-14T09:52:23.812 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3994 0.04 MB/sec execute 395 sec latency 482.581 ms 2024-05-14T09:52:24.812 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3999 0.04 MB/sec execute 396 sec latency 353.919 ms 2024-05-14T09:52:25.812 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4005 0.04 MB/sec execute 397 sec latency 423.248 ms 2024-05-14T09:52:26.404 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:52:26.414 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:52:26.812 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4009 0.04 MB/sec execute 398 sec latency 448.349 ms 2024-05-14T09:52:27.812 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4014 0.04 MB/sec execute 399 sec latency 382.731 ms 2024-05-14T09:52:28.812 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4020 0.04 MB/sec execute 400 sec latency 438.064 ms 2024-05-14T09:52:29.812 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4026 0.04 MB/sec execute 401 sec latency 352.248 ms 2024-05-14T09:52:30.812 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4027 0.04 MB/sec execute 402 sec latency 809.765 ms 2024-05-14T09:52:31.813 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4031 0.04 MB/sec execute 403 sec latency 1202.251 ms 2024-05-14T09:52:32.813 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4032 0.04 MB/sec execute 404 sec latency 916.456 ms 2024-05-14T09:52:33.813 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4035 0.04 MB/sec execute 405 sec latency 1150.936 ms 2024-05-14T09:52:34.813 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4036 0.04 MB/sec execute 406 sec latency 1107.872 ms 2024-05-14T09:52:35.813 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4041 0.04 MB/sec execute 407 sec latency 207.949 ms 2024-05-14T09:52:36.813 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4047 0.04 MB/sec execute 408 sec latency 356.254 ms 2024-05-14T09:52:37.813 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4049 0.04 MB/sec execute 409 sec latency 1123.414 ms 2024-05-14T09:52:38.813 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4058 0.04 MB/sec execute 410 sec latency 757.563 ms 2024-05-14T09:52:39.814 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4060 0.04 MB/sec execute 411 sec latency 1120.832 ms 2024-05-14T09:52:40.814 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4065 0.04 MB/sec execute 412 sec latency 609.601 ms 2024-05-14T09:52:41.814 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4071 0.04 MB/sec execute 413 sec latency 215.409 ms 2024-05-14T09:52:42.814 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4071 0.04 MB/sec execute 414 sec latency 1091.823 ms 2024-05-14T09:52:43.814 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4082 0.04 MB/sec execute 415 sec latency 1092.492 ms 2024-05-14T09:52:44.814 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4090 0.04 MB/sec execute 416 sec latency 1052.449 ms 2024-05-14T09:52:45.815 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4096 0.04 MB/sec execute 417 sec latency 393.338 ms 2024-05-14T09:52:46.815 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4105 0.04 MB/sec execute 418 sec latency 381.969 ms 2024-05-14T09:52:47.815 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4113 0.04 MB/sec execute 419 sec latency 391.802 ms 2024-05-14T09:52:48.815 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4120 0.04 MB/sec execute 420 sec latency 473.406 ms 2024-05-14T09:52:49.815 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4130 0.04 MB/sec execute 421 sec latency 221.655 ms 2024-05-14T09:52:50.815 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4138 0.04 MB/sec execute 422 sec latency 286.884 ms 2024-05-14T09:52:51.815 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4145 0.04 MB/sec execute 423 sec latency 699.692 ms 2024-05-14T09:52:52.815 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4153 0.04 MB/sec execute 424 sec latency 289.352 ms 2024-05-14T09:52:53.816 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4157 0.04 MB/sec execute 425 sec latency 600.803 ms 2024-05-14T09:52:54.816 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4165 0.04 MB/sec execute 426 sec latency 418.023 ms 2024-05-14T09:52:55.816 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4172 0.04 MB/sec execute 427 sec latency 351.696 ms 2024-05-14T09:52:56.684 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:52:56.692 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:52:56.816 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4173 0.04 MB/sec execute 428 sec latency 1262.588 ms 2024-05-14T09:52:57.816 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4176 0.04 MB/sec execute 429 sec latency 1008.706 ms 2024-05-14T09:52:58.816 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4176 0.04 MB/sec execute 430 sec latency 1050.072 ms 2024-05-14T09:52:59.816 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4181 0.04 MB/sec execute 431 sec latency 1189.349 ms 2024-05-14T09:53:00.818 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4186 0.04 MB/sec execute 432 sec latency 1156.132 ms 2024-05-14T09:53:01.817 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4186 0.04 MB/sec execute 433 sec latency 1054.418 ms 2024-05-14T09:53:02.817 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4216 0.04 MB/sec execute 434 sec latency 1097.019 ms 2024-05-14T09:53:03.817 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4217 0.04 MB/sec execute 435 sec latency 1133.146 ms 2024-05-14T09:53:04.817 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4221 0.04 MB/sec execute 436 sec latency 1130.658 ms 2024-05-14T09:53:05.817 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4225 0.04 MB/sec execute 437 sec latency 542.278 ms 2024-05-14T09:53:06.817 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4226 0.04 MB/sec execute 438 sec latency 1316.447 ms 2024-05-14T09:53:07.817 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4241 0.04 MB/sec execute 439 sec latency 339.163 ms 2024-05-14T09:53:08.818 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4252 0.04 MB/sec execute 440 sec latency 370.330 ms 2024-05-14T09:53:09.818 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4254 0.04 MB/sec execute 441 sec latency 1136.121 ms 2024-05-14T09:53:10.818 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4255 0.04 MB/sec execute 442 sec latency 1211.482 ms 2024-05-14T09:53:11.818 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4276 0.04 MB/sec execute 443 sec latency 436.385 ms 2024-05-14T09:53:12.818 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4281 0.04 MB/sec execute 444 sec latency 686.552 ms 2024-05-14T09:53:13.818 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4292 0.04 MB/sec execute 445 sec latency 693.997 ms 2024-05-14T09:53:14.818 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4314 0.04 MB/sec execute 446 sec latency 191.231 ms 2024-05-14T09:53:15.818 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4315 0.04 MB/sec execute 447 sec latency 815.002 ms 2024-05-14T09:53:16.818 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4317 0.04 MB/sec execute 448 sec latency 1257.515 ms 2024-05-14T09:53:17.819 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4330 0.04 MB/sec execute 449 sec latency 1183.876 ms 2024-05-14T09:53:18.819 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4345 0.04 MB/sec execute 450 sec latency 469.167 ms 2024-05-14T09:53:19.819 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4350 0.04 MB/sec execute 451 sec latency 732.005 ms 2024-05-14T09:53:20.819 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4360 0.04 MB/sec execute 452 sec latency 427.269 ms 2024-05-14T09:53:21.819 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4379 0.04 MB/sec execute 453 sec latency 340.913 ms 2024-05-14T09:53:22.819 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4383 0.04 MB/sec execute 454 sec latency 694.843 ms 2024-05-14T09:53:23.819 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4384 0.04 MB/sec execute 455 sec latency 1065.360 ms 2024-05-14T09:53:24.820 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4387 0.04 MB/sec execute 456 sec latency 1076.341 ms 2024-05-14T09:53:25.820 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4388 0.04 MB/sec execute 457 sec latency 898.732 ms 2024-05-14T09:53:26.814 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:53:26.834 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:53:26.835 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4393 0.04 MB/sec execute 458 sec latency 1096.556 ms 2024-05-14T09:53:27.820 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4423 0.04 MB/sec execute 459 sec latency 1049.502 ms 2024-05-14T09:53:28.820 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4424 0.04 MB/sec execute 460 sec latency 1092.298 ms 2024-05-14T09:53:29.820 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4424 0.04 MB/sec execute 461 sec latency 1211.082 ms 2024-05-14T09:53:30.820 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4432 0.04 MB/sec execute 462 sec latency 1222.989 ms 2024-05-14T09:53:31.820 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4432 0.04 MB/sec execute 463 sec latency 1168.963 ms 2024-05-14T09:53:32.821 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4434 0.04 MB/sec execute 464 sec latency 1522.567 ms 2024-05-14T09:53:33.821 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4450 0.04 MB/sec execute 465 sec latency 382.843 ms 2024-05-14T09:53:34.821 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4458 0.04 MB/sec execute 466 sec latency 1127.049 ms 2024-05-14T09:53:35.821 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4472 0.04 MB/sec execute 467 sec latency 471.605 ms 2024-05-14T09:53:36.821 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4474 0.04 MB/sec execute 468 sec latency 614.079 ms 2024-05-14T09:53:37.821 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4491 0.04 MB/sec execute 469 sec latency 285.132 ms 2024-05-14T09:53:38.821 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4497 0.04 MB/sec execute 470 sec latency 571.126 ms 2024-05-14T09:53:39.821 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4498 0.04 MB/sec execute 471 sec latency 1063.134 ms 2024-05-14T09:53:40.822 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4499 0.04 MB/sec execute 472 sec latency 1028.642 ms 2024-05-14T09:53:41.822 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4500 0.04 MB/sec execute 473 sec latency 921.634 ms 2024-05-14T09:53:42.822 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4501 0.04 MB/sec execute 474 sec latency 989.580 ms 2024-05-14T09:53:43.822 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4506 0.04 MB/sec execute 475 sec latency 1075.571 ms 2024-05-14T09:53:44.822 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4511 0.04 MB/sec execute 476 sec latency 1192.817 ms 2024-05-14T09:53:45.822 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4511 0.04 MB/sec execute 477 sec latency 1000.893 ms 2024-05-14T09:53:46.822 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4535 0.04 MB/sec execute 478 sec latency 1102.569 ms 2024-05-14T09:53:47.822 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4539 0.04 MB/sec execute 479 sec latency 724.893 ms 2024-05-14T09:53:48.822 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4549 0.04 MB/sec execute 480 sec latency 421.241 ms 2024-05-14T09:53:49.823 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4563 0.04 MB/sec execute 481 sec latency 299.461 ms 2024-05-14T09:53:50.823 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4567 0.04 MB/sec execute 482 sec latency 1022.741 ms 2024-05-14T09:53:51.823 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4596 0.04 MB/sec execute 483 sec latency 357.086 ms 2024-05-14T09:53:52.823 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4597 0.04 MB/sec execute 484 sec latency 1174.686 ms 2024-05-14T09:53:53.823 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4602 0.04 MB/sec execute 485 sec latency 442.439 ms 2024-05-14T09:53:54.823 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4606 0.04 MB/sec execute 486 sec latency 1151.613 ms 2024-05-14T09:53:55.823 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4614 0.04 MB/sec execute 487 sec latency 511.715 ms 2024-05-14T09:53:56.824 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4615 0.04 MB/sec execute 488 sec latency 1207.058 ms 2024-05-14T09:53:56.969 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:53:56.977 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:53:57.824 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4616 0.04 MB/sec execute 489 sec latency 1264.005 ms 2024-05-14T09:53:58.824 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4616 0.04 MB/sec execute 490 sec latency 1041.060 ms 2024-05-14T09:53:59.824 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4627 0.04 MB/sec execute 491 sec latency 1146.960 ms 2024-05-14T09:54:00.824 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4631 0.04 MB/sec execute 492 sec latency 462.088 ms 2024-05-14T09:54:01.824 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4650 0.04 MB/sec execute 493 sec latency 454.748 ms 2024-05-14T09:54:02.824 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4656 0.04 MB/sec execute 494 sec latency 435.150 ms 2024-05-14T09:54:03.824 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4659 0.04 MB/sec execute 495 sec latency 1087.269 ms 2024-05-14T09:54:04.825 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4668 0.04 MB/sec execute 496 sec latency 343.996 ms 2024-05-14T09:54:05.825 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4668 0.04 MB/sec execute 497 sec latency 1223.677 ms 2024-05-14T09:54:06.825 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4681 0.04 MB/sec execute 498 sec latency 1447.219 ms 2024-05-14T09:54:07.825 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4683 0.04 MB/sec execute 499 sec latency 1126.589 ms 2024-05-14T09:54:08.825 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4695 0.04 MB/sec execute 500 sec latency 340.786 ms 2024-05-14T09:54:09.825 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4705 0.04 MB/sec execute 501 sec latency 417.074 ms 2024-05-14T09:54:10.825 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4716 0.04 MB/sec execute 502 sec latency 647.165 ms 2024-05-14T09:54:11.825 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4724 0.04 MB/sec execute 503 sec latency 472.412 ms 2024-05-14T09:54:12.826 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4727 0.04 MB/sec execute 504 sec latency 1131.524 ms 2024-05-14T09:54:13.826 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4734 0.04 MB/sec execute 505 sec latency 598.888 ms 2024-05-14T09:54:14.826 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4735 0.04 MB/sec execute 506 sec latency 1137.275 ms 2024-05-14T09:54:15.826 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4736 0.04 MB/sec execute 507 sec latency 1260.043 ms 2024-05-14T09:54:16.826 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4736 0.04 MB/sec execute 508 sec latency 1201.967 ms 2024-05-14T09:54:17.826 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4740 0.04 MB/sec execute 509 sec latency 1528.386 ms 2024-05-14T09:54:18.828 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4746 0.04 MB/sec execute 510 sec latency 416.081 ms 2024-05-14T09:54:19.826 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4763 0.04 MB/sec execute 511 sec latency 420.872 ms 2024-05-14T09:54:20.827 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4770 0.04 MB/sec execute 512 sec latency 415.128 ms 2024-05-14T09:54:21.827 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4772 0.04 MB/sec execute 513 sec latency 1235.037 ms 2024-05-14T09:54:22.827 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4781 0.04 MB/sec execute 514 sec latency 371.687 ms 2024-05-14T09:54:23.827 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4797 0.04 MB/sec execute 515 sec latency 402.771 ms 2024-05-14T09:54:24.827 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4810 0.04 MB/sec execute 516 sec latency 409.907 ms 2024-05-14T09:54:25.827 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4814 0.04 MB/sec execute 517 sec latency 701.115 ms 2024-05-14T09:54:26.827 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4814 0.04 MB/sec execute 518 sec latency 1397.890 ms 2024-05-14T09:54:27.126 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:54:27.134 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:54:27.828 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4831 0.04 MB/sec execute 519 sec latency 1462.961 ms 2024-05-14T09:54:28.828 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4844 0.04 MB/sec execute 520 sec latency 258.989 ms 2024-05-14T09:54:29.828 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4846 0.04 MB/sec execute 521 sec latency 1148.909 ms 2024-05-14T09:54:30.828 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4846 0.04 MB/sec execute 522 sec latency 1060.540 ms 2024-05-14T09:54:31.828 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4847 0.04 MB/sec execute 523 sec latency 1118.606 ms 2024-05-14T09:54:32.828 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4850 0.04 MB/sec execute 524 sec latency 1347.030 ms 2024-05-14T09:54:33.828 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4884 0.04 MB/sec execute 525 sec latency 1124.346 ms 2024-05-14T09:54:34.829 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4942 0.04 MB/sec execute 526 sec latency 896.500 ms 2024-05-14T09:54:35.829 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4943 0.04 MB/sec execute 527 sec latency 1141.687 ms 2024-05-14T09:54:36.829 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4945 0.04 MB/sec execute 528 sec latency 1346.667 ms 2024-05-14T09:54:37.829 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4947 0.04 MB/sec execute 529 sec latency 790.567 ms 2024-05-14T09:54:38.829 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4951 0.04 MB/sec execute 530 sec latency 1111.858 ms 2024-05-14T09:54:39.829 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4955 0.04 MB/sec execute 531 sec latency 1099.779 ms 2024-05-14T09:54:40.829 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4962 0.04 MB/sec execute 532 sec latency 306.976 ms 2024-05-14T09:54:41.829 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4963 0.04 MB/sec execute 533 sec latency 925.463 ms 2024-05-14T09:54:42.830 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4976 0.04 MB/sec execute 534 sec latency 1100.251 ms 2024-05-14T09:54:43.830 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4983 0.04 MB/sec execute 535 sec latency 832.171 ms 2024-05-14T09:54:44.830 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4985 0.04 MB/sec execute 536 sec latency 1116.386 ms 2024-05-14T09:54:45.830 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5000 0.04 MB/sec execute 537 sec latency 399.047 ms 2024-05-14T09:54:46.830 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5012 0.04 MB/sec execute 538 sec latency 412.560 ms 2024-05-14T09:54:47.830 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5014 0.04 MB/sec execute 539 sec latency 804.938 ms 2024-05-14T09:54:48.830 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5027 0.04 MB/sec execute 540 sec latency 1105.031 ms 2024-05-14T09:54:49.840 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5031 0.04 MB/sec execute 541 sec latency 346.989 ms 2024-05-14T09:54:50.831 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5032 0.04 MB/sec execute 542 sec latency 990.303 ms 2024-05-14T09:54:51.831 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5051 0.04 MB/sec execute 543 sec latency 1218.139 ms 2024-05-14T09:54:52.831 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5052 0.04 MB/sec execute 544 sec latency 1008.679 ms 2024-05-14T09:54:53.831 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5055 0.04 MB/sec execute 545 sec latency 382.220 ms 2024-05-14T09:54:54.831 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5056 0.04 MB/sec execute 546 sec latency 881.447 ms 2024-05-14T09:54:55.831 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5065 0.04 MB/sec execute 547 sec latency 1128.848 ms 2024-05-14T09:54:56.831 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5071 0.04 MB/sec execute 548 sec latency 555.727 ms 2024-05-14T09:54:57.261 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:54:57.270 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:54:57.831 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5089 0.04 MB/sec execute 549 sec latency 443.043 ms 2024-05-14T09:54:58.832 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5092 0.04 MB/sec execute 550 sec latency 458.432 ms 2024-05-14T09:54:59.832 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5093 0.04 MB/sec execute 551 sec latency 1173.346 ms 2024-05-14T09:55:00.832 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5096 0.04 MB/sec execute 552 sec latency 864.470 ms 2024-05-14T09:55:01.832 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5117 0.04 MB/sec execute 553 sec latency 1151.428 ms 2024-05-14T09:55:02.832 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5120 0.04 MB/sec execute 554 sec latency 464.387 ms 2024-05-14T09:55:03.832 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5123 0.04 MB/sec execute 555 sec latency 1124.193 ms 2024-05-14T09:55:04.832 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5135 0.04 MB/sec execute 556 sec latency 264.000 ms 2024-05-14T09:55:05.832 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5147 0.04 MB/sec execute 557 sec latency 178.959 ms 2024-05-14T09:55:06.832 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5152 0.04 MB/sec execute 558 sec latency 380.503 ms 2024-05-14T09:55:07.833 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5154 0.04 MB/sec execute 559 sec latency 480.100 ms 2024-05-14T09:55:08.833 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5168 0.04 MB/sec execute 560 sec latency 1043.747 ms 2024-05-14T09:55:09.833 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5171 0.04 MB/sec execute 561 sec latency 636.361 ms 2024-05-14T09:55:10.833 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5175 0.04 MB/sec execute 562 sec latency 1030.406 ms 2024-05-14T09:55:11.833 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5175 0.04 MB/sec execute 563 sec latency 1075.703 ms 2024-05-14T09:55:12.833 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5181 0.04 MB/sec execute 564 sec latency 1142.833 ms 2024-05-14T09:55:13.833 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5182 0.04 MB/sec execute 565 sec latency 792.418 ms 2024-05-14T09:55:14.834 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5199 0.04 MB/sec execute 566 sec latency 1131.055 ms 2024-05-14T09:55:15.834 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5206 0.04 MB/sec execute 567 sec latency 842.263 ms 2024-05-14T09:55:16.834 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5208 0.04 MB/sec execute 568 sec latency 1360.658 ms 2024-05-14T09:55:17.834 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5209 0.04 MB/sec execute 569 sec latency 968.763 ms 2024-05-14T09:55:18.834 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5220 0.04 MB/sec execute 570 sec latency 1020.497 ms 2024-05-14T09:55:19.835 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5245 0.04 MB/sec execute 571 sec latency 472.279 ms 2024-05-14T09:55:20.834 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5252 0.04 MB/sec execute 572 sec latency 745.777 ms 2024-05-14T09:55:21.834 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5261 0.04 MB/sec execute 573 sec latency 550.891 ms 2024-05-14T09:55:22.834 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5266 0.04 MB/sec execute 574 sec latency 592.527 ms 2024-05-14T09:55:23.835 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5266 0.04 MB/sec execute 575 sec latency 1042.099 ms 2024-05-14T09:55:24.835 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5272 0.04 MB/sec execute 576 sec latency 1078.273 ms 2024-05-14T09:55:25.835 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5276 0.04 MB/sec execute 577 sec latency 1481.666 ms 2024-05-14T09:55:26.835 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5284 0.04 MB/sec execute 578 sec latency 410.758 ms 2024-05-14T09:55:27.257 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:15:48.722 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:55:27.378 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:55:27.388 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:55:27.388 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:15:48.852 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:55:27.522 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:15:48.998 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:55:27.527 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:15:49.004 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:55:27.528 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:15:48.994 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:55:27.530 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:15:49.009 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:55:27.535 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:15:49.014 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:55:27.648 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:15:49.124 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:55:27.670 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:15:49.149 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:55:27.835 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5298 0.04 MB/sec execute 579 sec latency 174.658 ms 2024-05-14T09:55:28.835 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5334 0.04 MB/sec execute 580 sec latency 183.872 ms 2024-05-14T09:55:29.836 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5337 0.04 MB/sec execute 581 sec latency 568.759 ms 2024-05-14T09:55:30.836 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5342 0.04 MB/sec execute 582 sec latency 1063.651 ms 2024-05-14T09:55:31.836 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5366 0.04 MB/sec execute 583 sec latency 135.730 ms 2024-05-14T09:55:32.836 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5370 0.04 MB/sec execute 584 sec latency 296.059 ms 2024-05-14T09:55:33.836 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5371 0.04 MB/sec execute 585 sec latency 877.107 ms 2024-05-14T09:55:34.836 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5385 0.04 MB/sec execute 586 sec latency 1239.129 ms 2024-05-14T09:55:35.836 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5387 0.04 MB/sec execute 587 sec latency 617.069 ms 2024-05-14T09:55:36.836 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5388 0.04 MB/sec execute 588 sec latency 1536.234 ms 2024-05-14T09:55:37.836 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5391 0.04 MB/sec execute 589 sec latency 823.643 ms 2024-05-14T09:55:38.837 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5401 0.04 MB/sec execute 590 sec latency 1026.254 ms 2024-05-14T09:55:39.837 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5405 0.04 MB/sec execute 591 sec latency 298.462 ms 2024-05-14T09:55:40.837 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5406 0.04 MB/sec execute 592 sec latency 936.017 ms 2024-05-14T09:55:41.837 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5423 0.04 MB/sec execute 593 sec latency 1088.278 ms 2024-05-14T09:55:42.837 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5423 0.04 MB/sec execute 594 sec latency 1039.391 ms 2024-05-14T09:55:43.837 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5427 0.04 MB/sec execute 595 sec latency 1153.532 ms 2024-05-14T09:55:44.838 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5431 0.04 MB/sec execute 596 sec latency 1183.765 ms 2024-05-14T09:55:45.838 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5434 0.04 MB/sec execute 597 sec latency 390.414 ms 2024-05-14T09:55:46.838 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5434 0.04 MB/sec execute 598 sec latency 1210.990 ms 2024-05-14T09:55:47.838 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5455 0.04 MB/sec execute 599 sec latency 1428.181 ms 2024-05-14T09:55:48.838 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 600 sec 2024-05-14T09:55:49.838 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 601 sec 2024-05-14T09:55:50.838 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 602 sec 2024-05-14T09:55:51.838 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 603 sec 2024-05-14T09:55:52.838 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 604 sec 2024-05-14T09:55:53.839 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 605 sec 2024-05-14T09:55:54.839 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 606 sec 2024-05-14T09:55:55.839 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 607 sec 2024-05-14T09:55:56.839 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 608 sec 2024-05-14T09:55:57.559 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:55:57.568 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:55:57.839 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 609 sec 2024-05-14T09:55:58.839 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 610 sec 2024-05-14T09:55:59.839 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 611 sec 2024-05-14T09:56:00.840 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 612 sec 2024-05-14T09:56:01.840 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 613 sec 2024-05-14T09:56:02.840 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 614 sec 2024-05-14T09:56:03.840 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 615 sec 2024-05-14T09:56:04.840 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 616 sec 2024-05-14T09:56:05.840 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 617 sec 2024-05-14T09:56:06.840 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 618 sec 2024-05-14T09:56:07.841 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 619 sec 2024-05-14T09:56:08.841 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 620 sec 2024-05-14T09:56:09.708 INFO:tasks.workunit.client.0.smithi135.stdout: 0 cleanup 621 sec 2024-05-14T09:56:09.708 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-14T09:56:09.708 INFO:tasks.workunit.client.0.smithi135.stdout: Operation Count AvgLat MaxLat 2024-05-14T09:56:09.708 INFO:tasks.workunit.client.0.smithi135.stdout: ---------------------------------------- 2024-05-14T09:56:09.708 INFO:tasks.workunit.client.0.smithi135.stdout: NTCreateX 770 210.510 777.996 2024-05-14T09:56:09.708 INFO:tasks.workunit.client.0.smithi135.stdout: Close 561 4.005 28.633 2024-05-14T09:56:09.708 INFO:tasks.workunit.client.0.smithi135.stdout: Rename 30 562.131 791.932 2024-05-14T09:56:09.708 INFO:tasks.workunit.client.0.smithi135.stdout: Unlink 136 208.158 699.664 2024-05-14T09:56:09.708 INFO:tasks.workunit.client.0.smithi135.stdout: Qpathinfo 713 111.513 921.606 2024-05-14T09:56:09.708 INFO:tasks.workunit.client.0.smithi135.stdout: Qfileinfo 125 3.763 16.798 2024-05-14T09:56:09.708 INFO:tasks.workunit.client.0.smithi135.stdout: Qfsinfo 109 35.175 207.182 2024-05-14T09:56:09.709 INFO:tasks.workunit.client.0.smithi135.stdout: Sfileinfo 59 42.068 55.439 2024-05-14T09:56:09.709 INFO:tasks.workunit.client.0.smithi135.stdout: Find 255 1143.672 1917.198 2024-05-14T09:56:09.709 INFO:tasks.workunit.client.0.smithi135.stdout: WriteX 359 13.820 211.694 2024-05-14T09:56:09.709 INFO:tasks.workunit.client.0.smithi135.stdout: ReadX 1137 0.118 7.513 2024-05-14T09:56:09.709 INFO:tasks.workunit.client.0.smithi135.stdout: LockX 2 87.767 141.047 2024-05-14T09:56:09.709 INFO:tasks.workunit.client.0.smithi135.stdout: UnlockX 2 68.892 89.288 2024-05-14T09:56:09.709 INFO:tasks.workunit.client.0.smithi135.stdout: Flush 49 162.537 340.895 2024-05-14T09:56:09.709 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-14T09:56:09.709 INFO:tasks.workunit.client.0.smithi135.stdout:Throughput 0.0375385 MB/sec 1 clients 1 procs max_latency=1917.219 ms 2024-05-14T09:56:09.709 INFO:tasks.workunit.client.0.smithi135.stderr:+ dbench 10 2024-05-14T09:56:09.711 INFO:tasks.workunit.client.0.smithi135.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-14T09:56:09.711 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-14T09:56:09.711 INFO:tasks.workunit.client.0.smithi135.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-14T09:56:09.716 INFO:tasks.workunit.client.0.smithi135.stdout:8 of 10 processes prepared for launch 0 sec 2024-05-14T09:56:09.816 INFO:tasks.workunit.client.0.smithi135.stdout:10 of 10 processes prepared for launch 0 sec 2024-05-14T09:56:09.816 INFO:tasks.workunit.client.0.smithi135.stdout:releasing clients 2024-05-14T09:56:10.816 INFO:tasks.workunit.client.0.smithi135.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.878 ms 2024-05-14T09:56:11.816 INFO:tasks.workunit.client.0.smithi135.stdout: 0 2 0.00 MB/sec warmup 2 sec latency 2000.016 ms 2024-05-14T09:56:12.817 INFO:tasks.workunit.client.0.smithi135.stdout: 0 3 0.00 MB/sec warmup 3 sec latency 3000.174 ms 2024-05-14T09:56:13.817 INFO:tasks.workunit.client.0.smithi135.stdout: 0 3 0.00 MB/sec warmup 4 sec latency 4000.322 ms 2024-05-14T09:56:14.817 INFO:tasks.workunit.client.0.smithi135.stdout: 0 4 0.00 MB/sec warmup 5 sec latency 5000.417 ms 2024-05-14T09:56:15.817 INFO:tasks.workunit.client.0.smithi135.stdout: 0 5 0.00 MB/sec warmup 6 sec latency 6000.536 ms 2024-05-14T09:56:16.817 INFO:tasks.workunit.client.0.smithi135.stdout: 1 7 0.06 MB/sec warmup 7 sec latency 1867.426 ms 2024-05-14T09:56:17.817 INFO:tasks.workunit.client.0.smithi135.stdout: 2 11 0.22 MB/sec warmup 8 sec latency 1213.400 ms 2024-05-14T09:56:18.817 INFO:tasks.workunit.client.0.smithi135.stdout: 2 12 0.24 MB/sec warmup 9 sec latency 1348.940 ms 2024-05-14T09:56:19.818 INFO:tasks.workunit.client.0.smithi135.stdout: 2 15 0.31 MB/sec warmup 10 sec latency 1594.169 ms 2024-05-14T09:56:20.817 INFO:tasks.workunit.client.0.smithi135.stdout: 3 18 0.38 MB/sec warmup 11 sec latency 1673.378 ms 2024-05-14T09:56:21.817 INFO:tasks.workunit.client.0.smithi135.stdout: 4 22 0.48 MB/sec warmup 12 sec latency 2088.341 ms 2024-05-14T09:56:22.818 INFO:tasks.workunit.client.0.smithi135.stdout: 8 28 0.67 MB/sec warmup 13 sec latency 2063.513 ms 2024-05-14T09:56:23.818 INFO:tasks.workunit.client.0.smithi135.stdout: 10 35 0.90 MB/sec warmup 14 sec latency 1809.404 ms 2024-05-14T09:56:24.818 INFO:tasks.workunit.client.0.smithi135.stdout: 10 40 1.02 MB/sec warmup 15 sec latency 1796.755 ms 2024-05-14T09:56:25.818 INFO:tasks.workunit.client.0.smithi135.stdout: 10 43 1.06 MB/sec warmup 16 sec latency 2180.334 ms 2024-05-14T09:56:26.818 INFO:tasks.workunit.client.0.smithi135.stdout: 10 47 1.09 MB/sec warmup 17 sec latency 3104.306 ms 2024-05-14T09:56:27.699 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:56:27.707 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:56:27.818 INFO:tasks.workunit.client.0.smithi135.stdout: 10 53 1.22 MB/sec warmup 18 sec latency 3290.377 ms 2024-05-14T09:56:28.823 INFO:tasks.workunit.client.0.smithi135.stdout: 10 59 1.32 MB/sec warmup 19 sec latency 2831.171 ms 2024-05-14T09:56:29.819 INFO:tasks.workunit.client.0.smithi135.stdout: 10 63 1.36 MB/sec warmup 20 sec latency 1920.961 ms 2024-05-14T09:56:30.819 INFO:tasks.workunit.client.0.smithi135.stdout: 10 67 1.40 MB/sec warmup 21 sec latency 2147.880 ms 2024-05-14T09:56:31.819 INFO:tasks.workunit.client.0.smithi135.stdout: 10 72 1.44 MB/sec warmup 22 sec latency 2256.827 ms 2024-05-14T09:56:32.819 INFO:tasks.workunit.client.0.smithi135.stdout: 10 77 1.51 MB/sec warmup 23 sec latency 2426.740 ms 2024-05-14T09:56:33.819 INFO:tasks.workunit.client.0.smithi135.stdout: 10 82 1.54 MB/sec warmup 24 sec latency 2695.458 ms 2024-05-14T09:56:34.819 INFO:tasks.workunit.client.0.smithi135.stdout: 10 85 1.56 MB/sec warmup 25 sec latency 2022.484 ms 2024-05-14T09:56:35.819 INFO:tasks.workunit.client.0.smithi135.stdout: 10 89 1.57 MB/sec warmup 26 sec latency 2589.565 ms 2024-05-14T09:56:36.819 INFO:tasks.workunit.client.0.smithi135.stdout: 10 94 1.60 MB/sec warmup 27 sec latency 2889.701 ms 2024-05-14T09:56:37.819 INFO:tasks.workunit.client.0.smithi135.stdout: 10 98 1.60 MB/sec warmup 28 sec latency 2323.442 ms 2024-05-14T09:56:38.819 INFO:tasks.workunit.client.0.smithi135.stdout: 10 103 1.65 MB/sec warmup 29 sec latency 1990.587 ms 2024-05-14T09:56:39.820 INFO:tasks.workunit.client.0.smithi135.stdout: 10 108 1.67 MB/sec warmup 30 sec latency 2706.627 ms 2024-05-14T09:56:40.820 INFO:tasks.workunit.client.0.smithi135.stdout: 10 111 1.66 MB/sec warmup 31 sec latency 2305.494 ms 2024-05-14T09:56:41.820 INFO:tasks.workunit.client.0.smithi135.stdout: 10 113 1.65 MB/sec warmup 32 sec latency 2896.320 ms 2024-05-14T09:56:42.820 INFO:tasks.workunit.client.0.smithi135.stdout: 10 116 1.62 MB/sec warmup 33 sec latency 3183.338 ms 2024-05-14T09:56:43.820 INFO:tasks.workunit.client.0.smithi135.stdout: 10 119 1.60 MB/sec warmup 34 sec latency 2715.153 ms 2024-05-14T09:56:44.820 INFO:tasks.workunit.client.0.smithi135.stdout: 10 121 1.58 MB/sec warmup 35 sec latency 2121.286 ms 2024-05-14T09:56:45.820 INFO:tasks.workunit.client.0.smithi135.stdout: 10 123 1.55 MB/sec warmup 36 sec latency 2680.833 ms 2024-05-14T09:56:46.820 INFO:tasks.workunit.client.0.smithi135.stdout: 10 126 1.53 MB/sec warmup 37 sec latency 2857.037 ms 2024-05-14T09:56:47.821 INFO:tasks.workunit.client.0.smithi135.stdout: 10 128 1.51 MB/sec warmup 38 sec latency 3443.432 ms 2024-05-14T09:56:48.821 INFO:tasks.workunit.client.0.smithi135.stdout: 10 128 1.47 MB/sec warmup 39 sec latency 3111.120 ms 2024-05-14T09:56:49.821 INFO:tasks.workunit.client.0.smithi135.stdout: 10 131 1.46 MB/sec warmup 40 sec latency 3716.351 ms 2024-05-14T09:56:50.821 INFO:tasks.workunit.client.0.smithi135.stdout: 10 136 1.46 MB/sec warmup 41 sec latency 3040.617 ms 2024-05-14T09:56:51.821 INFO:tasks.workunit.client.0.smithi135.stdout: 10 137 1.43 MB/sec warmup 42 sec latency 2552.427 ms 2024-05-14T09:56:52.821 INFO:tasks.workunit.client.0.smithi135.stdout: 10 137 1.40 MB/sec warmup 43 sec latency 2994.059 ms 2024-05-14T09:56:53.821 INFO:tasks.workunit.client.0.smithi135.stdout: 10 139 1.38 MB/sec warmup 44 sec latency 3827.880 ms 2024-05-14T09:56:54.821 INFO:tasks.workunit.client.0.smithi135.stdout: 10 143 1.37 MB/sec warmup 45 sec latency 4099.721 ms 2024-05-14T09:56:55.822 INFO:tasks.workunit.client.0.smithi135.stdout: 10 143 1.34 MB/sec warmup 46 sec latency 2147.386 ms 2024-05-14T09:56:56.822 INFO:tasks.workunit.client.0.smithi135.stdout: 10 147 1.34 MB/sec warmup 47 sec latency 2721.508 ms 2024-05-14T09:56:57.822 INFO:tasks.workunit.client.0.smithi135.stdout: 10 149 1.32 MB/sec warmup 48 sec latency 3023.053 ms 2024-05-14T09:56:57.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:56:57.839 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:56:58.822 INFO:tasks.workunit.client.0.smithi135.stdout: 10 149 1.29 MB/sec warmup 49 sec latency 2326.931 ms 2024-05-14T09:56:59.822 INFO:tasks.workunit.client.0.smithi135.stdout: 10 153 1.29 MB/sec warmup 50 sec latency 3114.769 ms 2024-05-14T09:57:00.822 INFO:tasks.workunit.client.0.smithi135.stdout: 10 156 1.29 MB/sec warmup 51 sec latency 3534.888 ms 2024-05-14T09:57:01.822 INFO:tasks.workunit.client.0.smithi135.stdout: 10 158 1.27 MB/sec warmup 52 sec latency 2050.332 ms 2024-05-14T09:57:02.822 INFO:tasks.workunit.client.0.smithi135.stdout: 10 160 1.26 MB/sec warmup 53 sec latency 2757.238 ms 2024-05-14T09:57:03.823 INFO:tasks.workunit.client.0.smithi135.stdout: 10 161 1.24 MB/sec warmup 54 sec latency 3184.117 ms 2024-05-14T09:57:04.823 INFO:tasks.workunit.client.0.smithi135.stdout: 10 163 1.23 MB/sec warmup 55 sec latency 3763.074 ms 2024-05-14T09:57:05.823 INFO:tasks.workunit.client.0.smithi135.stdout: 10 166 1.22 MB/sec warmup 56 sec latency 2436.984 ms 2024-05-14T09:57:06.823 INFO:tasks.workunit.client.0.smithi135.stdout: 10 167 1.21 MB/sec warmup 57 sec latency 2263.446 ms 2024-05-14T09:57:07.823 INFO:tasks.workunit.client.0.smithi135.stdout: 10 169 1.20 MB/sec warmup 58 sec latency 3074.796 ms 2024-05-14T09:57:08.823 INFO:tasks.workunit.client.0.smithi135.stdout: 10 169 1.18 MB/sec warmup 59 sec latency 3942.055 ms 2024-05-14T09:57:09.823 INFO:tasks.workunit.client.0.smithi135.stdout: 10 172 1.17 MB/sec warmup 60 sec latency 4635.154 ms 2024-05-14T09:57:10.823 INFO:tasks.workunit.client.0.smithi135.stdout: 10 174 1.17 MB/sec warmup 61 sec latency 5014.126 ms 2024-05-14T09:57:11.824 INFO:tasks.workunit.client.0.smithi135.stdout: 10 177 1.16 MB/sec warmup 62 sec latency 5181.631 ms 2024-05-14T09:57:12.824 INFO:tasks.workunit.client.0.smithi135.stdout: 10 179 1.15 MB/sec warmup 63 sec latency 3753.530 ms 2024-05-14T09:57:13.824 INFO:tasks.workunit.client.0.smithi135.stdout: 10 182 1.15 MB/sec warmup 64 sec latency 2947.671 ms 2024-05-14T09:57:14.066 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:17:35.532 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:57:14.103 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:17:35.569 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:57:14.161 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:17:35.627 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:57:14.219 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:17:35.695 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:57:14.236 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:17:35.712 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:57:14.263 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:17:35.742 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:57:14.266 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:17:35.745 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:57:14.324 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:17:35.800 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:57:14.334 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:17:35.813 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:57:14.824 INFO:tasks.workunit.client.0.smithi135.stdout: 10 182 1.13 MB/sec warmup 65 sec latency 3165.636 ms 2024-05-14T09:57:15.824 INFO:tasks.workunit.client.0.smithi135.stdout: 10 185 1.13 MB/sec warmup 66 sec latency 3899.104 ms 2024-05-14T09:57:16.826 INFO:tasks.workunit.client.0.smithi135.stdout: 10 189 1.13 MB/sec warmup 67 sec latency 2719.833 ms 2024-05-14T09:57:17.824 INFO:tasks.workunit.client.0.smithi135.stdout: 10 190 1.12 MB/sec warmup 68 sec latency 2364.620 ms 2024-05-14T09:57:18.824 INFO:tasks.workunit.client.0.smithi135.stdout: 10 191 1.11 MB/sec warmup 69 sec latency 3164.317 ms 2024-05-14T09:57:19.825 INFO:tasks.workunit.client.0.smithi135.stdout: 10 191 1.09 MB/sec warmup 70 sec latency 3805.374 ms 2024-05-14T09:57:20.825 INFO:tasks.workunit.client.0.smithi135.stdout: 10 193 1.08 MB/sec warmup 71 sec latency 4679.913 ms 2024-05-14T09:57:21.825 INFO:tasks.workunit.client.0.smithi135.stdout: 10 198 1.09 MB/sec warmup 72 sec latency 4474.404 ms 2024-05-14T09:57:22.825 INFO:tasks.workunit.client.0.smithi135.stdout: 10 199 1.08 MB/sec warmup 73 sec latency 2263.208 ms 2024-05-14T09:57:23.825 INFO:tasks.workunit.client.0.smithi135.stdout: 10 200 1.07 MB/sec warmup 74 sec latency 2697.583 ms 2024-05-14T09:57:24.826 INFO:tasks.workunit.client.0.smithi135.stdout: 10 203 1.07 MB/sec warmup 75 sec latency 3210.712 ms 2024-05-14T09:57:25.826 INFO:tasks.workunit.client.0.smithi135.stdout: 10 206 1.07 MB/sec warmup 76 sec latency 3212.465 ms 2024-05-14T09:57:26.827 INFO:tasks.workunit.client.0.smithi135.stdout: 10 208 1.06 MB/sec warmup 77 sec latency 2301.318 ms 2024-05-14T09:57:27.826 INFO:tasks.workunit.client.0.smithi135.stdout: 10 209 1.05 MB/sec warmup 78 sec latency 2624.580 ms 2024-05-14T09:57:28.127 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:57:28.138 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:57:28.826 INFO:tasks.workunit.client.0.smithi135.stdout: 10 210 1.04 MB/sec warmup 79 sec latency 3540.513 ms 2024-05-14T09:57:29.826 INFO:tasks.workunit.client.0.smithi135.stdout: 10 211 1.03 MB/sec warmup 80 sec latency 4027.218 ms 2024-05-14T09:57:30.826 INFO:tasks.workunit.client.0.smithi135.stdout: 10 213 1.03 MB/sec warmup 81 sec latency 4532.233 ms 2024-05-14T09:57:31.826 INFO:tasks.workunit.client.0.smithi135.stdout: 10 217 1.03 MB/sec warmup 82 sec latency 5019.660 ms 2024-05-14T09:57:32.826 INFO:tasks.workunit.client.0.smithi135.stdout: 10 219 1.02 MB/sec warmup 83 sec latency 2782.097 ms 2024-05-14T09:57:33.826 INFO:tasks.workunit.client.0.smithi135.stdout: 10 221 1.02 MB/sec warmup 84 sec latency 3229.885 ms 2024-05-14T09:57:34.826 INFO:tasks.workunit.client.0.smithi135.stdout: 10 223 1.01 MB/sec warmup 85 sec latency 3361.636 ms 2024-05-14T09:57:35.827 INFO:tasks.workunit.client.0.smithi135.stdout: 10 227 1.02 MB/sec warmup 86 sec latency 2856.669 ms 2024-05-14T09:57:36.827 INFO:tasks.workunit.client.0.smithi135.stdout: 10 229 1.02 MB/sec warmup 87 sec latency 2832.176 ms 2024-05-14T09:57:37.827 INFO:tasks.workunit.client.0.smithi135.stdout: 10 229 1.00 MB/sec warmup 88 sec latency 3196.051 ms 2024-05-14T09:57:38.827 INFO:tasks.workunit.client.0.smithi135.stdout: 10 230 1.00 MB/sec warmup 89 sec latency 3687.089 ms 2024-05-14T09:57:39.827 INFO:tasks.workunit.client.0.smithi135.stdout: 10 231 0.99 MB/sec warmup 90 sec latency 4572.830 ms 2024-05-14T09:57:40.827 INFO:tasks.workunit.client.0.smithi135.stdout: 10 234 0.99 MB/sec warmup 91 sec latency 5020.590 ms 2024-05-14T09:57:41.827 INFO:tasks.workunit.client.0.smithi135.stdout: 10 236 0.99 MB/sec warmup 92 sec latency 5278.700 ms 2024-05-14T09:57:42.827 INFO:tasks.workunit.client.0.smithi135.stdout: 10 239 0.99 MB/sec warmup 93 sec latency 5291.220 ms 2024-05-14T09:57:43.828 INFO:tasks.workunit.client.0.smithi135.stdout: 10 240 0.98 MB/sec warmup 94 sec latency 3215.801 ms 2024-05-14T09:57:44.828 INFO:tasks.workunit.client.0.smithi135.stdout: 10 243 0.97 MB/sec warmup 95 sec latency 4215.983 ms 2024-05-14T09:57:45.828 INFO:tasks.workunit.client.0.smithi135.stdout: 10 247 0.98 MB/sec warmup 96 sec latency 4228.300 ms 2024-05-14T09:57:46.828 INFO:tasks.workunit.client.0.smithi135.stdout: 10 248 0.97 MB/sec warmup 97 sec latency 3640.850 ms 2024-05-14T09:57:47.828 INFO:tasks.workunit.client.0.smithi135.stdout: 10 249 0.97 MB/sec warmup 98 sec latency 3038.121 ms 2024-05-14T09:57:48.828 INFO:tasks.workunit.client.0.smithi135.stdout: 10 251 0.96 MB/sec warmup 99 sec latency 3737.828 ms 2024-05-14T09:57:49.828 INFO:tasks.workunit.client.0.smithi135.stdout: 10 254 0.96 MB/sec warmup 100 sec latency 4221.631 ms 2024-05-14T09:57:50.828 INFO:tasks.workunit.client.0.smithi135.stdout: 10 255 0.96 MB/sec warmup 101 sec latency 4571.747 ms 2024-05-14T09:57:51.829 INFO:tasks.workunit.client.0.smithi135.stdout: 10 260 0.96 MB/sec warmup 102 sec latency 4690.007 ms 2024-05-14T09:57:52.829 INFO:tasks.workunit.client.0.smithi135.stdout: 10 261 0.96 MB/sec warmup 103 sec latency 3201.403 ms 2024-05-14T09:57:53.829 INFO:tasks.workunit.client.0.smithi135.stdout: 10 263 0.95 MB/sec warmup 104 sec latency 3542.792 ms 2024-05-14T09:57:54.829 INFO:tasks.workunit.client.0.smithi135.stdout: 10 265 0.95 MB/sec warmup 105 sec latency 4253.374 ms 2024-05-14T09:57:55.829 INFO:tasks.workunit.client.0.smithi135.stdout: 10 270 0.96 MB/sec warmup 106 sec latency 3663.605 ms 2024-05-14T09:57:56.829 INFO:tasks.workunit.client.0.smithi135.stdout: 10 271 0.95 MB/sec warmup 107 sec latency 2668.523 ms 2024-05-14T09:57:57.829 INFO:tasks.workunit.client.0.smithi135.stdout: 10 271 0.94 MB/sec warmup 108 sec latency 3139.790 ms 2024-05-14T09:57:58.254 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:57:58.262 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:57:58.830 INFO:tasks.workunit.client.0.smithi135.stdout: 10 271 0.93 MB/sec warmup 109 sec latency 3701.726 ms 2024-05-14T09:57:59.830 INFO:tasks.workunit.client.0.smithi135.stdout: 10 272 0.93 MB/sec warmup 110 sec latency 4701.868 ms 2024-05-14T09:58:00.830 INFO:tasks.workunit.client.0.smithi135.stdout: 10 274 0.93 MB/sec warmup 111 sec latency 5354.081 ms 2024-05-14T09:58:01.830 INFO:tasks.workunit.client.0.smithi135.stdout: 10 278 0.93 MB/sec warmup 112 sec latency 5756.543 ms 2024-05-14T09:58:02.830 INFO:tasks.workunit.client.0.smithi135.stdout: 10 280 0.93 MB/sec warmup 113 sec latency 2170.386 ms 2024-05-14T09:58:03.830 INFO:tasks.workunit.client.0.smithi135.stdout: 10 282 0.93 MB/sec warmup 114 sec latency 2861.852 ms 2024-05-14T09:58:04.831 INFO:tasks.workunit.client.0.smithi135.stdout: 10 283 0.92 MB/sec warmup 115 sec latency 3325.131 ms 2024-05-14T09:58:05.830 INFO:tasks.workunit.client.0.smithi135.stdout: 10 287 0.92 MB/sec warmup 116 sec latency 3450.998 ms 2024-05-14T09:58:06.831 INFO:tasks.workunit.client.0.smithi135.stdout: 10 290 0.92 MB/sec warmup 117 sec latency 2786.164 ms 2024-05-14T09:58:07.831 INFO:tasks.workunit.client.0.smithi135.stdout: 10 291 0.91 MB/sec warmup 118 sec latency 2652.812 ms 2024-05-14T09:58:08.831 INFO:tasks.workunit.client.0.smithi135.stdout: 10 293 0.91 MB/sec warmup 119 sec latency 3037.444 ms 2024-05-14T09:58:10.831 INFO:tasks.workunit.client.0.smithi135.stdout: 10 294 0.39 MB/sec execute 1 sec latency 4113.052 ms 2024-05-14T09:58:11.831 INFO:tasks.workunit.client.0.smithi135.stdout: 10 295 0.32 MB/sec execute 2 sec latency 5113.192 ms 2024-05-14T09:58:12.831 INFO:tasks.workunit.client.0.smithi135.stdout: 10 296 0.30 MB/sec execute 3 sec latency 5313.949 ms 2024-05-14T09:58:13.831 INFO:tasks.workunit.client.0.smithi135.stdout: 10 296 0.23 MB/sec execute 4 sec latency 5920.997 ms 2024-05-14T09:58:14.832 INFO:tasks.workunit.client.0.smithi135.stdout: 10 299 0.29 MB/sec execute 5 sec latency 6218.159 ms 2024-05-14T09:58:15.832 INFO:tasks.workunit.client.0.smithi135.stdout: 10 303 0.45 MB/sec execute 6 sec latency 3467.997 ms 2024-05-14T09:58:16.832 INFO:tasks.workunit.client.0.smithi135.stdout: 10 305 0.50 MB/sec execute 7 sec latency 2383.634 ms 2024-05-14T09:58:17.832 INFO:tasks.workunit.client.0.smithi135.stdout: 10 307 0.54 MB/sec execute 8 sec latency 3010.131 ms 2024-05-14T09:58:18.832 INFO:tasks.workunit.client.0.smithi135.stdout: 10 311 0.62 MB/sec execute 9 sec latency 2684.011 ms 2024-05-14T09:58:19.832 INFO:tasks.workunit.client.0.smithi135.stdout: 10 313 0.61 MB/sec execute 10 sec latency 2845.881 ms 2024-05-14T09:58:20.832 INFO:tasks.workunit.client.0.smithi135.stdout: 10 315 0.60 MB/sec execute 11 sec latency 3163.174 ms 2024-05-14T09:58:21.832 INFO:tasks.workunit.client.0.smithi135.stdout: 10 318 0.62 MB/sec execute 12 sec latency 3062.569 ms 2024-05-14T09:58:22.833 INFO:tasks.workunit.client.0.smithi135.stdout: 10 319 0.59 MB/sec execute 13 sec latency 2486.229 ms 2024-05-14T09:58:23.832 INFO:tasks.workunit.client.0.smithi135.stdout: 10 322 0.61 MB/sec execute 14 sec latency 2756.140 ms 2024-05-14T09:58:24.833 INFO:tasks.workunit.client.0.smithi135.stdout: 10 324 0.62 MB/sec execute 15 sec latency 3341.859 ms 2024-05-14T09:58:25.833 INFO:tasks.workunit.client.0.smithi135.stdout: 10 324 0.58 MB/sec execute 16 sec latency 4341.970 ms 2024-05-14T09:58:26.833 INFO:tasks.workunit.client.0.smithi135.stdout: 10 324 0.54 MB/sec execute 17 sec latency 4842.884 ms 2024-05-14T09:58:27.833 INFO:tasks.workunit.client.0.smithi135.stdout: 10 327 0.56 MB/sec execute 18 sec latency 5005.960 ms 2024-05-14T09:58:28.373 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:58:28.386 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:58:28.833 INFO:tasks.workunit.client.0.smithi135.stdout: 10 331 0.60 MB/sec execute 19 sec latency 3821.114 ms 2024-05-14T09:58:29.833 INFO:tasks.workunit.client.0.smithi135.stdout: 10 331 0.57 MB/sec execute 20 sec latency 2634.740 ms 2024-05-14T09:58:30.834 INFO:tasks.workunit.client.0.smithi135.stdout: 10 332 0.55 MB/sec execute 21 sec latency 3342.852 ms 2024-05-14T09:58:31.834 INFO:tasks.workunit.client.0.smithi135.stdout: 10 335 0.56 MB/sec execute 22 sec latency 4115.726 ms 2024-05-14T09:58:32.834 INFO:tasks.workunit.client.0.smithi135.stdout: 10 339 0.59 MB/sec execute 23 sec latency 4178.201 ms 2024-05-14T09:58:33.834 INFO:tasks.workunit.client.0.smithi135.stdout: 10 339 0.58 MB/sec execute 24 sec latency 2289.517 ms 2024-05-14T09:58:34.834 INFO:tasks.workunit.client.0.smithi135.stdout: 10 341 0.58 MB/sec execute 25 sec latency 3011.917 ms 2024-05-14T09:58:35.834 INFO:tasks.workunit.client.0.smithi135.stdout: 10 343 0.59 MB/sec execute 26 sec latency 3480.535 ms 2024-05-14T09:58:36.834 INFO:tasks.workunit.client.0.smithi135.stdout: 10 346 0.59 MB/sec execute 27 sec latency 3408.977 ms 2024-05-14T09:58:37.834 INFO:tasks.workunit.client.0.smithi135.stdout: 10 349 0.60 MB/sec execute 28 sec latency 2589.847 ms 2024-05-14T09:58:38.835 INFO:tasks.workunit.client.0.smithi135.stdout: 10 349 0.58 MB/sec execute 29 sec latency 2738.430 ms 2024-05-14T09:58:39.835 INFO:tasks.workunit.client.0.smithi135.stdout: 10 351 0.57 MB/sec execute 30 sec latency 3377.385 ms 2024-05-14T09:58:40.835 INFO:tasks.workunit.client.0.smithi135.stdout: 10 354 0.59 MB/sec execute 31 sec latency 3464.216 ms 2024-05-14T09:58:41.835 INFO:tasks.workunit.client.0.smithi135.stdout: 10 356 0.59 MB/sec execute 32 sec latency 3434.488 ms 2024-05-14T09:58:42.835 INFO:tasks.workunit.client.0.smithi135.stdout: 10 358 0.59 MB/sec execute 33 sec latency 2678.800 ms 2024-05-14T09:58:43.838 INFO:tasks.workunit.client.0.smithi135.stdout: 10 361 0.61 MB/sec execute 34 sec latency 2837.603 ms 2024-05-14T09:58:44.835 INFO:tasks.workunit.client.0.smithi135.stdout: 10 364 0.61 MB/sec execute 35 sec latency 3229.304 ms 2024-05-14T09:58:45.835 INFO:tasks.workunit.client.0.smithi135.stdout: 10 364 0.60 MB/sec execute 36 sec latency 3269.676 ms 2024-05-14T09:58:46.835 INFO:tasks.workunit.client.0.smithi135.stdout: 10 364 0.58 MB/sec execute 37 sec latency 4269.765 ms 2024-05-14T09:58:47.836 INFO:tasks.workunit.client.0.smithi135.stdout: 10 369 0.60 MB/sec execute 38 sec latency 4479.958 ms 2024-05-14T09:58:48.836 INFO:tasks.workunit.client.0.smithi135.stdout: 10 372 0.62 MB/sec execute 39 sec latency 1530.559 ms 2024-05-14T09:58:49.836 INFO:tasks.workunit.client.0.smithi135.stdout: 10 372 0.60 MB/sec execute 40 sec latency 2530.692 ms 2024-05-14T09:58:50.836 INFO:tasks.workunit.client.0.smithi135.stdout: 10 372 0.59 MB/sec execute 41 sec latency 3530.793 ms 2024-05-14T09:58:51.836 INFO:tasks.workunit.client.0.smithi135.stdout: 10 373 0.57 MB/sec execute 42 sec latency 4328.039 ms 2024-05-14T09:58:52.836 INFO:tasks.workunit.client.0.smithi135.stdout: 10 379 0.61 MB/sec execute 43 sec latency 4264.960 ms 2024-05-14T09:58:53.836 INFO:tasks.workunit.client.0.smithi135.stdout: 10 380 0.61 MB/sec execute 44 sec latency 1728.225 ms 2024-05-14T09:58:54.836 INFO:tasks.workunit.client.0.smithi135.stdout: 10 380 0.59 MB/sec execute 45 sec latency 2728.374 ms 2024-05-14T09:58:55.837 INFO:tasks.workunit.client.0.smithi135.stdout: 10 380 0.58 MB/sec execute 46 sec latency 3728.516 ms 2024-05-14T09:58:56.837 INFO:tasks.workunit.client.0.smithi135.stdout: 10 380 0.57 MB/sec execute 47 sec latency 4716.547 ms 2024-05-14T09:58:57.837 INFO:tasks.workunit.client.0.smithi135.stdout: 10 384 0.58 MB/sec execute 48 sec latency 5564.363 ms 2024-05-14T09:58:58.584 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:58:58.594 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:58:58.837 INFO:tasks.workunit.client.0.smithi135.stdout: 10 388 0.60 MB/sec execute 49 sec latency 5838.075 ms 2024-05-14T09:58:59.837 INFO:tasks.workunit.client.0.smithi135.stdout: 10 388 0.59 MB/sec execute 50 sec latency 2543.738 ms 2024-05-14T09:59:00.837 INFO:tasks.workunit.client.0.smithi135.stdout: 10 389 0.58 MB/sec execute 51 sec latency 2891.505 ms 2024-05-14T09:59:01.837 INFO:tasks.workunit.client.0.smithi135.stdout: 10 392 0.59 MB/sec execute 52 sec latency 3764.484 ms 2024-05-14T09:59:02.837 INFO:tasks.workunit.client.0.smithi135.stdout: 10 397 0.61 MB/sec execute 53 sec latency 3820.630 ms 2024-05-14T09:59:03.838 INFO:tasks.workunit.client.0.smithi135.stdout: 10 398 0.60 MB/sec execute 54 sec latency 2461.865 ms 2024-05-14T09:59:04.838 INFO:tasks.workunit.client.0.smithi135.stdout: 10 400 0.60 MB/sec execute 55 sec latency 2839.378 ms 2024-05-14T09:59:05.838 INFO:tasks.workunit.client.0.smithi135.stdout: 10 400 0.59 MB/sec execute 56 sec latency 3330.864 ms 2024-05-14T09:59:06.838 INFO:tasks.workunit.client.0.smithi135.stdout: 10 403 0.60 MB/sec execute 57 sec latency 4137.387 ms 2024-05-14T09:59:07.838 INFO:tasks.workunit.client.0.smithi135.stdout: 10 407 0.61 MB/sec execute 58 sec latency 4426.674 ms 2024-05-14T09:59:08.838 INFO:tasks.workunit.client.0.smithi135.stdout: 10 408 0.61 MB/sec execute 59 sec latency 2700.438 ms 2024-05-14T09:59:09.838 INFO:tasks.workunit.client.0.smithi135.stdout: 10 408 0.60 MB/sec execute 60 sec latency 3700.539 ms 2024-05-14T09:59:10.838 INFO:tasks.workunit.client.0.smithi135.stdout: 10 410 0.60 MB/sec execute 61 sec latency 4700.634 ms 2024-05-14T09:59:11.838 INFO:tasks.workunit.client.0.smithi135.stdout: 10 412 0.60 MB/sec execute 62 sec latency 4903.171 ms 2024-05-14T09:59:12.839 INFO:tasks.workunit.client.0.smithi135.stdout: 10 416 0.61 MB/sec execute 63 sec latency 4756.609 ms 2024-05-14T09:59:13.839 INFO:tasks.workunit.client.0.smithi135.stdout: 10 419 0.61 MB/sec execute 64 sec latency 3198.138 ms 2024-05-14T09:59:14.839 INFO:tasks.workunit.client.0.smithi135.stdout: 10 419 0.61 MB/sec execute 65 sec latency 3511.165 ms 2024-05-14T09:59:15.839 INFO:tasks.workunit.client.0.smithi135.stdout: 10 421 0.61 MB/sec execute 66 sec latency 4046.743 ms 2024-05-14T09:59:16.839 INFO:tasks.workunit.client.0.smithi135.stdout: 10 423 0.61 MB/sec execute 67 sec latency 3834.353 ms 2024-05-14T09:59:17.839 INFO:tasks.workunit.client.0.smithi135.stdout: 10 424 0.60 MB/sec execute 68 sec latency 4834.491 ms 2024-05-14T09:59:18.840 INFO:tasks.workunit.client.0.smithi135.stdout: 10 427 0.60 MB/sec execute 69 sec latency 5602.059 ms 2024-05-14T09:59:19.840 INFO:tasks.workunit.client.0.smithi135.stdout: 10 430 0.61 MB/sec execute 70 sec latency 4361.361 ms 2024-05-14T09:59:20.840 INFO:tasks.workunit.client.0.smithi135.stdout: 10 431 0.61 MB/sec execute 71 sec latency 4561.938 ms 2024-05-14T09:59:21.840 INFO:tasks.workunit.client.0.smithi135.stdout: 10 432 0.60 MB/sec execute 72 sec latency 3694.942 ms 2024-05-14T09:59:22.840 INFO:tasks.workunit.client.0.smithi135.stdout: 10 433 0.60 MB/sec execute 73 sec latency 3845.401 ms 2024-05-14T09:59:23.840 INFO:tasks.workunit.client.0.smithi135.stdout: 10 437 0.61 MB/sec execute 74 sec latency 4367.870 ms 2024-05-14T09:59:24.840 INFO:tasks.workunit.client.0.smithi135.stdout: 10 440 0.62 MB/sec execute 75 sec latency 2050.932 ms 2024-05-14T09:59:25.840 INFO:tasks.workunit.client.0.smithi135.stdout: 10 441 0.61 MB/sec execute 76 sec latency 2508.012 ms 2024-05-14T09:59:26.841 INFO:tasks.workunit.client.0.smithi135.stdout: 10 441 0.61 MB/sec execute 77 sec latency 3354.681 ms 2024-05-14T09:59:27.841 INFO:tasks.workunit.client.0.smithi135.stdout: 10 445 0.61 MB/sec execute 78 sec latency 3815.306 ms 2024-05-14T09:59:28.719 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:59:28.727 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:59:28.841 INFO:tasks.workunit.client.0.smithi135.stdout: 10 449 0.62 MB/sec execute 79 sec latency 3786.708 ms 2024-05-14T09:59:29.841 INFO:tasks.workunit.client.0.smithi135.stdout: 10 449 0.62 MB/sec execute 80 sec latency 2190.458 ms 2024-05-14T09:59:30.841 INFO:tasks.workunit.client.0.smithi135.stdout: 10 449 0.61 MB/sec execute 81 sec latency 3190.558 ms 2024-05-14T09:59:31.841 INFO:tasks.workunit.client.0.smithi135.stdout: 10 450 0.60 MB/sec execute 82 sec latency 3987.176 ms 2024-05-14T09:59:32.841 INFO:tasks.workunit.client.0.smithi135.stdout: 10 455 0.61 MB/sec execute 83 sec latency 4314.956 ms 2024-05-14T09:59:33.841 INFO:tasks.workunit.client.0.smithi135.stdout: 10 457 0.62 MB/sec execute 84 sec latency 1850.306 ms 2024-05-14T09:59:34.842 INFO:tasks.workunit.client.0.smithi135.stdout: 10 457 0.61 MB/sec execute 85 sec latency 2850.444 ms 2024-05-14T09:59:35.464 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:19:56.930 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:59:35.588 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:19:57.054 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:59:35.691 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:19:57.154 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T09:59:35.721 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:19:57.197 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:59:35.725 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:19:57.202 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:59:35.735 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:19:57.214 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:59:35.740 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:19:57.219 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:59:35.829 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:19:57.305 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T09:59:35.842 INFO:tasks.workunit.client.0.smithi135.stdout: 10 457 0.60 MB/sec execute 86 sec latency 3850.569 ms 2024-05-14T09:59:35.867 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:19:57.346 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T09:59:36.842 INFO:tasks.workunit.client.0.smithi135.stdout: 10 458 0.60 MB/sec execute 87 sec latency 4435.471 ms 2024-05-14T09:59:37.842 INFO:tasks.workunit.client.0.smithi135.stdout: 10 460 0.60 MB/sec execute 88 sec latency 5218.472 ms 2024-05-14T09:59:38.842 INFO:tasks.workunit.client.0.smithi135.stdout: 10 464 0.61 MB/sec execute 89 sec latency 5728.142 ms 2024-05-14T09:59:39.842 INFO:tasks.workunit.client.0.smithi135.stdout: 10 466 0.61 MB/sec execute 90 sec latency 6038.376 ms 2024-05-14T09:59:40.842 INFO:tasks.workunit.client.0.smithi135.stdout: 10 466 0.60 MB/sec execute 91 sec latency 3349.215 ms 2024-05-14T09:59:41.842 INFO:tasks.workunit.client.0.smithi135.stdout: 10 468 0.60 MB/sec execute 92 sec latency 3651.164 ms 2024-05-14T09:59:42.843 INFO:tasks.workunit.client.0.smithi135.stdout: 10 472 0.61 MB/sec execute 93 sec latency 3622.753 ms 2024-05-14T09:59:43.843 INFO:tasks.workunit.client.0.smithi135.stdout: 10 475 0.61 MB/sec execute 94 sec latency 2065.574 ms 2024-05-14T09:59:44.843 INFO:tasks.workunit.client.0.smithi135.stdout: 10 475 0.61 MB/sec execute 95 sec latency 2923.899 ms 2024-05-14T09:59:45.843 INFO:tasks.workunit.client.0.smithi135.stdout: 10 477 0.61 MB/sec execute 96 sec latency 3371.661 ms 2024-05-14T09:59:46.843 INFO:tasks.workunit.client.0.smithi135.stdout: 10 479 0.60 MB/sec execute 97 sec latency 4077.319 ms 2024-05-14T09:59:47.843 INFO:tasks.workunit.client.0.smithi135.stdout: 10 481 0.61 MB/sec execute 98 sec latency 4450.714 ms 2024-05-14T09:59:48.843 INFO:tasks.workunit.client.0.smithi135.stdout: 10 485 0.61 MB/sec execute 99 sec latency 4549.950 ms 2024-05-14T09:59:49.843 INFO:tasks.workunit.client.0.smithi135.stdout: 10 486 0.61 MB/sec execute 100 sec latency 3672.131 ms 2024-05-14T09:59:50.844 INFO:tasks.workunit.client.0.smithi135.stdout: 10 488 0.61 MB/sec execute 101 sec latency 3858.985 ms 2024-05-14T09:59:51.844 INFO:tasks.workunit.client.0.smithi135.stdout: 10 490 0.61 MB/sec execute 102 sec latency 4042.781 ms 2024-05-14T09:59:52.844 INFO:tasks.workunit.client.0.smithi135.stdout: 10 493 0.61 MB/sec execute 103 sec latency 4621.736 ms 2024-05-14T09:59:53.844 INFO:tasks.workunit.client.0.smithi135.stdout: 10 498 0.62 MB/sec execute 104 sec latency 4530.217 ms 2024-05-14T09:59:54.844 INFO:tasks.workunit.client.0.smithi135.stdout: 10 501 0.63 MB/sec execute 105 sec latency 2906.964 ms 2024-05-14T09:59:55.844 INFO:tasks.workunit.client.0.smithi135.stdout: 10 502 0.63 MB/sec execute 106 sec latency 3657.881 ms 2024-05-14T09:59:56.844 INFO:tasks.workunit.client.0.smithi135.stdout: 10 504 0.62 MB/sec execute 107 sec latency 3983.486 ms 2024-05-14T09:59:57.844 INFO:tasks.workunit.client.0.smithi135.stdout: 10 508 0.63 MB/sec execute 108 sec latency 4320.674 ms 2024-05-14T09:59:58.845 INFO:tasks.workunit.client.0.smithi135.stdout: 10 509 0.63 MB/sec execute 109 sec latency 4234.803 ms 2024-05-14T09:59:58.855 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:59:58.864 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T09:59:59.845 INFO:tasks.workunit.client.0.smithi135.stdout: 10 510 0.63 MB/sec execute 110 sec latency 5234.985 ms 2024-05-14T10:00:00.845 INFO:tasks.workunit.client.0.smithi135.stdout: 10 511 0.62 MB/sec execute 111 sec latency 6235.100 ms 2024-05-14T10:00:01.845 INFO:tasks.workunit.client.0.smithi135.stdout: 10 514 0.63 MB/sec execute 112 sec latency 7235.207 ms 2024-05-14T10:00:02.845 INFO:tasks.workunit.client.0.smithi135.stdout: 10 516 0.63 MB/sec execute 113 sec latency 7684.301 ms 2024-05-14T10:00:03.845 INFO:tasks.workunit.client.0.smithi135.stdout: 10 518 0.63 MB/sec execute 114 sec latency 3165.505 ms 2024-05-14T10:00:04.845 INFO:tasks.workunit.client.0.smithi135.stdout: 10 519 0.62 MB/sec execute 115 sec latency 2976.408 ms 2024-05-14T10:00:05.846 INFO:tasks.workunit.client.0.smithi135.stdout: 10 525 0.63 MB/sec execute 116 sec latency 3756.393 ms 2024-05-14T10:00:06.846 INFO:tasks.workunit.client.0.smithi135.stdout: 10 528 0.64 MB/sec execute 117 sec latency 4042.017 ms 2024-05-14T10:00:07.846 INFO:tasks.workunit.client.0.smithi135.stdout: 10 529 0.63 MB/sec execute 118 sec latency 4357.527 ms 2024-05-14T10:00:08.846 INFO:tasks.workunit.client.0.smithi135.stdout: 10 530 0.63 MB/sec execute 119 sec latency 3670.916 ms 2024-05-14T10:00:09.846 INFO:tasks.workunit.client.0.smithi135.stdout: 10 534 0.63 MB/sec execute 120 sec latency 4671.010 ms 2024-05-14T10:00:10.846 INFO:tasks.workunit.client.0.smithi135.stdout: 10 534 0.63 MB/sec execute 121 sec latency 5671.156 ms 2024-05-14T10:00:11.846 INFO:tasks.workunit.client.0.smithi135.stdout: 10 534 0.62 MB/sec execute 122 sec latency 6671.269 ms 2024-05-14T10:00:12.846 INFO:tasks.workunit.client.0.smithi135.stdout: 10 538 0.63 MB/sec execute 123 sec latency 7671.411 ms 2024-05-14T10:00:13.846 INFO:tasks.workunit.client.0.smithi135.stdout: 10 539 0.63 MB/sec execute 124 sec latency 8671.545 ms 2024-05-14T10:00:14.847 INFO:tasks.workunit.client.0.smithi135.stdout: 10 545 0.65 MB/sec execute 125 sec latency 9671.677 ms 2024-05-14T10:00:15.847 INFO:tasks.workunit.client.0.smithi135.stdout: 10 548 0.66 MB/sec execute 126 sec latency 10671.770 ms 2024-05-14T10:00:16.847 INFO:tasks.workunit.client.0.smithi135.stdout: 10 551 0.66 MB/sec execute 127 sec latency 10720.770 ms 2024-05-14T10:00:17.847 INFO:tasks.workunit.client.0.smithi135.stdout: 10 556 0.66 MB/sec execute 128 sec latency 2696.916 ms 2024-05-14T10:00:18.847 INFO:tasks.workunit.client.0.smithi135.stdout: 10 563 0.66 MB/sec execute 129 sec latency 2714.412 ms 2024-05-14T10:00:19.847 INFO:tasks.workunit.client.0.smithi135.stdout: 10 572 0.68 MB/sec execute 130 sec latency 3493.945 ms 2024-05-14T10:00:20.847 INFO:tasks.workunit.client.0.smithi135.stdout: 10 579 0.70 MB/sec execute 131 sec latency 4494.045 ms 2024-05-14T10:00:21.847 INFO:tasks.workunit.client.0.smithi135.stdout: 10 588 0.72 MB/sec execute 132 sec latency 4547.479 ms 2024-05-14T10:00:22.847 INFO:tasks.workunit.client.0.smithi135.stdout: 10 594 0.72 MB/sec execute 133 sec latency 4398.182 ms 2024-05-14T10:00:23.848 INFO:tasks.workunit.client.0.smithi135.stdout: 10 599 0.73 MB/sec execute 134 sec latency 5295.542 ms 2024-05-14T10:00:24.848 INFO:tasks.workunit.client.0.smithi135.stdout: 10 603 0.73 MB/sec execute 135 sec latency 4341.464 ms 2024-05-14T10:00:25.848 INFO:tasks.workunit.client.0.smithi135.stdout: 10 605 0.73 MB/sec execute 136 sec latency 4683.888 ms 2024-05-14T10:00:26.848 INFO:tasks.workunit.client.0.smithi135.stdout: 10 608 0.74 MB/sec execute 137 sec latency 4170.806 ms 2024-05-14T10:00:27.848 INFO:tasks.workunit.client.0.smithi135.stdout: 10 610 0.73 MB/sec execute 138 sec latency 4692.855 ms 2024-05-14T10:00:28.848 INFO:tasks.workunit.client.0.smithi135.stdout: 10 610 0.73 MB/sec execute 139 sec latency 4815.535 ms 2024-05-14T10:00:28.977 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:00:28.986 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:00:29.849 INFO:tasks.workunit.client.0.smithi135.stdout: 10 612 0.72 MB/sec execute 140 sec latency 5783.726 ms 2024-05-14T10:00:30.849 INFO:tasks.workunit.client.0.smithi135.stdout: 10 615 0.72 MB/sec execute 141 sec latency 5530.047 ms 2024-05-14T10:00:31.849 INFO:tasks.workunit.client.0.smithi135.stdout: 10 615 0.71 MB/sec execute 142 sec latency 4733.100 ms 2024-05-14T10:00:32.849 INFO:tasks.workunit.client.0.smithi135.stdout: 10 615 0.71 MB/sec execute 143 sec latency 4903.776 ms 2024-05-14T10:00:33.849 INFO:tasks.workunit.client.0.smithi135.stdout: 10 616 0.70 MB/sec execute 144 sec latency 5903.920 ms 2024-05-14T10:00:34.849 INFO:tasks.workunit.client.0.smithi135.stdout: 10 616 0.70 MB/sec execute 145 sec latency 6437.636 ms 2024-05-14T10:00:35.849 INFO:tasks.workunit.client.0.smithi135.stdout: 10 617 0.69 MB/sec execute 146 sec latency 6261.380 ms 2024-05-14T10:00:36.849 INFO:tasks.workunit.client.0.smithi135.stdout: 10 619 0.69 MB/sec execute 147 sec latency 6226.459 ms 2024-05-14T10:00:37.850 INFO:tasks.workunit.client.0.smithi135.stdout: 10 620 0.68 MB/sec execute 148 sec latency 3993.981 ms 2024-05-14T10:00:38.850 INFO:tasks.workunit.client.0.smithi135.stdout: 10 620 0.68 MB/sec execute 149 sec latency 4614.593 ms 2024-05-14T10:00:39.850 INFO:tasks.workunit.client.0.smithi135.stdout: 10 624 0.68 MB/sec execute 150 sec latency 4088.148 ms 2024-05-14T10:00:40.850 INFO:tasks.workunit.client.0.smithi135.stdout: 10 624 0.67 MB/sec execute 151 sec latency 5088.304 ms 2024-05-14T10:00:41.850 INFO:tasks.workunit.client.0.smithi135.stdout: 10 626 0.67 MB/sec execute 152 sec latency 5659.322 ms 2024-05-14T10:00:42.850 INFO:tasks.workunit.client.0.smithi135.stdout: 10 627 0.66 MB/sec execute 153 sec latency 6035.927 ms 2024-05-14T10:00:43.850 INFO:tasks.workunit.client.0.smithi135.stdout: 10 630 0.66 MB/sec execute 154 sec latency 6528.267 ms 2024-05-14T10:00:44.850 INFO:tasks.workunit.client.0.smithi135.stdout: 10 640 0.66 MB/sec execute 155 sec latency 5759.184 ms 2024-05-14T10:00:45.850 INFO:tasks.workunit.client.0.smithi135.stdout: 10 643 0.65 MB/sec execute 156 sec latency 5468.154 ms 2024-05-14T10:00:46.850 INFO:tasks.workunit.client.0.smithi135.stdout: 10 645 0.65 MB/sec execute 157 sec latency 3892.167 ms 2024-05-14T10:00:47.851 INFO:tasks.workunit.client.0.smithi135.stdout: 10 646 0.64 MB/sec execute 158 sec latency 2886.782 ms 2024-05-14T10:00:48.851 INFO:tasks.workunit.client.0.smithi135.stdout: 10 647 0.64 MB/sec execute 159 sec latency 3886.962 ms 2024-05-14T10:00:49.851 INFO:tasks.workunit.client.0.smithi135.stdout: 10 647 0.64 MB/sec execute 160 sec latency 4887.103 ms 2024-05-14T10:00:50.851 INFO:tasks.workunit.client.0.smithi135.stdout: 10 648 0.63 MB/sec execute 161 sec latency 5422.510 ms 2024-05-14T10:00:51.851 INFO:tasks.workunit.client.0.smithi135.stdout: 10 648 0.63 MB/sec execute 162 sec latency 5635.046 ms 2024-05-14T10:00:52.851 INFO:tasks.workunit.client.0.smithi135.stdout: 10 650 0.63 MB/sec execute 163 sec latency 5753.785 ms 2024-05-14T10:00:53.852 INFO:tasks.workunit.client.0.smithi135.stdout: 10 651 0.62 MB/sec execute 164 sec latency 5254.899 ms 2024-05-14T10:00:54.852 INFO:tasks.workunit.client.0.smithi135.stdout: 10 651 0.62 MB/sec execute 165 sec latency 2895.926 ms 2024-05-14T10:00:55.852 INFO:tasks.workunit.client.0.smithi135.stdout: 10 652 0.62 MB/sec execute 166 sec latency 3896.086 ms 2024-05-14T10:00:56.852 INFO:tasks.workunit.client.0.smithi135.stdout: 10 652 0.61 MB/sec execute 167 sec latency 4896.222 ms 2024-05-14T10:00:57.852 INFO:tasks.workunit.client.0.smithi135.stdout: 10 652 0.61 MB/sec execute 168 sec latency 5896.324 ms 2024-05-14T10:00:58.853 INFO:tasks.workunit.client.0.smithi135.stdout: 10 654 0.60 MB/sec execute 169 sec latency 6382.101 ms 2024-05-14T10:00:59.109 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:00:59.118 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:00:59.852 INFO:tasks.workunit.client.0.smithi135.stdout: 10 656 0.60 MB/sec execute 170 sec latency 6723.388 ms 2024-05-14T10:01:00.852 INFO:tasks.workunit.client.0.smithi135.stdout: 10 656 0.60 MB/sec execute 171 sec latency 4334.920 ms 2024-05-14T10:01:01.852 INFO:tasks.workunit.client.0.smithi135.stdout: 10 657 0.59 MB/sec execute 172 sec latency 2718.871 ms 2024-05-14T10:01:02.852 INFO:tasks.workunit.client.0.smithi135.stdout: 10 658 0.59 MB/sec execute 173 sec latency 3712.414 ms 2024-05-14T10:01:03.853 INFO:tasks.workunit.client.0.smithi135.stdout: 10 660 0.59 MB/sec execute 174 sec latency 4571.969 ms 2024-05-14T10:01:04.853 INFO:tasks.workunit.client.0.smithi135.stdout: 10 661 0.58 MB/sec execute 175 sec latency 4987.372 ms 2024-05-14T10:01:05.853 INFO:tasks.workunit.client.0.smithi135.stdout: 10 662 0.58 MB/sec execute 176 sec latency 4676.478 ms 2024-05-14T10:01:06.853 INFO:tasks.workunit.client.0.smithi135.stdout: 10 663 0.58 MB/sec execute 177 sec latency 5676.591 ms 2024-05-14T10:01:07.853 INFO:tasks.workunit.client.0.smithi135.stdout: 10 663 0.58 MB/sec execute 178 sec latency 6676.710 ms 2024-05-14T10:01:08.853 INFO:tasks.workunit.client.0.smithi135.stdout: 10 665 0.57 MB/sec execute 179 sec latency 7676.821 ms 2024-05-14T10:01:09.853 INFO:tasks.workunit.client.0.smithi135.stdout: 10 666 0.57 MB/sec execute 180 sec latency 7718.399 ms 2024-05-14T10:01:10.853 INFO:tasks.workunit.client.0.smithi135.stdout: 10 667 0.57 MB/sec execute 181 sec latency 8416.881 ms 2024-05-14T10:01:11.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 668 0.56 MB/sec execute 182 sec latency 8368.392 ms 2024-05-14T10:01:12.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 669 0.56 MB/sec execute 183 sec latency 8382.248 ms 2024-05-14T10:01:13.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 671 0.56 MB/sec execute 184 sec latency 3792.978 ms 2024-05-14T10:01:14.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 673 0.56 MB/sec execute 185 sec latency 4793.080 ms 2024-05-14T10:01:15.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 677 0.55 MB/sec execute 186 sec latency 5793.177 ms 2024-05-14T10:01:16.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 679 0.55 MB/sec execute 187 sec latency 6793.315 ms 2024-05-14T10:01:17.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 680 0.55 MB/sec execute 188 sec latency 6906.089 ms 2024-05-14T10:01:18.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 682 0.55 MB/sec execute 189 sec latency 2567.971 ms 2024-05-14T10:01:19.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 684 0.54 MB/sec execute 190 sec latency 3568.106 ms 2024-05-14T10:01:20.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 685 0.54 MB/sec execute 191 sec latency 4568.232 ms 2024-05-14T10:01:21.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 688 0.54 MB/sec execute 192 sec latency 5568.387 ms 2024-05-14T10:01:22.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 690 0.54 MB/sec execute 193 sec latency 6324.920 ms 2024-05-14T10:01:23.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 692 0.53 MB/sec execute 194 sec latency 4644.190 ms 2024-05-14T10:01:24.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 694 0.53 MB/sec execute 195 sec latency 4235.191 ms 2024-05-14T10:01:25.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 696 0.53 MB/sec execute 196 sec latency 4705.383 ms 2024-05-14T10:01:26.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 696 0.52 MB/sec execute 197 sec latency 4222.662 ms 2024-05-14T10:01:27.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 698 0.52 MB/sec execute 198 sec latency 5222.792 ms 2024-05-14T10:01:28.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 699 0.52 MB/sec execute 199 sec latency 6222.895 ms 2024-05-14T10:01:29.226 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:01:29.236 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:01:29.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 700 0.52 MB/sec execute 200 sec latency 6632.583 ms 2024-05-14T10:01:30.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 701 0.51 MB/sec execute 201 sec latency 5479.784 ms 2024-05-14T10:01:31.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 702 0.51 MB/sec execute 202 sec latency 6143.502 ms 2024-05-14T10:01:32.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 704 0.51 MB/sec execute 203 sec latency 5330.383 ms 2024-05-14T10:01:33.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 705 0.51 MB/sec execute 204 sec latency 6235.678 ms 2024-05-14T10:01:34.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 707 0.51 MB/sec execute 205 sec latency 6082.138 ms 2024-05-14T10:01:35.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 708 0.50 MB/sec execute 206 sec latency 7082.270 ms 2024-05-14T10:01:36.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 710 0.50 MB/sec execute 207 sec latency 7564.071 ms 2024-05-14T10:01:37.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 713 0.50 MB/sec execute 208 sec latency 6294.968 ms 2024-05-14T10:01:38.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 715 0.50 MB/sec execute 209 sec latency 7295.059 ms 2024-05-14T10:01:39.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 718 0.49 MB/sec execute 210 sec latency 7384.839 ms 2024-05-14T10:01:40.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 721 0.49 MB/sec execute 211 sec latency 2062.471 ms 2024-05-14T10:01:41.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 723 0.49 MB/sec execute 212 sec latency 2817.460 ms 2024-05-14T10:01:42.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 726 0.49 MB/sec execute 213 sec latency 2244.038 ms 2024-05-14T10:01:43.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 728 0.49 MB/sec execute 214 sec latency 2929.194 ms 2024-05-14T10:01:44.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 730 0.48 MB/sec execute 215 sec latency 3929.342 ms 2024-05-14T10:01:45.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 731 0.48 MB/sec execute 216 sec latency 4929.454 ms 2024-05-14T10:01:46.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 732 0.48 MB/sec execute 217 sec latency 5929.549 ms 2024-05-14T10:01:47.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 733 0.48 MB/sec execute 218 sec latency 6929.657 ms 2024-05-14T10:01:48.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 735 0.48 MB/sec execute 219 sec latency 7929.763 ms 2024-05-14T10:01:49.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 735 0.47 MB/sec execute 220 sec latency 8929.904 ms 2024-05-14T10:01:50.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 735 0.47 MB/sec execute 221 sec latency 9930.033 ms 2024-05-14T10:01:51.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 736 0.47 MB/sec execute 222 sec latency 10414.011 ms 2024-05-14T10:01:52.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 737 0.47 MB/sec execute 223 sec latency 9123.233 ms 2024-05-14T10:01:53.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 740 0.47 MB/sec execute 224 sec latency 9825.961 ms 2024-05-14T10:01:54.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 742 0.46 MB/sec execute 225 sec latency 4861.938 ms 2024-05-14T10:01:55.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 743 0.46 MB/sec execute 226 sec latency 4326.481 ms 2024-05-14T10:01:56.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 745 0.46 MB/sec execute 227 sec latency 5326.581 ms 2024-05-14T10:01:57.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 746 0.46 MB/sec execute 228 sec latency 6326.714 ms 2024-05-14T10:01:58.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 747 0.46 MB/sec execute 229 sec latency 7326.874 ms 2024-05-14T10:01:59.364 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:01:59.372 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:01:59.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 751 0.46 MB/sec execute 230 sec latency 7752.961 ms 2024-05-14T10:02:00.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 754 0.45 MB/sec execute 231 sec latency 7074.484 ms 2024-05-14T10:02:01.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 756 0.45 MB/sec execute 232 sec latency 7545.068 ms 2024-05-14T10:02:02.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 760 0.45 MB/sec execute 233 sec latency 6856.672 ms 2024-05-14T10:02:03.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 762 0.45 MB/sec execute 234 sec latency 1876.807 ms 2024-05-14T10:02:04.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 764 0.45 MB/sec execute 235 sec latency 2771.133 ms 2024-05-14T10:02:05.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 766 0.44 MB/sec execute 236 sec latency 3771.228 ms 2024-05-14T10:02:06.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 766 0.44 MB/sec execute 237 sec latency 4771.390 ms 2024-05-14T10:02:07.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 766 0.44 MB/sec execute 238 sec latency 5771.538 ms 2024-05-14T10:02:08.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 766 0.44 MB/sec execute 239 sec latency 6655.479 ms 2024-05-14T10:02:09.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 768 0.44 MB/sec execute 240 sec latency 5869.463 ms 2024-05-14T10:02:10.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 770 0.44 MB/sec execute 241 sec latency 6869.605 ms 2024-05-14T10:02:11.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 770 0.43 MB/sec execute 242 sec latency 7869.728 ms 2024-05-14T10:02:12.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 771 0.43 MB/sec execute 243 sec latency 7959.871 ms 2024-05-14T10:02:13.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 773 0.43 MB/sec execute 244 sec latency 8354.687 ms 2024-05-14T10:02:14.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 774 0.43 MB/sec execute 245 sec latency 8518.266 ms 2024-05-14T10:02:15.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 774 0.43 MB/sec execute 246 sec latency 3887.951 ms 2024-05-14T10:02:16.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 774 0.43 MB/sec execute 247 sec latency 4888.134 ms 2024-05-14T10:02:17.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 776 0.42 MB/sec execute 248 sec latency 5888.250 ms 2024-05-14T10:02:18.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 777 0.42 MB/sec execute 249 sec latency 6360.765 ms 2024-05-14T10:02:19.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 781 0.42 MB/sec execute 250 sec latency 6559.633 ms 2024-05-14T10:02:20.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 786 0.42 MB/sec execute 251 sec latency 7168.593 ms 2024-05-14T10:02:21.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 790 0.42 MB/sec execute 252 sec latency 1466.351 ms 2024-05-14T10:02:22.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 792 0.42 MB/sec execute 253 sec latency 2466.484 ms 2024-05-14T10:02:23.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 794 0.42 MB/sec execute 254 sec latency 3466.611 ms 2024-05-14T10:02:24.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 796 0.41 MB/sec execute 255 sec latency 4466.768 ms 2024-05-14T10:02:25.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 797 0.41 MB/sec execute 256 sec latency 5466.878 ms 2024-05-14T10:02:26.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 798 0.41 MB/sec execute 257 sec latency 5831.580 ms 2024-05-14T10:02:27.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 799 0.41 MB/sec execute 258 sec latency 4244.241 ms 2024-05-14T10:02:28.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 799 0.41 MB/sec execute 259 sec latency 5244.347 ms 2024-05-14T10:02:29.719 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:02:29.730 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:02:29.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 800 0.41 MB/sec execute 260 sec latency 6244.482 ms 2024-05-14T10:02:30.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 800 0.40 MB/sec execute 261 sec latency 7244.600 ms 2024-05-14T10:02:31.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 800 0.40 MB/sec execute 262 sec latency 8244.759 ms 2024-05-14T10:02:32.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 802 0.40 MB/sec execute 263 sec latency 9034.910 ms 2024-05-14T10:02:33.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 804 0.40 MB/sec execute 264 sec latency 7643.781 ms 2024-05-14T10:02:34.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 805 0.40 MB/sec execute 265 sec latency 1627.334 ms 2024-05-14T10:02:35.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 807 0.40 MB/sec execute 266 sec latency 2627.482 ms 2024-05-14T10:02:36.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 808 0.40 MB/sec execute 267 sec latency 3627.613 ms 2024-05-14T10:02:37.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 809 0.40 MB/sec execute 268 sec latency 4627.705 ms 2024-05-14T10:02:38.865 INFO:tasks.workunit.client.0.smithi135.stdout: 10 810 0.39 MB/sec execute 269 sec latency 5627.814 ms 2024-05-14T10:02:39.865 INFO:tasks.workunit.client.0.smithi135.stdout: 10 812 0.39 MB/sec execute 270 sec latency 6627.946 ms 2024-05-14T10:02:40.865 INFO:tasks.workunit.client.0.smithi135.stdout: 10 814 0.39 MB/sec execute 271 sec latency 7389.155 ms 2024-05-14T10:02:41.865 INFO:tasks.workunit.client.0.smithi135.stdout: 10 820 0.39 MB/sec execute 272 sec latency 7432.056 ms 2024-05-14T10:02:42.865 INFO:tasks.workunit.client.0.smithi135.stdout: 10 821 0.39 MB/sec execute 273 sec latency 1449.424 ms 2024-05-14T10:02:43.865 INFO:tasks.workunit.client.0.smithi135.stdout: 10 823 0.39 MB/sec execute 274 sec latency 2446.792 ms 2024-05-14T10:02:44.865 INFO:tasks.workunit.client.0.smithi135.stdout: 10 823 0.39 MB/sec execute 275 sec latency 3446.922 ms 2024-05-14T10:02:45.865 INFO:tasks.workunit.client.0.smithi135.stdout: 10 823 0.39 MB/sec execute 276 sec latency 4447.036 ms 2024-05-14T10:02:46.865 INFO:tasks.workunit.client.0.smithi135.stdout: 10 823 0.38 MB/sec execute 277 sec latency 5447.171 ms 2024-05-14T10:02:47.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 823 0.38 MB/sec execute 278 sec latency 6346.299 ms 2024-05-14T10:02:48.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 823 0.38 MB/sec execute 279 sec latency 6589.384 ms 2024-05-14T10:02:49.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 826 0.38 MB/sec execute 280 sec latency 6609.652 ms 2024-05-14T10:02:50.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 828 0.38 MB/sec execute 281 sec latency 6707.773 ms 2024-05-14T10:02:51.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 828 0.38 MB/sec execute 282 sec latency 4101.442 ms 2024-05-14T10:02:52.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 828 0.38 MB/sec execute 283 sec latency 5087.506 ms 2024-05-14T10:02:53.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 828 0.37 MB/sec execute 284 sec latency 4994.384 ms 2024-05-14T10:02:54.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 829 0.37 MB/sec execute 285 sec latency 4826.245 ms 2024-05-14T10:02:55.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 830 0.37 MB/sec execute 286 sec latency 5732.756 ms 2024-05-14T10:02:56.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 837 0.37 MB/sec execute 287 sec latency 5767.381 ms 2024-05-14T10:02:57.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 839 0.37 MB/sec execute 288 sec latency 2934.647 ms 2024-05-14T10:02:58.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 840 0.37 MB/sec execute 289 sec latency 3934.740 ms 2024-05-14T10:02:59.838 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:02:59.846 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:02:59.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 840 0.37 MB/sec execute 290 sec latency 4934.816 ms 2024-05-14T10:03:00.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 842 0.37 MB/sec execute 291 sec latency 5456.443 ms 2024-05-14T10:03:01.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 842 0.37 MB/sec execute 292 sec latency 5095.228 ms 2024-05-14T10:03:02.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 842 0.36 MB/sec execute 293 sec latency 5729.542 ms 2024-05-14T10:03:03.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 843 0.36 MB/sec execute 294 sec latency 5428.043 ms 2024-05-14T10:03:04.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 844 0.36 MB/sec execute 295 sec latency 5448.365 ms 2024-05-14T10:03:05.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 845 0.36 MB/sec execute 296 sec latency 4849.967 ms 2024-05-14T10:03:06.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 846 0.36 MB/sec execute 297 sec latency 5850.113 ms 2024-05-14T10:03:07.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 851 0.36 MB/sec execute 298 sec latency 5959.699 ms 2024-05-14T10:03:08.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 854 0.36 MB/sec execute 299 sec latency 5287.265 ms 2024-05-14T10:03:09.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 856 0.36 MB/sec execute 300 sec latency 5918.886 ms 2024-05-14T10:03:10.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 859 0.36 MB/sec execute 301 sec latency 5929.385 ms 2024-05-14T10:03:11.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 861 0.35 MB/sec execute 302 sec latency 2224.767 ms 2024-05-14T10:03:12.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 863 0.35 MB/sec execute 303 sec latency 3224.906 ms 2024-05-14T10:03:13.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 864 0.35 MB/sec execute 304 sec latency 4225.041 ms 2024-05-14T10:03:14.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 864 0.35 MB/sec execute 305 sec latency 5225.255 ms 2024-05-14T10:03:15.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 865 0.35 MB/sec execute 306 sec latency 6225.349 ms 2024-05-14T10:03:16.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 866 0.35 MB/sec execute 307 sec latency 6444.923 ms 2024-05-14T10:03:17.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 866 0.35 MB/sec execute 308 sec latency 7213.234 ms 2024-05-14T10:03:18.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 867 0.35 MB/sec execute 309 sec latency 6590.472 ms 2024-05-14T10:03:19.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 867 0.35 MB/sec execute 310 sec latency 7127.370 ms 2024-05-14T10:03:20.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 868 0.35 MB/sec execute 311 sec latency 7232.835 ms 2024-05-14T10:03:21.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 869 0.34 MB/sec execute 312 sec latency 8071.405 ms 2024-05-14T10:03:22.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 870 0.34 MB/sec execute 313 sec latency 8236.112 ms 2024-05-14T10:03:23.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 872 0.34 MB/sec execute 314 sec latency 7153.873 ms 2024-05-14T10:03:24.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 873 0.34 MB/sec execute 315 sec latency 5463.900 ms 2024-05-14T10:03:25.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 876 0.34 MB/sec execute 316 sec latency 5987.376 ms 2024-05-14T10:03:26.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 877 0.34 MB/sec execute 317 sec latency 2436.499 ms 2024-05-14T10:03:27.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 879 0.34 MB/sec execute 318 sec latency 2178.104 ms 2024-05-14T10:03:28.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 881 0.34 MB/sec execute 319 sec latency 3009.642 ms 2024-05-14T10:03:29.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 883 0.34 MB/sec execute 320 sec latency 4009.778 ms 2024-05-14T10:03:29.964 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:03:29.972 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:03:30.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 884 0.34 MB/sec execute 321 sec latency 5009.915 ms 2024-05-14T10:03:31.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 884 0.33 MB/sec execute 322 sec latency 6010.054 ms 2024-05-14T10:03:32.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 884 0.33 MB/sec execute 323 sec latency 7010.175 ms 2024-05-14T10:03:33.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 884 0.33 MB/sec execute 324 sec latency 7418.190 ms 2024-05-14T10:03:34.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 885 0.33 MB/sec execute 325 sec latency 7311.324 ms 2024-05-14T10:03:35.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 885 0.33 MB/sec execute 326 sec latency 6541.078 ms 2024-05-14T10:03:36.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 888 0.33 MB/sec execute 327 sec latency 7355.984 ms 2024-05-14T10:03:37.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 890 0.33 MB/sec execute 328 sec latency 7447.523 ms 2024-05-14T10:03:38.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 893 0.33 MB/sec execute 329 sec latency 6450.652 ms 2024-05-14T10:03:39.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 894 0.33 MB/sec execute 330 sec latency 4847.861 ms 2024-05-14T10:03:40.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 897 0.33 MB/sec execute 331 sec latency 2400.906 ms 2024-05-14T10:03:41.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 899 0.33 MB/sec execute 332 sec latency 3401.053 ms 2024-05-14T10:03:42.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 900 0.33 MB/sec execute 333 sec latency 4401.201 ms 2024-05-14T10:03:43.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 900 0.32 MB/sec execute 334 sec latency 5401.332 ms 2024-05-14T10:03:44.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 901 0.32 MB/sec execute 335 sec latency 6396.507 ms 2024-05-14T10:03:45.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 902 0.32 MB/sec execute 336 sec latency 5855.750 ms 2024-05-14T10:03:46.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 902 0.32 MB/sec execute 337 sec latency 5821.567 ms 2024-05-14T10:03:47.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 903 0.32 MB/sec execute 338 sec latency 6821.701 ms 2024-05-14T10:03:48.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 905 0.32 MB/sec execute 339 sec latency 7607.048 ms 2024-05-14T10:03:49.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 906 0.32 MB/sec execute 340 sec latency 6631.057 ms 2024-05-14T10:03:50.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 909 0.32 MB/sec execute 341 sec latency 5551.520 ms 2024-05-14T10:03:51.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 912 0.32 MB/sec execute 342 sec latency 6150.040 ms 2024-05-14T10:03:52.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 913 0.32 MB/sec execute 343 sec latency 3756.678 ms 2024-05-14T10:03:53.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 914 0.32 MB/sec execute 344 sec latency 4756.785 ms 2024-05-14T10:03:54.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 916 0.31 MB/sec execute 345 sec latency 5263.583 ms 2024-05-14T10:03:55.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 918 0.31 MB/sec execute 346 sec latency 4928.947 ms 2024-05-14T10:03:56.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 918 0.31 MB/sec execute 347 sec latency 5929.096 ms 2024-05-14T10:03:57.492 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:24:18.958 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:03:57.500 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:24:18.966 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:03:57.531 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:24:19.010 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:03:57.646 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:24:19.123 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:03:57.653 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:24:19.129 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:03:57.661 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:24:19.140 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:03:57.683 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:24:19.149 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:03:57.824 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:24:19.300 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:03:57.835 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:24:19.314 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:03:57.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 918 0.31 MB/sec execute 348 sec latency 6929.181 ms 2024-05-14T10:03:58.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 920 0.31 MB/sec execute 349 sec latency 7202.808 ms 2024-05-14T10:03:59.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 920 0.31 MB/sec execute 350 sec latency 6606.564 ms 2024-05-14T10:04:00.128 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:04:00.137 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:04:00.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 921 0.31 MB/sec execute 351 sec latency 5411.425 ms 2024-05-14T10:04:01.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 922 0.31 MB/sec execute 352 sec latency 6411.566 ms 2024-05-14T10:04:02.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 924 0.31 MB/sec execute 353 sec latency 7279.094 ms 2024-05-14T10:04:03.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 926 0.31 MB/sec execute 354 sec latency 7249.607 ms 2024-05-14T10:04:04.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 928 0.31 MB/sec execute 355 sec latency 7426.381 ms 2024-05-14T10:04:05.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 929 0.31 MB/sec execute 356 sec latency 6178.404 ms 2024-05-14T10:04:06.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 929 0.31 MB/sec execute 357 sec latency 5264.870 ms 2024-05-14T10:04:07.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 930 0.30 MB/sec execute 358 sec latency 6246.860 ms 2024-05-14T10:04:08.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 931 0.30 MB/sec execute 359 sec latency 6278.847 ms 2024-05-14T10:04:09.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 932 0.30 MB/sec execute 360 sec latency 5722.035 ms 2024-05-14T10:04:10.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 933 0.30 MB/sec execute 361 sec latency 4196.419 ms 2024-05-14T10:04:11.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 933 0.30 MB/sec execute 362 sec latency 4778.999 ms 2024-05-14T10:04:12.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 934 0.30 MB/sec execute 363 sec latency 5330.385 ms 2024-05-14T10:04:13.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 936 0.30 MB/sec execute 364 sec latency 4806.626 ms 2024-05-14T10:04:14.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 937 0.30 MB/sec execute 365 sec latency 3488.443 ms 2024-05-14T10:04:15.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 937 0.30 MB/sec execute 366 sec latency 4488.545 ms 2024-05-14T10:04:16.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 937 0.30 MB/sec execute 367 sec latency 5488.682 ms 2024-05-14T10:04:17.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 939 0.30 MB/sec execute 368 sec latency 5896.450 ms 2024-05-14T10:04:18.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 939 0.30 MB/sec execute 369 sec latency 6034.246 ms 2024-05-14T10:04:19.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 940 0.30 MB/sec execute 370 sec latency 6089.977 ms 2024-05-14T10:04:20.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 941 0.29 MB/sec execute 371 sec latency 5017.691 ms 2024-05-14T10:04:21.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 941 0.29 MB/sec execute 372 sec latency 6017.783 ms 2024-05-14T10:04:22.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 943 0.29 MB/sec execute 373 sec latency 7001.653 ms 2024-05-14T10:04:23.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 944 0.29 MB/sec execute 374 sec latency 5820.825 ms 2024-05-14T10:04:24.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 946 0.29 MB/sec execute 375 sec latency 5248.710 ms 2024-05-14T10:04:25.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 947 0.29 MB/sec execute 376 sec latency 6248.807 ms 2024-05-14T10:04:26.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 949 0.29 MB/sec execute 377 sec latency 6535.820 ms 2024-05-14T10:04:27.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 949 0.29 MB/sec execute 378 sec latency 4388.670 ms 2024-05-14T10:04:28.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 950 0.29 MB/sec execute 379 sec latency 5388.791 ms 2024-05-14T10:04:29.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 951 0.29 MB/sec execute 380 sec latency 6255.059 ms 2024-05-14T10:04:30.238 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:04:30.246 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:04:30.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 951 0.29 MB/sec execute 381 sec latency 6224.719 ms 2024-05-14T10:04:31.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 954 0.29 MB/sec execute 382 sec latency 5581.922 ms 2024-05-14T10:04:32.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 955 0.29 MB/sec execute 383 sec latency 5876.536 ms 2024-05-14T10:04:33.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 958 0.29 MB/sec execute 384 sec latency 6264.381 ms 2024-05-14T10:04:34.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 960 0.29 MB/sec execute 385 sec latency 5142.788 ms 2024-05-14T10:04:35.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 962 0.29 MB/sec execute 386 sec latency 5757.892 ms 2024-05-14T10:04:36.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 965 0.29 MB/sec execute 387 sec latency 5598.319 ms 2024-05-14T10:04:37.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 968 0.29 MB/sec execute 388 sec latency 5878.724 ms 2024-05-14T10:04:38.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 969 0.29 MB/sec execute 389 sec latency 5423.535 ms 2024-05-14T10:04:39.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 969 0.29 MB/sec execute 390 sec latency 5690.181 ms 2024-05-14T10:04:40.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 971 0.29 MB/sec execute 391 sec latency 5808.257 ms 2024-05-14T10:04:41.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 971 0.28 MB/sec execute 392 sec latency 6005.359 ms 2024-05-14T10:04:42.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 971 0.28 MB/sec execute 393 sec latency 7005.501 ms 2024-05-14T10:04:43.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 973 0.28 MB/sec execute 394 sec latency 7070.712 ms 2024-05-14T10:04:44.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 975 0.28 MB/sec execute 395 sec latency 7201.569 ms 2024-05-14T10:04:45.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 978 0.28 MB/sec execute 396 sec latency 7226.557 ms 2024-05-14T10:04:46.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 979 0.28 MB/sec execute 397 sec latency 6075.256 ms 2024-05-14T10:04:47.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 982 0.28 MB/sec execute 398 sec latency 7075.403 ms 2024-05-14T10:04:48.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 984 0.28 MB/sec execute 399 sec latency 8075.559 ms 2024-05-14T10:04:49.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 986 0.28 MB/sec execute 400 sec latency 8201.830 ms 2024-05-14T10:04:50.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 989 0.28 MB/sec execute 401 sec latency 6073.812 ms 2024-05-14T10:04:51.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 991 0.28 MB/sec execute 402 sec latency 6360.307 ms 2024-05-14T10:04:52.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 992 0.28 MB/sec execute 403 sec latency 5090.662 ms 2024-05-14T10:04:53.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 993 0.28 MB/sec execute 404 sec latency 6090.757 ms 2024-05-14T10:04:54.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 995 0.28 MB/sec execute 405 sec latency 7090.862 ms 2024-05-14T10:04:55.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 996 0.28 MB/sec execute 406 sec latency 7930.265 ms 2024-05-14T10:04:56.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 997 0.28 MB/sec execute 407 sec latency 7935.445 ms 2024-05-14T10:04:57.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 997 0.28 MB/sec execute 408 sec latency 8935.577 ms 2024-05-14T10:04:58.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 998 0.28 MB/sec execute 409 sec latency 9935.676 ms 2024-05-14T10:04:59.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 999 0.28 MB/sec execute 410 sec latency 10715.200 ms 2024-05-14T10:05:00.354 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:05:00.363 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:05:00.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1002 0.28 MB/sec execute 411 sec latency 10860.047 ms 2024-05-14T10:05:01.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1004 0.28 MB/sec execute 412 sec latency 8058.050 ms 2024-05-14T10:05:02.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1006 0.28 MB/sec execute 413 sec latency 8129.551 ms 2024-05-14T10:05:03.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1007 0.28 MB/sec execute 414 sec latency 7916.636 ms 2024-05-14T10:05:04.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1010 0.28 MB/sec execute 415 sec latency 8916.755 ms 2024-05-14T10:05:05.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1013 0.28 MB/sec execute 416 sec latency 9779.252 ms 2024-05-14T10:05:06.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1014 0.28 MB/sec execute 417 sec latency 6015.361 ms 2024-05-14T10:05:07.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1016 0.28 MB/sec execute 418 sec latency 7015.468 ms 2024-05-14T10:05:08.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1018 0.28 MB/sec execute 419 sec latency 8015.602 ms 2024-05-14T10:05:09.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1019 0.28 MB/sec execute 420 sec latency 8304.450 ms 2024-05-14T10:05:10.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1019 0.28 MB/sec execute 421 sec latency 5903.957 ms 2024-05-14T10:05:11.884 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1022 0.28 MB/sec execute 422 sec latency 6529.352 ms 2024-05-14T10:05:12.884 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1023 0.28 MB/sec execute 423 sec latency 6457.889 ms 2024-05-14T10:05:13.884 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1024 0.28 MB/sec execute 424 sec latency 6570.252 ms 2024-05-14T10:05:14.884 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1027 0.28 MB/sec execute 425 sec latency 6026.440 ms 2024-05-14T10:05:15.884 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1031 0.28 MB/sec execute 426 sec latency 6255.193 ms 2024-05-14T10:05:16.884 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1033 0.28 MB/sec execute 427 sec latency 5375.333 ms 2024-05-14T10:05:17.884 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1034 0.28 MB/sec execute 428 sec latency 5783.887 ms 2024-05-14T10:05:18.885 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1035 0.28 MB/sec execute 429 sec latency 6585.802 ms 2024-05-14T10:05:19.885 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1035 0.28 MB/sec execute 430 sec latency 6753.152 ms 2024-05-14T10:05:20.885 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1036 0.28 MB/sec execute 431 sec latency 4789.867 ms 2024-05-14T10:05:21.885 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1037 0.28 MB/sec execute 432 sec latency 5789.998 ms 2024-05-14T10:05:22.885 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1038 0.28 MB/sec execute 433 sec latency 5990.030 ms 2024-05-14T10:05:23.885 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1039 0.28 MB/sec execute 434 sec latency 5130.270 ms 2024-05-14T10:05:24.885 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1040 0.28 MB/sec execute 435 sec latency 5883.408 ms 2024-05-14T10:05:25.885 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1042 0.28 MB/sec execute 436 sec latency 6717.355 ms 2024-05-14T10:05:26.885 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1043 0.27 MB/sec execute 437 sec latency 4952.989 ms 2024-05-14T10:05:27.886 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1044 0.27 MB/sec execute 438 sec latency 5554.291 ms 2024-05-14T10:05:28.886 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1044 0.27 MB/sec execute 439 sec latency 5061.679 ms 2024-05-14T10:05:29.886 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1045 0.27 MB/sec execute 440 sec latency 5683.015 ms 2024-05-14T10:05:30.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:05:30.489 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:05:30.886 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1046 0.27 MB/sec execute 441 sec latency 5166.730 ms 2024-05-14T10:05:31.886 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1047 0.27 MB/sec execute 442 sec latency 6036.596 ms 2024-05-14T10:05:32.886 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1048 0.27 MB/sec execute 443 sec latency 6595.361 ms 2024-05-14T10:05:33.886 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1049 0.27 MB/sec execute 444 sec latency 6399.509 ms 2024-05-14T10:05:34.887 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1052 0.27 MB/sec execute 445 sec latency 6613.835 ms 2024-05-14T10:05:35.887 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1053 0.27 MB/sec execute 446 sec latency 3790.818 ms 2024-05-14T10:05:36.887 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1054 0.27 MB/sec execute 447 sec latency 4790.945 ms 2024-05-14T10:05:37.887 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1055 0.27 MB/sec execute 448 sec latency 5791.108 ms 2024-05-14T10:05:38.482 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:25:59.948 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:05:38.489 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:25:59.955 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:05:38.582 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:26:00.047 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:05:38.608 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:26:00.087 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:05:38.649 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:26:00.125 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:05:38.656 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:26:00.132 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:05:38.681 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:26:00.160 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:05:38.721 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:26:00.197 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:05:38.739 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:26:00.218 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:05:38.887 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1056 0.27 MB/sec execute 449 sec latency 6317.103 ms 2024-05-14T10:05:39.887 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1057 0.27 MB/sec execute 450 sec latency 5867.856 ms 2024-05-14T10:05:40.887 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1057 0.27 MB/sec execute 451 sec latency 4073.473 ms 2024-05-14T10:05:41.887 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1058 0.27 MB/sec execute 452 sec latency 5073.603 ms 2024-05-14T10:05:42.888 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1059 0.27 MB/sec execute 453 sec latency 5995.209 ms 2024-05-14T10:05:43.888 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1061 0.27 MB/sec execute 454 sec latency 6181.500 ms 2024-05-14T10:05:44.888 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1061 0.26 MB/sec execute 455 sec latency 6474.827 ms 2024-05-14T10:05:45.888 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1062 0.26 MB/sec execute 456 sec latency 6818.781 ms 2024-05-14T10:05:46.888 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1062 0.26 MB/sec execute 457 sec latency 7041.763 ms 2024-05-14T10:05:47.888 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1063 0.26 MB/sec execute 458 sec latency 5079.099 ms 2024-05-14T10:05:48.888 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1065 0.26 MB/sec execute 459 sec latency 6079.262 ms 2024-05-14T10:05:49.890 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1066 0.26 MB/sec execute 460 sec latency 6633.430 ms 2024-05-14T10:05:50.888 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1068 0.26 MB/sec execute 461 sec latency 5837.848 ms 2024-05-14T10:05:51.889 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1070 0.26 MB/sec execute 462 sec latency 5404.854 ms 2024-05-14T10:05:52.889 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1070 0.26 MB/sec execute 463 sec latency 5931.799 ms 2024-05-14T10:05:53.889 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1071 0.26 MB/sec execute 464 sec latency 4666.765 ms 2024-05-14T10:05:54.889 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1072 0.26 MB/sec execute 465 sec latency 5666.900 ms 2024-05-14T10:05:55.889 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1074 0.26 MB/sec execute 466 sec latency 6411.837 ms 2024-05-14T10:05:56.889 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1076 0.26 MB/sec execute 467 sec latency 6695.690 ms 2024-05-14T10:05:57.889 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1078 0.26 MB/sec execute 468 sec latency 5948.985 ms 2024-05-14T10:05:58.890 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1080 0.26 MB/sec execute 469 sec latency 6949.128 ms 2024-05-14T10:05:59.890 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1082 0.26 MB/sec execute 470 sec latency 7949.253 ms 2024-05-14T10:06:00.673 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:06:00.684 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:06:00.890 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1083 0.26 MB/sec execute 471 sec latency 8004.136 ms 2024-05-14T10:06:01.890 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1083 0.26 MB/sec execute 472 sec latency 5568.643 ms 2024-05-14T10:06:02.890 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1085 0.25 MB/sec execute 473 sec latency 6568.756 ms 2024-05-14T10:06:03.890 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1087 0.25 MB/sec execute 474 sec latency 6997.105 ms 2024-05-14T10:06:04.890 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1089 0.25 MB/sec execute 475 sec latency 6834.205 ms 2024-05-14T10:06:05.890 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1090 0.25 MB/sec execute 476 sec latency 7521.030 ms 2024-05-14T10:06:06.890 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1091 0.25 MB/sec execute 477 sec latency 6863.768 ms 2024-05-14T10:06:07.890 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1092 0.25 MB/sec execute 478 sec latency 7863.897 ms 2024-05-14T10:06:08.891 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1095 0.25 MB/sec execute 479 sec latency 8218.749 ms 2024-05-14T10:06:09.891 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1097 0.25 MB/sec execute 480 sec latency 6469.789 ms 2024-05-14T10:06:10.891 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1099 0.25 MB/sec execute 481 sec latency 5248.208 ms 2024-05-14T10:06:11.891 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1101 0.25 MB/sec execute 482 sec latency 5385.969 ms 2024-05-14T10:06:12.891 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1103 0.25 MB/sec execute 483 sec latency 5028.823 ms 2024-05-14T10:06:13.891 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1103 0.25 MB/sec execute 484 sec latency 2705.526 ms 2024-05-14T10:06:14.891 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1105 0.25 MB/sec execute 485 sec latency 2803.691 ms 2024-05-14T10:06:15.892 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1108 0.25 MB/sec execute 486 sec latency 2674.523 ms 2024-05-14T10:06:16.892 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1109 0.25 MB/sec execute 487 sec latency 3102.403 ms 2024-05-14T10:06:17.892 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1110 0.25 MB/sec execute 488 sec latency 4102.542 ms 2024-05-14T10:06:18.892 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1111 0.25 MB/sec execute 489 sec latency 5102.710 ms 2024-05-14T10:06:19.892 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1112 0.25 MB/sec execute 490 sec latency 5873.449 ms 2024-05-14T10:06:20.892 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1113 0.25 MB/sec execute 491 sec latency 5685.224 ms 2024-05-14T10:06:21.892 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1115 0.25 MB/sec execute 492 sec latency 6124.134 ms 2024-05-14T10:06:22.892 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1117 0.25 MB/sec execute 493 sec latency 6254.815 ms 2024-05-14T10:06:23.892 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1118 0.24 MB/sec execute 494 sec latency 5525.694 ms 2024-05-14T10:06:24.893 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1120 0.24 MB/sec execute 495 sec latency 2925.351 ms 2024-05-14T10:06:25.893 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1121 0.24 MB/sec execute 496 sec latency 3797.336 ms 2024-05-14T10:06:26.893 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1124 0.24 MB/sec execute 497 sec latency 4797.481 ms 2024-05-14T10:06:27.893 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1124 0.24 MB/sec execute 498 sec latency 5797.616 ms 2024-05-14T10:06:28.893 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1125 0.24 MB/sec execute 499 sec latency 6797.728 ms 2024-05-14T10:06:29.894 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1125 0.24 MB/sec execute 500 sec latency 7797.828 ms 2024-05-14T10:06:30.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:06:30.847 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:06:30.893 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1126 0.24 MB/sec execute 501 sec latency 8294.711 ms 2024-05-14T10:06:31.893 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1127 0.24 MB/sec execute 502 sec latency 6784.897 ms 2024-05-14T10:06:32.894 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1129 0.24 MB/sec execute 503 sec latency 5848.032 ms 2024-05-14T10:06:33.894 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1130 0.24 MB/sec execute 504 sec latency 5053.404 ms 2024-05-14T10:06:34.894 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1132 0.24 MB/sec execute 505 sec latency 2120.212 ms 2024-05-14T10:06:35.894 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1135 0.24 MB/sec execute 506 sec latency 3120.309 ms 2024-05-14T10:06:36.894 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1137 0.24 MB/sec execute 507 sec latency 3793.576 ms 2024-05-14T10:06:37.894 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1139 0.24 MB/sec execute 508 sec latency 4793.713 ms 2024-05-14T10:06:38.894 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1140 0.24 MB/sec execute 509 sec latency 5070.927 ms 2024-05-14T10:06:39.894 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1140 0.24 MB/sec execute 510 sec latency 4401.143 ms 2024-05-14T10:06:40.895 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1142 0.24 MB/sec execute 511 sec latency 4750.710 ms 2024-05-14T10:06:41.895 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1143 0.24 MB/sec execute 512 sec latency 4170.053 ms 2024-05-14T10:06:42.895 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1144 0.24 MB/sec execute 513 sec latency 4592.827 ms 2024-05-14T10:06:43.895 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1145 0.24 MB/sec execute 514 sec latency 4375.239 ms 2024-05-14T10:06:44.895 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1146 0.24 MB/sec execute 515 sec latency 5375.367 ms 2024-05-14T10:06:45.895 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1148 0.23 MB/sec execute 516 sec latency 6375.495 ms 2024-05-14T10:06:46.895 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1149 0.23 MB/sec execute 517 sec latency 6569.907 ms 2024-05-14T10:06:47.895 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1151 0.23 MB/sec execute 518 sec latency 5577.973 ms 2024-05-14T10:06:48.896 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1153 0.23 MB/sec execute 519 sec latency 6578.114 ms 2024-05-14T10:06:49.896 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1153 0.23 MB/sec execute 520 sec latency 7578.302 ms 2024-05-14T10:06:50.896 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1155 0.23 MB/sec execute 521 sec latency 7735.462 ms 2024-05-14T10:06:51.896 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1156 0.23 MB/sec execute 522 sec latency 5615.398 ms 2024-05-14T10:06:52.896 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1156 0.23 MB/sec execute 523 sec latency 5912.443 ms 2024-05-14T10:06:53.896 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1157 0.23 MB/sec execute 524 sec latency 3843.397 ms 2024-05-14T10:06:54.897 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1158 0.23 MB/sec execute 525 sec latency 4843.542 ms 2024-05-14T10:06:55.897 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1160 0.23 MB/sec execute 526 sec latency 5843.686 ms 2024-05-14T10:06:56.897 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1162 0.23 MB/sec execute 527 sec latency 6843.830 ms 2024-05-14T10:06:57.897 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1164 0.23 MB/sec execute 528 sec latency 7313.911 ms 2024-05-14T10:06:58.897 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1165 0.23 MB/sec execute 529 sec latency 1959.520 ms 2024-05-14T10:06:59.897 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1167 0.23 MB/sec execute 530 sec latency 2959.612 ms 2024-05-14T10:07:00.897 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1168 0.23 MB/sec execute 531 sec latency 3959.727 ms 2024-05-14T10:07:01.000 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:07:01.009 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:07:01.897 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1169 0.23 MB/sec execute 532 sec latency 4959.854 ms 2024-05-14T10:07:02.897 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1170 0.23 MB/sec execute 533 sec latency 5508.636 ms 2024-05-14T10:07:03.898 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1170 0.23 MB/sec execute 534 sec latency 6132.186 ms 2024-05-14T10:07:04.898 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1171 0.23 MB/sec execute 535 sec latency 4869.087 ms 2024-05-14T10:07:05.898 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1172 0.23 MB/sec execute 536 sec latency 5533.813 ms 2024-05-14T10:07:06.898 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1173 0.23 MB/sec execute 537 sec latency 5209.458 ms 2024-05-14T10:07:07.898 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1174 0.23 MB/sec execute 538 sec latency 6177.132 ms 2024-05-14T10:07:08.898 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1176 0.23 MB/sec execute 539 sec latency 6403.915 ms 2024-05-14T10:07:09.898 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1178 0.23 MB/sec execute 540 sec latency 6196.841 ms 2024-05-14T10:07:10.899 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1179 0.22 MB/sec execute 541 sec latency 2773.589 ms 2024-05-14T10:07:11.899 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1180 0.22 MB/sec execute 542 sec latency 3773.740 ms 2024-05-14T10:07:12.899 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1181 0.22 MB/sec execute 543 sec latency 4773.905 ms 2024-05-14T10:07:13.900 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1182 0.22 MB/sec execute 544 sec latency 5387.792 ms 2024-05-14T10:07:14.899 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1183 0.22 MB/sec execute 545 sec latency 6387.954 ms 2024-05-14T10:07:15.899 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1184 0.22 MB/sec execute 546 sec latency 6926.335 ms 2024-05-14T10:07:16.899 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1184 0.22 MB/sec execute 547 sec latency 5431.115 ms 2024-05-14T10:07:17.900 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1185 0.22 MB/sec execute 548 sec latency 6431.256 ms 2024-05-14T10:07:18.900 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1187 0.22 MB/sec execute 549 sec latency 7014.395 ms 2024-05-14T10:07:19.900 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1187 0.22 MB/sec execute 550 sec latency 6676.748 ms 2024-05-14T10:07:20.900 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1187 0.22 MB/sec execute 551 sec latency 7676.881 ms 2024-05-14T10:07:21.900 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1189 0.22 MB/sec execute 552 sec latency 8316.441 ms 2024-05-14T10:07:22.900 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1191 0.22 MB/sec execute 553 sec latency 6366.225 ms 2024-05-14T10:07:23.900 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1192 0.22 MB/sec execute 554 sec latency 5713.535 ms 2024-05-14T10:07:24.900 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1193 0.22 MB/sec execute 555 sec latency 6713.686 ms 2024-05-14T10:07:25.901 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1193 0.22 MB/sec execute 556 sec latency 7038.243 ms 2024-05-14T10:07:26.901 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1195 0.22 MB/sec execute 557 sec latency 5357.299 ms 2024-05-14T10:07:27.901 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1197 0.22 MB/sec execute 558 sec latency 6117.803 ms 2024-05-14T10:07:28.901 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1198 0.22 MB/sec execute 559 sec latency 6092.338 ms 2024-05-14T10:07:29.901 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1199 0.22 MB/sec execute 560 sec latency 6648.175 ms 2024-05-14T10:07:30.901 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1200 0.22 MB/sec execute 561 sec latency 5442.821 ms 2024-05-14T10:07:31.257 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:07:31.266 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:07:31.901 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1201 0.22 MB/sec execute 562 sec latency 4251.249 ms 2024-05-14T10:07:32.901 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1204 0.22 MB/sec execute 563 sec latency 5251.384 ms 2024-05-14T10:07:33.902 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1205 0.22 MB/sec execute 564 sec latency 5393.314 ms 2024-05-14T10:07:34.902 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1208 0.22 MB/sec execute 565 sec latency 3141.226 ms 2024-05-14T10:07:35.902 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1210 0.22 MB/sec execute 566 sec latency 4141.352 ms 2024-05-14T10:07:36.902 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1211 0.21 MB/sec execute 567 sec latency 5141.508 ms 2024-05-14T10:07:37.902 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1212 0.21 MB/sec execute 568 sec latency 6141.641 ms 2024-05-14T10:07:38.902 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1213 0.21 MB/sec execute 569 sec latency 7098.587 ms 2024-05-14T10:07:39.902 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1215 0.21 MB/sec execute 570 sec latency 7141.144 ms 2024-05-14T10:07:40.902 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1216 0.21 MB/sec execute 571 sec latency 3118.066 ms 2024-05-14T10:07:41.903 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1218 0.21 MB/sec execute 572 sec latency 4118.162 ms 2024-05-14T10:07:42.903 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1219 0.21 MB/sec execute 573 sec latency 5118.295 ms 2024-05-14T10:07:43.903 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1220 0.21 MB/sec execute 574 sec latency 6118.430 ms 2024-05-14T10:07:44.903 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1224 0.21 MB/sec execute 575 sec latency 6943.967 ms 2024-05-14T10:07:45.903 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1226 0.21 MB/sec execute 576 sec latency 7105.348 ms 2024-05-14T10:07:46.903 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1228 0.21 MB/sec execute 577 sec latency 8105.440 ms 2024-05-14T10:07:47.903 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1230 0.21 MB/sec execute 578 sec latency 8414.178 ms 2024-05-14T10:07:48.903 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1231 0.21 MB/sec execute 579 sec latency 7633.954 ms 2024-05-14T10:07:49.903 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1232 0.21 MB/sec execute 580 sec latency 5133.178 ms 2024-05-14T10:07:49.921 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:28:11.386 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:07:49.940 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:28:11.406 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:07:49.971 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:28:11.447 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:07:49.972 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:28:11.451 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:07:49.978 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:28:11.455 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:07:49.986 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:28:11.465 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:07:50.082 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:28:11.548 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:07:50.089 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:28:11.566 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:07:50.115 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:28:11.594 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:07:50.904 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1233 0.21 MB/sec execute 581 sec latency 6133.287 ms 2024-05-14T10:07:51.904 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1234 0.21 MB/sec execute 582 sec latency 7133.383 ms 2024-05-14T10:07:52.904 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1236 0.21 MB/sec execute 583 sec latency 7443.393 ms 2024-05-14T10:07:53.904 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1238 0.21 MB/sec execute 584 sec latency 5108.751 ms 2024-05-14T10:07:54.904 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1240 0.21 MB/sec execute 585 sec latency 6108.855 ms 2024-05-14T10:07:55.904 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1240 0.21 MB/sec execute 586 sec latency 7108.958 ms 2024-05-14T10:07:56.904 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1241 0.21 MB/sec execute 587 sec latency 8030.921 ms 2024-05-14T10:07:57.904 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1243 0.21 MB/sec execute 588 sec latency 6324.441 ms 2024-05-14T10:07:58.904 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1244 0.21 MB/sec execute 589 sec latency 6690.764 ms 2024-05-14T10:07:59.905 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1246 0.21 MB/sec execute 590 sec latency 7690.857 ms 2024-05-14T10:08:00.905 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1247 0.21 MB/sec execute 591 sec latency 7852.169 ms 2024-05-14T10:08:01.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:08:01.405 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:08:01.905 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1249 0.21 MB/sec execute 592 sec latency 5417.051 ms 2024-05-14T10:08:02.905 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1250 0.21 MB/sec execute 593 sec latency 6417.181 ms 2024-05-14T10:08:03.905 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1252 0.21 MB/sec execute 594 sec latency 6427.815 ms 2024-05-14T10:08:04.905 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1254 0.21 MB/sec execute 595 sec latency 4596.575 ms 2024-05-14T10:08:05.905 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1255 0.21 MB/sec execute 596 sec latency 5596.656 ms 2024-05-14T10:08:06.905 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1256 0.20 MB/sec execute 597 sec latency 6596.776 ms 2024-05-14T10:08:07.906 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1258 0.20 MB/sec execute 598 sec latency 7574.158 ms 2024-05-14T10:08:08.906 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1259 0.20 MB/sec execute 599 sec latency 6093.042 ms 2024-05-14T10:08:09.906 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 600 sec 2024-05-14T10:08:10.906 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 601 sec 2024-05-14T10:08:11.906 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 602 sec 2024-05-14T10:08:12.906 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 603 sec 2024-05-14T10:08:13.906 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 604 sec 2024-05-14T10:08:14.906 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 605 sec 2024-05-14T10:08:15.906 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 606 sec 2024-05-14T10:08:16.907 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 607 sec 2024-05-14T10:08:17.907 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 608 sec 2024-05-14T10:08:18.907 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 609 sec 2024-05-14T10:08:19.907 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 610 sec 2024-05-14T10:08:20.907 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 611 sec 2024-05-14T10:08:21.907 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 612 sec 2024-05-14T10:08:22.907 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 613 sec 2024-05-14T10:08:23.907 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 614 sec 2024-05-14T10:08:24.908 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 615 sec 2024-05-14T10:08:25.908 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 616 sec 2024-05-14T10:08:26.908 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 617 sec 2024-05-14T10:08:27.908 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 618 sec 2024-05-14T10:08:28.908 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 619 sec 2024-05-14T10:08:29.908 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 620 sec 2024-05-14T10:08:30.908 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 621 sec 2024-05-14T10:08:31.518 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:08:31.526 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:08:31.908 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 622 sec 2024-05-14T10:08:32.909 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 623 sec 2024-05-14T10:08:33.909 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 624 sec 2024-05-14T10:08:34.909 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 625 sec 2024-05-14T10:08:35.909 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 626 sec 2024-05-14T10:08:36.909 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 627 sec 2024-05-14T10:08:37.909 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 628 sec 2024-05-14T10:08:38.909 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 629 sec 2024-05-14T10:08:39.909 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 630 sec 2024-05-14T10:08:40.910 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 631 sec 2024-05-14T10:08:41.910 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 632 sec 2024-05-14T10:08:42.910 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 633 sec 2024-05-14T10:08:43.910 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 634 sec 2024-05-14T10:08:44.910 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 635 sec 2024-05-14T10:08:45.910 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 636 sec 2024-05-14T10:08:46.910 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 637 sec 2024-05-14T10:08:47.911 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 638 sec 2024-05-14T10:08:48.911 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 639 sec 2024-05-14T10:08:49.911 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 640 sec 2024-05-14T10:08:50.911 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 641 sec 2024-05-14T10:08:51.911 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 642 sec 2024-05-14T10:08:52.911 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 643 sec 2024-05-14T10:08:53.911 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 644 sec 2024-05-14T10:08:54.911 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 645 sec 2024-05-14T10:08:55.912 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 646 sec 2024-05-14T10:08:56.912 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 647 sec 2024-05-14T10:08:57.912 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 648 sec 2024-05-14T10:08:58.912 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 649 sec 2024-05-14T10:08:59.912 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 650 sec 2024-05-14T10:09:00.912 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 651 sec 2024-05-14T10:09:01.884 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:09:01.892 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:09:01.912 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 652 sec 2024-05-14T10:09:02.913 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 653 sec 2024-05-14T10:09:03.913 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 654 sec 2024-05-14T10:09:04.913 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 655 sec 2024-05-14T10:09:05.913 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 656 sec 2024-05-14T10:09:06.913 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 657 sec 2024-05-14T10:09:07.913 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 658 sec 2024-05-14T10:09:08.913 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 659 sec 2024-05-14T10:09:09.913 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 660 sec 2024-05-14T10:09:10.913 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 661 sec 2024-05-14T10:09:11.914 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 662 sec 2024-05-14T10:09:12.914 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 663 sec 2024-05-14T10:09:13.914 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 664 sec 2024-05-14T10:09:14.914 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 665 sec 2024-05-14T10:09:15.914 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 666 sec 2024-05-14T10:09:16.914 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 667 sec 2024-05-14T10:09:17.914 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 668 sec 2024-05-14T10:09:18.914 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 669 sec 2024-05-14T10:09:19.915 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 670 sec 2024-05-14T10:09:20.915 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 671 sec 2024-05-14T10:09:21.915 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 672 sec 2024-05-14T10:09:22.915 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 673 sec 2024-05-14T10:09:23.915 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 674 sec 2024-05-14T10:09:24.915 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 675 sec 2024-05-14T10:09:25.915 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 676 sec 2024-05-14T10:09:26.916 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 677 sec 2024-05-14T10:09:27.916 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 678 sec 2024-05-14T10:09:28.916 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 679 sec 2024-05-14T10:09:29.916 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 680 sec 2024-05-14T10:09:30.916 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 681 sec 2024-05-14T10:09:31.916 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 682 sec 2024-05-14T10:09:32.030 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:09:32.038 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:09:32.916 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 683 sec 2024-05-14T10:09:33.916 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 684 sec 2024-05-14T10:09:34.916 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 685 sec 2024-05-14T10:09:35.917 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 686 sec 2024-05-14T10:09:36.917 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 687 sec 2024-05-14T10:09:37.917 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 688 sec 2024-05-14T10:09:38.917 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 689 sec 2024-05-14T10:09:39.917 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 690 sec 2024-05-14T10:09:40.917 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 691 sec 2024-05-14T10:09:41.917 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 692 sec 2024-05-14T10:09:42.918 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 693 sec 2024-05-14T10:09:43.918 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 694 sec 2024-05-14T10:09:44.918 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 695 sec 2024-05-14T10:09:45.918 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 696 sec 2024-05-14T10:09:46.918 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 697 sec 2024-05-14T10:09:47.918 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 698 sec 2024-05-14T10:09:48.918 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 699 sec 2024-05-14T10:09:49.918 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 700 sec 2024-05-14T10:09:50.919 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 701 sec 2024-05-14T10:09:51.919 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 702 sec 2024-05-14T10:09:52.919 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 703 sec 2024-05-14T10:09:53.919 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 704 sec 2024-05-14T10:09:54.919 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 705 sec 2024-05-14T10:09:55.919 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 706 sec 2024-05-14T10:09:56.919 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 707 sec 2024-05-14T10:09:57.919 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 708 sec 2024-05-14T10:09:58.920 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 709 sec 2024-05-14T10:09:59.920 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 710 sec 2024-05-14T10:10:00.920 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 711 sec 2024-05-14T10:10:01.920 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 712 sec 2024-05-14T10:10:02.156 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:10:02.164 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:10:02.920 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 713 sec 2024-05-14T10:10:03.920 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 714 sec 2024-05-14T10:10:04.920 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 715 sec 2024-05-14T10:10:05.921 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 716 sec 2024-05-14T10:10:06.920 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 717 sec 2024-05-14T10:10:07.921 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 718 sec 2024-05-14T10:10:08.921 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 719 sec 2024-05-14T10:10:09.921 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 720 sec 2024-05-14T10:10:10.921 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 721 sec 2024-05-14T10:10:11.921 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 722 sec 2024-05-14T10:10:12.921 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 723 sec 2024-05-14T10:10:13.922 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 724 sec 2024-05-14T10:10:14.922 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 725 sec 2024-05-14T10:10:15.922 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 726 sec 2024-05-14T10:10:16.922 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 727 sec 2024-05-14T10:10:17.922 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 728 sec 2024-05-14T10:10:18.922 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 729 sec 2024-05-14T10:10:19.922 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 730 sec 2024-05-14T10:10:20.923 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 731 sec 2024-05-14T10:10:21.923 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 732 sec 2024-05-14T10:10:22.923 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 733 sec 2024-05-14T10:10:23.923 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 734 sec 2024-05-14T10:10:24.923 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 735 sec 2024-05-14T10:10:25.923 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 736 sec 2024-05-14T10:10:26.923 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 737 sec 2024-05-14T10:10:27.923 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 738 sec 2024-05-14T10:10:28.924 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 739 sec 2024-05-14T10:10:29.924 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 740 sec 2024-05-14T10:10:30.924 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 741 sec 2024-05-14T10:10:31.924 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 742 sec 2024-05-14T10:10:32.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:10:32.295 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:10:32.924 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 743 sec 2024-05-14T10:10:33.924 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 744 sec 2024-05-14T10:10:34.924 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 745 sec 2024-05-14T10:10:35.925 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 746 sec 2024-05-14T10:10:36.925 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 747 sec 2024-05-14T10:10:37.925 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 748 sec 2024-05-14T10:10:38.925 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 749 sec 2024-05-14T10:10:39.925 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 750 sec 2024-05-14T10:10:40.925 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 751 sec 2024-05-14T10:10:41.925 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 752 sec 2024-05-14T10:10:42.925 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 753 sec 2024-05-14T10:10:43.925 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 754 sec 2024-05-14T10:10:44.925 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 755 sec 2024-05-14T10:10:45.926 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 756 sec 2024-05-14T10:10:46.926 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 757 sec 2024-05-14T10:10:47.926 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 758 sec 2024-05-14T10:10:48.926 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 759 sec 2024-05-14T10:10:49.926 INFO:tasks.workunit.client.0.smithi135.stdout: 9 cleanup 760 sec 2024-05-14T10:10:50.926 INFO:tasks.workunit.client.0.smithi135.stdout: 8 cleanup 761 sec 2024-05-14T10:10:51.926 INFO:tasks.workunit.client.0.smithi135.stdout: 7 cleanup 762 sec 2024-05-14T10:10:52.926 INFO:tasks.workunit.client.0.smithi135.stdout: 7 cleanup 763 sec 2024-05-14T10:10:53.927 INFO:tasks.workunit.client.0.smithi135.stdout: 6 cleanup 764 sec 2024-05-14T10:10:54.927 INFO:tasks.workunit.client.0.smithi135.stdout: 6 cleanup 765 sec 2024-05-14T10:10:55.927 INFO:tasks.workunit.client.0.smithi135.stdout: 6 cleanup 766 sec 2024-05-14T10:10:56.927 INFO:tasks.workunit.client.0.smithi135.stdout: 5 cleanup 767 sec 2024-05-14T10:10:57.927 INFO:tasks.workunit.client.0.smithi135.stdout: 4 cleanup 768 sec 2024-05-14T10:10:58.927 INFO:tasks.workunit.client.0.smithi135.stdout: 4 cleanup 769 sec 2024-05-14T10:10:59.927 INFO:tasks.workunit.client.0.smithi135.stdout: 4 cleanup 770 sec 2024-05-14T10:11:00.928 INFO:tasks.workunit.client.0.smithi135.stdout: 4 cleanup 771 sec 2024-05-14T10:11:01.928 INFO:tasks.workunit.client.0.smithi135.stdout: 4 cleanup 772 sec 2024-05-14T10:11:02.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:11:02.489 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:11:02.928 INFO:tasks.workunit.client.0.smithi135.stdout: 3 cleanup 773 sec 2024-05-14T10:11:03.928 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 774 sec 2024-05-14T10:11:04.928 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 775 sec 2024-05-14T10:11:05.928 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 776 sec 2024-05-14T10:11:05.948 INFO:tasks.workunit.client.0.smithi135.stdout: 0 cleanup 776 sec 2024-05-14T10:11:05.948 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-14T10:11:05.948 INFO:tasks.workunit.client.0.smithi135.stdout: Operation Count AvgLat MaxLat 2024-05-14T10:11:05.948 INFO:tasks.workunit.client.0.smithi135.stdout: ---------------------------------------- 2024-05-14T10:11:05.948 INFO:tasks.workunit.client.0.smithi135.stdout: NTCreateX 1385 1525.887 6218.142 2024-05-14T10:11:05.948 INFO:tasks.workunit.client.0.smithi135.stdout: Close 1295 11.794 133.898 2024-05-14T10:11:05.948 INFO:tasks.workunit.client.0.smithi135.stdout: Rename 98 2513.026 4656.655 2024-05-14T10:11:05.949 INFO:tasks.workunit.client.0.smithi135.stdout: Unlink 154 905.998 2307.988 2024-05-14T10:11:05.949 INFO:tasks.workunit.client.0.smithi135.stdout: Qpathinfo 862 644.333 4786.456 2024-05-14T10:11:05.949 INFO:tasks.workunit.client.0.smithi135.stdout: Qfileinfo 578 47.887 276.257 2024-05-14T10:11:05.949 INFO:tasks.workunit.client.0.smithi135.stdout: Qfsinfo 295 106.456 607.532 2024-05-14T10:11:05.949 INFO:tasks.workunit.client.0.smithi135.stdout: Sfileinfo 318 255.382 621.154 2024-05-14T10:11:05.949 INFO:tasks.workunit.client.0.smithi135.stdout: Find 387 6348.589 10860.033 2024-05-14T10:11:05.949 INFO:tasks.workunit.client.0.smithi135.stdout: WriteX 2770 67.397 694.865 2024-05-14T10:11:05.949 INFO:tasks.workunit.client.0.smithi135.stdout: ReadX 1305 0.399 45.698 2024-05-14T10:11:05.949 INFO:tasks.workunit.client.0.smithi135.stdout: Flush 240 754.295 2053.367 2024-05-14T10:11:05.949 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-14T10:11:05.949 INFO:tasks.workunit.client.0.smithi135.stdout:Throughput 0.204254 MB/sec 10 clients 10 procs max_latency=10860.047 ms 2024-05-14T10:11:05.951 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-14T10:11:05.951 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-14T10:11:32.668 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:11:32.677 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:11:58.044 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:32:19.510 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:11:58.066 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:32:19.532 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:11:58.088 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:32:19.565 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:11:58.092 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:32:19.571 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:11:58.096 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:32:19.573 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:11:58.100 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:32:19.579 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:11:58.243 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:32:19.709 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:11:58.277 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:32:19.754 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:11:58.281 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:32:19.760 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:12:02.823 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:12:02.832 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:12:08.597 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-05-14T10:12:08.597 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-14T10:12:09.635 DEBUG:teuthology.parallel:result is None 2024-05-14T10:12:09.635 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-14T10:12:10.387 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-14T10:12:10.387 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-14T10:12:10.396 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-14T10:12:10.397 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T10:12:10.397 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T10:12:10.453 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T10:12:10.453 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T10:12:10.501 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T10:12:10.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.816+0000 7fe344000640 1 Processor -- start 2024-05-14T10:12:10.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.817+0000 7fe344000640 1 -- start start 2024-05-14T10:12:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.821+0000 7fe344000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe33c06c6f0 0x7fe33c0c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.821+0000 7fe344000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe33c0cdf50 0x7fe33c0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.821+0000 7fe344000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe33c0c6910 0x7fe33c0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.821+0000 7fe344000640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe33c0b5c80 con 0x7fe33c0c6910 2024-05-14T10:12:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.821+0000 7fe344000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe33c0c74a0 con 0x7fe33c0cdf50 2024-05-14T10:12:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.821+0000 7fe344000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe33c0c7780 con 0x7fe33c06c6f0 2024-05-14T10:12:10.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.824+0000 7fe340c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe33c0cdf50 0x7fe33c0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:10.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.824+0000 7fe341600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe33c06c6f0 0x7fe33c0c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.825+0000 7fe340c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe33c0cdf50 0x7fe33c0cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:33460/0 (socket says 172.21.15.135:33460) 2024-05-14T10:12:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.825+0000 7fe340c00640 1 -- 172.21.15.135:0/869328023 learned_addr learned my addr 172.21.15.135:0/869328023 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:10.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.832+0000 7fe340c00640 1 -- 172.21.15.135:0/869328023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe33c06c6f0 msgr2=0x7fe33c0c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:10.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.833+0000 7fe340c00640 1 --2- 172.21.15.135:0/869328023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe33c06c6f0 0x7fe33c0c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:10.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.833+0000 7fe340c00640 1 -- 172.21.15.135:0/869328023 >> v2:172.21.15.135:3300/0 conn(0x7fe33c0c6910 msgr2=0x7fe33c0cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:10.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.833+0000 7fe340c00640 1 --2- 172.21.15.135:0/869328023 >> v2:172.21.15.135:3300/0 conn(0x7fe33c0c6910 0x7fe33c0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:10.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.833+0000 7fe340c00640 1 -- 172.21.15.135:0/869328023 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c0c7a60 con 0x7fe33c0cdf50 2024-05-14T10:12:10.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.833+0000 7fe341600640 1 --2- 172.21.15.135:0/869328023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe33c06c6f0 0x7fe33c0c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T10:12:10.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.838+0000 7fe340c00640 1 --2- 172.21.15.135:0/869328023 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe33c0cdf50 0x7fe33c0cd160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe33c070270 tx=0x7fe32802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=589cd245dceffbba server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:10.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.857+0000 7fe33be00640 1 -- 172.21.15.135:0/869328023 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328037070 con 0x7fe33c0cdf50 2024-05-14T10:12:10.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.857+0000 7fe33be00640 1 -- 172.21.15.135:0/869328023 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe328032440 con 0x7fe33c0cdf50 2024-05-14T10:12:10.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.857+0000 7fe33be00640 1 -- 172.21.15.135:0/869328023 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328032810 con 0x7fe33c0cdf50 2024-05-14T10:12:10.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.858+0000 7fe344000640 1 -- 172.21.15.135:0/869328023 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe33c0cdf50 msgr2=0x7fe33c0cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.858+0000 7fe344000640 1 --2- 172.21.15.135:0/869328023 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe33c0cdf50 0x7fe33c0cd160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe33c070270 tx=0x7fe32802a1e0 comp rx=0 tx=0).stop 2024-05-14T10:12:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.858+0000 7fe344000640 1 -- 172.21.15.135:0/869328023 shutdown_connections 2024-05-14T10:12:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.858+0000 7fe344000640 1 --2- 172.21.15.135:0/869328023 >> v2:172.21.15.135:3300/0 conn(0x7fe33c0c6910 0x7fe33c0cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.858+0000 7fe344000640 1 --2- 172.21.15.135:0/869328023 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe33c0cdf50 0x7fe33c0cd160 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.858+0000 7fe344000640 1 --2- 172.21.15.135:0/869328023 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe33c06c6f0 0x7fe33c0c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.858+0000 7fe344000640 1 -- 172.21.15.135:0/869328023 >> 172.21.15.135:0/869328023 conn(0x7fe33c0ce3f0 msgr2=0x7fe33c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.858+0000 7fe344000640 1 -- 172.21.15.135:0/869328023 shutdown_connections 2024-05-14T10:12:10.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.858+0000 7fe344000640 1 -- 172.21.15.135:0/869328023 wait complete. 2024-05-14T10:12:10.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.861+0000 7fe344000640 1 Processor -- start 2024-05-14T10:12:10.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.862+0000 7fe344000640 1 -- start start 2024-05-14T10:12:10.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.864+0000 7fe344000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe33c06c6f0 0x7fe33c14d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:10.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.864+0000 7fe344000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe33c0c6910 0x7fe33c1e5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:10.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.864+0000 7fe344000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe33c0cdf50 0x7fe33c14c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:10.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.864+0000 7fe344000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c0c8a80 con 0x7fe33c0c6910 2024-05-14T10:12:10.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.864+0000 7fe344000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c0c8020 con 0x7fe33c06c6f0 2024-05-14T10:12:10.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.864+0000 7fe344000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe33c15cf70 con 0x7fe33c0cdf50 2024-05-14T10:12:10.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.864+0000 7fe340c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe33c0c6910 0x7fe33c1e5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:10.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.865+0000 7fe340c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe33c0c6910 0x7fe33c1e5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33436/0 (socket says 172.21.15.135:33436) 2024-05-14T10:12:10.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.865+0000 7fe340c00640 1 -- 172.21.15.135:0/239741553 learned_addr learned my addr 172.21.15.135:0/239741553 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:10.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.866+0000 7fe342000640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe33c0cdf50 0x7fe33c14c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:10.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.867+0000 7fe341600640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe33c06c6f0 0x7fe33c14d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.873+0000 7fe340c00640 1 -- 172.21.15.135:0/239741553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe33c0cdf50 msgr2=0x7fe33c14c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.873+0000 7fe340c00640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe33c0cdf50 0x7fe33c14c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.873+0000 7fe340c00640 1 -- 172.21.15.135:0/239741553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe33c06c6f0 msgr2=0x7fe33c14d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.873+0000 7fe340c00640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe33c06c6f0 0x7fe33c14d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.873+0000 7fe340c00640 1 -- 172.21.15.135:0/239741553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c14f240 con 0x7fe33c0c6910 2024-05-14T10:12:10.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.876+0000 7fe340c00640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe33c0c6910 0x7fe33c1e5b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe328009960 tx=0x7fe3280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:10.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.882+0000 7fe339600640 1 -- 172.21.15.135:0/239741553 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328037040 con 0x7fe33c0c6910 2024-05-14T10:12:10.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.882+0000 7fe339600640 1 -- 172.21.15.135:0/239741553 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe328042070 con 0x7fe33c0c6910 2024-05-14T10:12:10.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.882+0000 7fe339600640 1 -- 172.21.15.135:0/239741553 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328030960 con 0x7fe33c0c6910 2024-05-14T10:12:10.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.882+0000 7fe344000640 1 -- 172.21.15.135:0/239741553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33c14f520 con 0x7fe33c0c6910 2024-05-14T10:12:10.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.882+0000 7fe344000640 1 -- 172.21.15.135:0/239741553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33c14fae0 con 0x7fe33c0c6910 2024-05-14T10:12:10.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:10.884+0000 7fe344000640 1 -- 172.21.15.135:0/239741553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33c15c2d0 con 0x7fe33c0c6910 2024-05-14T10:12:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.236+0000 7fe339600640 1 -- 172.21.15.135:0/239741553 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe328030b00 con 0x7fe33c0c6910 2024-05-14T10:12:11.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.238+0000 7fe339600640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe31c076320 0x7fe31c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:11.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.238+0000 7fe341600640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe31c076320 0x7fe31c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:11.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.240+0000 7fe341600640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe31c076320 0x7fe31c078830 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe330009560 tx=0x7fe330009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:11.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.273+0000 7fe339600640 1 -- 172.21.15.135:0/239741553 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fe328030df0 con 0x7fe33c0c6910 2024-05-14T10:12:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.275+0000 7fe339600640 1 -- 172.21.15.135:0/239741553 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe328081b80 con 0x7fe33c0c6910 2024-05-14T10:12:11.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.514+0000 7fe344000640 1 -- 172.21.15.135:0/239741553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe33c152ce0 con 0x7fe33c0c6910 2024-05-14T10:12:11.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.652+0000 7fe339600640 1 -- 172.21.15.135:0/239741553 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7fe328085e80 con 0x7fe33c0c6910 2024-05-14T10:12:11.652 INFO:teuthology.orchestra.run.smithi135.stderr:listed 0 entries 2024-05-14T10:12:11.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.656+0000 7fe344000640 1 -- 172.21.15.135:0/239741553 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe31c076320 msgr2=0x7fe31c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:11.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.656+0000 7fe344000640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe31c076320 0x7fe31c078830 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe330009560 tx=0x7fe330009190 comp rx=0 tx=0).stop 2024-05-14T10:12:11.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.656+0000 7fe344000640 1 -- 172.21.15.135:0/239741553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe33c0c6910 msgr2=0x7fe33c1e5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:11.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.656+0000 7fe344000640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe33c0c6910 0x7fe33c1e5b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe328009960 tx=0x7fe3280046c0 comp rx=0 tx=0).stop 2024-05-14T10:12:11.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.656+0000 7fe344000640 1 -- 172.21.15.135:0/239741553 shutdown_connections 2024-05-14T10:12:11.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.656+0000 7fe344000640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe31c076320 0x7fe31c078830 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:11.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.656+0000 7fe344000640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe33c0cdf50 0x7fe33c14c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:11.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.656+0000 7fe344000640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe33c0c6910 0x7fe33c1e5b00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:11.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.656+0000 7fe344000640 1 --2- 172.21.15.135:0/239741553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe33c06c6f0 0x7fe33c14d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:11.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.656+0000 7fe344000640 1 -- 172.21.15.135:0/239741553 >> 172.21.15.135:0/239741553 conn(0x7fe33c0ce3f0 msgr2=0x7fe33c1537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:11.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.657+0000 7fe344000640 1 -- 172.21.15.135:0/239741553 shutdown_connections 2024-05-14T10:12:11.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:11.657+0000 7fe344000640 1 -- 172.21.15.135:0/239741553 wait complete. 2024-05-14T10:12:11.687 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-14T10:12:11.687 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T10:12:11.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T10:12:12.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.049+0000 7f07cee00640 1 Processor -- start 2024-05-14T10:12:12.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.049+0000 7f07cee00640 1 -- start start 2024-05-14T10:12:12.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.051+0000 7f07cee00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f07c815ab20 0x7f07c8153f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:12.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.051+0000 7f07cee00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07c81544b0 0x7f07c80c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:12.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.051+0000 7f07cee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c8071f70 0x7f07c80c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:12.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.051+0000 7f07cee00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f07c806cde0 con 0x7f07c81544b0 2024-05-14T10:12:12.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.051+0000 7f07cee00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f07c8074ce0 con 0x7f07c815ab20 2024-05-14T10:12:12.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.051+0000 7f07cee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f07c8074a00 con 0x7f07c8071f70 2024-05-14T10:12:12.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.053+0000 7f07bfe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07c81544b0 0x7f07c80c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:12.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.054+0000 7f07bfe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f07c81544b0 0x7f07c80c6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33444/0 (socket says 172.21.15.135:33444) 2024-05-14T10:12:12.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.054+0000 7f07bfe00640 1 -- 172.21.15.135:0/3612028989 learned_addr learned my addr 172.21.15.135:0/3612028989 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.059+0000 7f07cce00640 1 --2- 172.21.15.135:0/3612028989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c8071f70 0x7f07c80c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:12.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.069+0000 7f07c7e00640 1 --2- 172.21.15.135:0/3612028989 >> v2:172.21.15.196:3300/0 conn(0x7f07c815ab20 0x7f07c8153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:12.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.080+0000 7f07cce00640 1 -- 172.21.15.135:0/3612028989 >> v2:172.21.15.196:3300/0 conn(0x7f07c815ab20 msgr2=0x7f07c8153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:12.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.080+0000 7f07cce00640 1 --2- 172.21.15.135:0/3612028989 >> v2:172.21.15.196:3300/0 conn(0x7f07c815ab20 0x7f07c8153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.080+0000 7f07cce00640 1 -- 172.21.15.135:0/3612028989 >> v2:172.21.15.135:3300/0 conn(0x7f07c81544b0 msgr2=0x7f07c80c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:12.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.080+0000 7f07cce00640 1 --2- 172.21.15.135:0/3612028989 >> v2:172.21.15.135:3300/0 conn(0x7f07c81544b0 0x7f07c80c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.080+0000 7f07cce00640 1 -- 172.21.15.135:0/3612028989 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c806c790 con 0x7f07c8071f70 2024-05-14T10:12:12.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.086+0000 7f07cce00640 1 --2- 172.21.15.135:0/3612028989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c8071f70 0x7f07c80c71b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f07c80739a0 tx=0x7f07c002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89f7a4a51ad85fc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.200+0000 7f07c7400640 1 -- 172.21.15.135:0/3612028989 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0031600 con 0x7f07c8071f70 2024-05-14T10:12:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.201+0000 7f07c7400640 1 -- 172.21.15.135:0/3612028989 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c00317a0 con 0x7f07c8071f70 2024-05-14T10:12:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.201+0000 7f07c7400640 1 -- 172.21.15.135:0/3612028989 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0031b70 con 0x7f07c8071f70 2024-05-14T10:12:12.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.202+0000 7f07cee00640 1 -- 172.21.15.135:0/3612028989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c8071f70 msgr2=0x7f07c80c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:12.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.202+0000 7f07cee00640 1 --2- 172.21.15.135:0/3612028989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c8071f70 0x7f07c80c71b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f07c80739a0 tx=0x7f07c002a5d0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.203+0000 7f07cee00640 1 -- 172.21.15.135:0/3612028989 shutdown_connections 2024-05-14T10:12:12.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.203+0000 7f07cee00640 1 --2- 172.21.15.135:0/3612028989 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c8071f70 0x7f07c80c71b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.203+0000 7f07cee00640 1 --2- 172.21.15.135:0/3612028989 >> v2:172.21.15.135:3300/0 conn(0x7f07c81544b0 0x7f07c80c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.203+0000 7f07cee00640 1 --2- 172.21.15.135:0/3612028989 >> v2:172.21.15.196:3300/0 conn(0x7f07c815ab20 0x7f07c8153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.203+0000 7f07cee00640 1 -- 172.21.15.135:0/3612028989 >> 172.21.15.135:0/3612028989 conn(0x7f07c8073d40 msgr2=0x7f07c8074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:12.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.203+0000 7f07cee00640 1 -- 172.21.15.135:0/3612028989 shutdown_connections 2024-05-14T10:12:12.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.203+0000 7f07cee00640 1 -- 172.21.15.135:0/3612028989 wait complete. 2024-05-14T10:12:12.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.206+0000 7f07cee00640 1 Processor -- start 2024-05-14T10:12:12.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.207+0000 7f07cee00640 1 -- start start 2024-05-14T10:12:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.209+0000 7f07cee00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c8071f70 0x7f07c815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.209+0000 7f07cee00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81544b0 0x7f07c80c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.209+0000 7f07cee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c815ab20 0x7f07c81f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.209+0000 7f07cee00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07c806d270 con 0x7f07c81544b0 2024-05-14T10:12:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.209+0000 7f07cee00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f07c80c4690 con 0x7f07c8071f70 2024-05-14T10:12:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.209+0000 7f07cee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f07c806d3f0 con 0x7f07c815ab20 2024-05-14T10:12:12.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.211+0000 7f07c7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c8071f70 0x7f07c815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:12.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.212+0000 7f07cce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c815ab20 0x7f07c81f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:12.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.212+0000 7f07c7e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c8071f70 0x7f07c815b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:33500/0 (socket says 172.21.15.135:33500) 2024-05-14T10:12:12.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.212+0000 7f07c7e00640 1 -- 172.21.15.135:0/4222602585 learned_addr learned my addr 172.21.15.135:0/4222602585 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:12.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.214+0000 7f07bfe00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81544b0 0x7f07c80c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:12.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.226+0000 7f07bfe00640 1 -- 172.21.15.135:0/4222602585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c815ab20 msgr2=0x7f07c81f25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:12.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.226+0000 7f07bfe00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c815ab20 0x7f07c81f25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.226+0000 7f07bfe00640 1 -- 172.21.15.135:0/4222602585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c8071f70 msgr2=0x7f07c815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:12.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.226+0000 7f07bfe00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c8071f70 0x7f07c815b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.226+0000 7f07bfe00640 1 -- 172.21.15.135:0/4222602585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c815b8a0 con 0x7f07c81544b0 2024-05-14T10:12:12.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.232+0000 7f07bfe00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81544b0 0x7f07c80c6870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f07b000d5a0 tx=0x7f07b000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:12.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.243+0000 7f07c4c00640 1 -- 172.21.15.135:0/4222602585 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0004240 con 0x7f07c81544b0 2024-05-14T10:12:12.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.243+0000 7f07c4c00640 1 -- 172.21.15.135:0/4222602585 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b0019070 con 0x7f07c81544b0 2024-05-14T10:12:12.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.243+0000 7f07c4c00640 1 -- 172.21.15.135:0/4222602585 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0003610 con 0x7f07c81544b0 2024-05-14T10:12:12.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.243+0000 7f07cee00640 1 -- 172.21.15.135:0/4222602585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c81f5900 con 0x7f07c81544b0 2024-05-14T10:12:12.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.244+0000 7f07cee00640 1 -- 172.21.15.135:0/4222602585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c81f5ba0 con 0x7f07c81544b0 2024-05-14T10:12:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.246+0000 7f07cee00640 1 -- 172.21.15.135:0/4222602585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c8069a60 con 0x7f07c81544b0 2024-05-14T10:12:12.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.635+0000 7f07c4c00640 1 -- 172.21.15.135:0/4222602585 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f07b00037b0 con 0x7f07c81544b0 2024-05-14T10:12:12.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.638+0000 7f07c4c00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a4076350 0x7f07a4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:12.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.639+0000 7f07c7e00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a4076350 0x7f07a4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:12.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.640+0000 7f07c7e00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a4076350 0x7f07a4078860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009b60 tx=0x7f07b8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:12.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.674+0000 7f07c4c00640 1 -- 172.21.15.135:0/4222602585 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f07b005d730 con 0x7f07c81544b0 2024-05-14T10:12:12.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.675+0000 7f07c4c00640 1 -- 172.21.15.135:0/4222602585 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f07b00614a0 con 0x7f07c81544b0 2024-05-14T10:12:12.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.949+0000 7f07cee00640 1 -- 172.21.15.135:0/4222602585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f07c80c7290 con 0x7f07c81544b0 2024-05-14T10:12:12.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.962+0000 7f07c4c00640 1 -- 172.21.15.135:0/4222602585 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f07b00657a0 con 0x7f07c81544b0 2024-05-14T10:12:12.962 INFO:teuthology.orchestra.run.smithi135.stderr:listed 0 entries 2024-05-14T10:12:12.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.965+0000 7f07cee00640 1 -- 172.21.15.135:0/4222602585 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a4076350 msgr2=0x7f07a4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.965+0000 7f07cee00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a4076350 0x7f07a4078860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009b60 tx=0x7f07b8009190 comp rx=0 tx=0).stop 2024-05-14T10:12:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.965+0000 7f07cee00640 1 -- 172.21.15.135:0/4222602585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81544b0 msgr2=0x7f07c80c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.965+0000 7f07cee00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81544b0 0x7f07c80c6870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f07b000d5a0 tx=0x7f07b000da60 comp rx=0 tx=0).stop 2024-05-14T10:12:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.965+0000 7f07cee00640 1 -- 172.21.15.135:0/4222602585 shutdown_connections 2024-05-14T10:12:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.965+0000 7f07cee00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f07a4076350 0x7f07a4078860 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.965+0000 7f07cee00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07c815ab20 0x7f07c81f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.965+0000 7f07cee00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07c81544b0 0x7f07c80c6870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.965+0000 7f07cee00640 1 --2- 172.21.15.135:0/4222602585 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f07c8071f70 0x7f07c815b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.965+0000 7f07cee00640 1 -- 172.21.15.135:0/4222602585 >> 172.21.15.135:0/4222602585 conn(0x7f07c8073d40 msgr2=0x7f07c80cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.965+0000 7f07cee00640 1 -- 172.21.15.135:0/4222602585 shutdown_connections 2024-05-14T10:12:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:12.966+0000 7f07cee00640 1 -- 172.21.15.135:0/4222602585 wait complete. 2024-05-14T10:12:12.992 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi135.front.sepia.ceph.com... 2024-05-14T10:12:12.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:12:12.993 DEBUG:teuthology.orchestra.run.smithi135:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-14T10:12:13.067 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:12:13.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi135.stderr:ceph-fuse[45699]: fuse finished with error 0 and tester_r 0 2024-05-14T10:12:14.043 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi135.stderr:==00:00:30:12.957 45699== 2024-05-14T10:12:14.043 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi135.stderr:==00:00:30:12.957 45699== Exit program on first error (--exit-on-first-error=yes) 2024-05-14T10:12:14.228 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi135.stderr:daemon-helper: command failed with exit status 42 2024-05-14T10:12:16.812 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:32:38.278 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:12:16.817 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:32:38.283 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:12:16.872 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:32:38.338 36409== Warning: unimplemented fcntl command: 1036 2024-05-14T10:12:16.950 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:32:38.429 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:12:16.963 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:32:38.440 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:12:16.967 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:32:38.444 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:12:16.986 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:32:38.465 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:12:17.042 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:32:38.520 36229== Warning: unimplemented fcntl command: 1036 2024-05-14T10:12:17.048 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:32:38.525 36230== Warning: unimplemented fcntl command: 1036 2024-05-14T10:12:19.168 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-14T10:12:19.169 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T10:12:19.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:12:19.169 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-14T10:12:19.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:12:19.225 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-14T10:12:19.276 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-14T10:12:19.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:12:19.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T10:12:19.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T10:12:19.363 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-05-14T10:12:19.488 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-14T10:12:19.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T10:12:19.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T10:12:19.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.754+0000 7f00d0a00640 1 Processor -- start 2024-05-14T10:12:19.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.754+0000 7f00d0a00640 1 -- start start 2024-05-14T10:12:19.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.756+0000 7f00d0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00cc15cf70 0x7f00cc074810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:19.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.756+0000 7f00d0a00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00cc0c8650 con 0x7f00cc156930 2024-05-14T10:12:19.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.756+0000 7f00d0a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00cc0c8930 con 0x7f00cc0c7e80 2024-05-14T10:12:19.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.756+0000 7f00d0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f00cc160a10 con 0x7f00cc15cf70 2024-05-14T10:12:19.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.798+0000 7f00c3e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f00cc0c7e80 0x7f00cc15c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:55884/0 (socket says 172.21.15.135:55884) 2024-05-14T10:12:19.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.798+0000 7f00c3e00640 1 -- 172.21.15.135:0/2570883345 learned_addr learned my addr 172.21.15.135:0/2570883345 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:19.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.808+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726533429 0 0) 0x7f00cc0c8930 con 0x7f00cc0c7e80 2024-05-14T10:12:19.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.808+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b0003520 con 0x7f00cc0c7e80 2024-05-14T10:12:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.811+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204346387 0 0) 0x7f00cc0c8650 con 0x7f00cc156930 2024-05-14T10:12:19.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.811+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00cc0c8930 con 0x7f00cc156930 2024-05-14T10:12:19.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.816+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2949965439 0 0) 0x7f00b0003520 con 0x7f00cc0c7e80 2024-05-14T10:12:19.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.816+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00cc15cf70 msgr2=0x7f00cc074810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:19.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.816+0000 7f00c9400640 1 --2- 172.21.15.135:0/2570883345 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00cc15cf70 0x7f00cc074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:19.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.816+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 >> v1:172.21.15.135:6789/0 conn(0x7f00cc156930 legacy=0x7f00cc0c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:19.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.817+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00cc160450 con 0x7f00cc0c7e80 2024-05-14T10:12:19.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.817+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f00b40016f0 con 0x7f00cc0c7e80 2024-05-14T10:12:19.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.817+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 >> v1:172.21.15.196:6789/0 conn(0x7f00cc0c7e80 legacy=0x7f00cc15c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.817+0000 7f00c9400640 1 --2- 172.21.15.135:0/2570883345 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00b0003c30 0x7f00b0004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.817+0000 7f00c9400640 1 --2- 172.21.15.135:0/2570883345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b0004800 0x7f00b0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.817+0000 7f00c9400640 1 --2- 172.21.15.135:0/2570883345 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00cc15cf70 0x7f00b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.817+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc160a10 con 0x7f00b0004800 2024-05-14T10:12:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.817+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f00b000bf00 con 0x7f00b0003c30 2024-05-14T10:12:19.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.817+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f00b000c080 con 0x7f00cc15cf70 2024-05-14T10:12:19.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.824+0000 7f00ca800640 1 --2- 172.21.15.135:0/2570883345 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00cc15cf70 0x7f00b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:19.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.825+0000 7f00c9e00640 1 --2- 172.21.15.135:0/2570883345 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00b0003c30 0x7f00b0004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:19.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.827+0000 7f00c3e00640 1 --2- 172.21.15.135:0/2570883345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b0004800 0x7f00b0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:19.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.831+0000 7f00c9e00640 1 -- 172.21.15.135:0/2570883345 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00cc15cf70 msgr2=0x7f00b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:19.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.831+0000 7f00c9e00640 1 --2- 172.21.15.135:0/2570883345 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00cc15cf70 0x7f00b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:19.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.831+0000 7f00c9e00640 1 -- 172.21.15.135:0/2570883345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b0004800 msgr2=0x7f00b0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:19.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.831+0000 7f00c9e00640 1 --2- 172.21.15.135:0/2570883345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b0004800 0x7f00b0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:19.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.831+0000 7f00c9e00640 1 -- 172.21.15.135:0/2570883345 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b0003520 con 0x7f00b0003c30 2024-05-14T10:12:19.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.838+0000 7f00c9e00640 1 --2- 172.21.15.135:0/2570883345 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00b0003c30 0x7f00b0004080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f00bc001920 tx=0x7f00b0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94fed9a5fb0d405c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:19.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.848+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc001540 con 0x7f00b0003c30 2024-05-14T10:12:19.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.848+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00bc02acd0 con 0x7f00b0003c30 2024-05-14T10:12:19.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.848+0000 7f00c9400640 1 -- 172.21.15.135:0/2570883345 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc005310 con 0x7f00b0003c30 2024-05-14T10:12:19.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.850+0000 7f00d0a00640 1 -- 172.21.15.135:0/2570883345 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00b0003c30 msgr2=0x7f00b0004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:19.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.850+0000 7f00d0a00640 1 --2- 172.21.15.135:0/2570883345 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00b0003c30 0x7f00b0004080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f00bc001920 tx=0x7f00b0005830 comp rx=0 tx=0).stop 2024-05-14T10:12:19.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.850+0000 7f00ca800640 1 -- 172.21.15.135:0/2570883345 reap_dead start 2024-05-14T10:12:19.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.850+0000 7f00d0a00640 1 -- 172.21.15.135:0/2570883345 shutdown_connections 2024-05-14T10:12:19.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.850+0000 7f00d0a00640 1 -- 172.21.15.135:0/2570883345 >> 172.21.15.135:0/2570883345 conn(0x7f00cc073cf0 msgr2=0x7f00cc074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:19.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.850+0000 7f00d0a00640 1 -- 172.21.15.135:0/2570883345 shutdown_connections 2024-05-14T10:12:19.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.851+0000 7f00d0a00640 1 -- 172.21.15.135:0/2570883345 wait complete. 2024-05-14T10:12:19.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.856+0000 7f00d0a00640 1 Processor -- start 2024-05-14T10:12:19.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.856+0000 7f00d0a00640 1 -- start start 2024-05-14T10:12:19.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.860+0000 7f00d0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00b0003c30 0x7f00cc1f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:19.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.860+0000 7f00d0a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00cc15a400 0x7f00cc15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:19.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.860+0000 7f00d0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00cc15d610 0x7f00cc159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:19.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.860+0000 7f00d0a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc0c9b50 con 0x7f00cc15d610 2024-05-14T10:12:19.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.860+0000 7f00d0a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc074d50 con 0x7f00cc15a400 2024-05-14T10:12:19.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.860+0000 7f00d0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f00cc0c9730 con 0x7f00b0003c30 2024-05-14T10:12:19.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.862+0000 7f00ca800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00cc15d610 0x7f00cc159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:19.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.862+0000 7f00c3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00cc15a400 0x7f00cc15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:19.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.862+0000 7f00ca800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00cc15d610 0x7f00cc159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44726/0 (socket says 172.21.15.135:44726) 2024-05-14T10:12:19.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.862+0000 7f00ca800640 1 -- 172.21.15.135:0/2008611272 learned_addr learned my addr 172.21.15.135:0/2008611272 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:19.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.862+0000 7f00c9e00640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00b0003c30 0x7f00cc1f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:19.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.868+0000 7f00ca800640 1 -- 172.21.15.135:0/2008611272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00b0003c30 msgr2=0x7f00cc1f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:19.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.868+0000 7f00ca800640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00b0003c30 0x7f00cc1f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:19.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.868+0000 7f00ca800640 1 -- 172.21.15.135:0/2008611272 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00cc15a400 msgr2=0x7f00cc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:19.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.868+0000 7f00ca800640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00cc15a400 0x7f00cc15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:19.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.868+0000 7f00ca800640 1 -- 172.21.15.135:0/2008611272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00cc15c170 con 0x7f00cc15d610 2024-05-14T10:12:19.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.872+0000 7f00ca800640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00cc15d610 0x7f00cc159920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00cc06ee60 tx=0x7f00c400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:19.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.881+0000 7f00c2000640 1 -- 172.21.15.135:0/2008611272 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c401b070 con 0x7f00cc15d610 2024-05-14T10:12:19.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.881+0000 7f00c2000640 1 -- 172.21.15.135:0/2008611272 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c4006e50 con 0x7f00cc15d610 2024-05-14T10:12:19.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.881+0000 7f00c2000640 1 -- 172.21.15.135:0/2008611272 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c400cde0 con 0x7f00cc15d610 2024-05-14T10:12:19.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.881+0000 7f00d0a00640 1 -- 172.21.15.135:0/2008611272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00cc15ac00 con 0x7f00cc15d610 2024-05-14T10:12:19.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.881+0000 7f00d0a00640 1 -- 172.21.15.135:0/2008611272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00cc15b690 con 0x7f00cc15d610 2024-05-14T10:12:19.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.883+0000 7f00d0a00640 1 -- 172.21.15.135:0/2008611272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00cc069a90 con 0x7f00cc15d610 2024-05-14T10:12:19.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.922+0000 7f00c2000640 1 -- 172.21.15.135:0/2008611272 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f00c401e070 con 0x7f00cc15d610 2024-05-14T10:12:19.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.923+0000 7f00c2000640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f00a8076320 0x7f00a8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:19.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.924+0000 7f00c9e00640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f00a8076320 0x7f00a8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:19.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:19.926+0000 7f00c9e00640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f00a8076320 0x7f00a8078830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f00bc032000 tx=0x7f00bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:20.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.265+0000 7f00c2000640 1 -- 172.21.15.135:0/2008611272 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f00c405c9b0 con 0x7f00cc15d610 2024-05-14T10:12:20.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.266+0000 7f00c2000640 1 -- 172.21.15.135:0/2008611272 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f00c4060720 con 0x7f00cc15d610 2024-05-14T10:12:20.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.484+0000 7f00d0a00640 1 -- 172.21.15.135:0/2008611272 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00cc14ce00 con 0x7f00a8076320 2024-05-14T10:12:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.513+0000 7f00c2000640 1 -- 172.21.15.135:0/2008611272 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333499 (secure 0 0 0) 0x7f00bc0936d0 con 0x7f00a8076320 2024-05-14T10:12:20.519 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T10:12:20.521 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 -- 172.21.15.135:0/2008611272 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f00a8076320 msgr2=0x7f00a8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f00a8076320 0x7f00a8078830 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f00bc032000 tx=0x7f00bc02e000 comp rx=0 tx=0).stop 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 -- 172.21.15.135:0/2008611272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00cc15d610 msgr2=0x7f00cc159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00cc15d610 0x7f00cc159920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00cc06ee60 tx=0x7f00c400ee60 comp rx=0 tx=0).stop 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 -- 172.21.15.135:0/2008611272 shutdown_connections 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f00a8076320 0x7f00a8078830 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00cc15a400 0x7f00cc15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00cc15d610 0x7f00cc159920 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 --2- 172.21.15.135:0/2008611272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00b0003c30 0x7f00cc1f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 -- 172.21.15.135:0/2008611272 >> 172.21.15.135:0/2008611272 conn(0x7f00cc073cf0 msgr2=0x7f00cc06d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 -- 172.21.15.135:0/2008611272 shutdown_connections 2024-05-14T10:12:20.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.522+0000 7f00d0a00640 1 -- 172.21.15.135:0/2008611272 wait complete. 2024-05-14T10:12:20.556 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":991,"stamp":"2024-05-14T10:12:19.376613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22567725,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":498,"num_read_kb":521,"num_write":8783,"num_write_kb":276537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8838,"ondisk_log_size":8838,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329672,"kb_used_data":46984,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754645048,"statfs":{"total":773094113280,"available":772756529152,"internally_reserved":0,"allocated":48111616,"data_stored":46321998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":289394226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40276,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":51,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006583"},"pg_stats":[{"pgid":"2.1f","version":"33'574","reported_seq":624,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:00.807469+0000","last_change":"2024-05-14T09:40:43.106486+0000","last_active":"2024-05-14T10:12:00.807469+0000","last_peered":"2024-05-14T10:12:00.807469+0000","last_clean":"2024-05-14T10:12:00.807469+0000","last_became_active":"2024-05-14T09:40:43.105731+0000","last_became_peered":"2024-05-14T09:40:43.105731+0000","last_unstale":"2024-05-14T10:12:00.807469+0000","last_undegraded":"2024-05-14T10:12:00.807469+0000","last_fullsized":"2024-05-14T10:12:00.807469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:32:09.735265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573,"num_write_kb":4404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'15","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.501309+0000","last_change":"2024-05-14T09:40:45.750103+0000","last_active":"2024-05-14T10:12:13.501309+0000","last_peered":"2024-05-14T10:12:13.501309+0000","last_clean":"2024-05-14T10:12:13.501309+0000","last_became_active":"2024-05-14T09:40:45.747865+0000","last_became_peered":"2024-05-14T09:40:45.747865+0000","last_unstale":"2024-05-14T10:12:13.501309+0000","last_undegraded":"2024-05-14T10:12:13.501309+0000","last_fullsized":"2024-05-14T10:12:13.501309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:06.549076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'61","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:53.409756+0000","last_change":"2024-05-14T09:40:53.664918+0000","last_active":"2024-05-14T10:10:53.409756+0000","last_peered":"2024-05-14T10:10:53.409756+0000","last_clean":"2024-05-14T10:10:53.409756+0000","last_became_active":"2024-05-14T09:40:53.664366+0000","last_became_peered":"2024-05-14T09:40:53.664366+0000","last_unstale":"2024-05-14T10:10:53.409756+0000","last_undegraded":"2024-05-14T10:10:53.409756+0000","last_fullsized":"2024-05-14T10:10:53.409756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:20:52.204134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'88","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.980596+0000","last_change":"2024-05-14T09:40:43.101185+0000","last_active":"2024-05-14T10:12:13.980596+0000","last_peered":"2024-05-14T10:12:13.980596+0000","last_clean":"2024-05-14T10:12:13.980596+0000","last_became_active":"2024-05-14T09:40:43.098862+0000","last_became_peered":"2024-05-14T09:40:43.098862+0000","last_unstale":"2024-05-14T10:12:13.980596+0000","last_undegraded":"2024-05-14T10:12:13.980596+0000","last_fullsized":"2024-05-14T10:12:13.980596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883346,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.488230+0000","last_change":"2024-05-14T09:40:45.752960+0000","last_active":"2024-05-14T10:12:13.488230+0000","last_peered":"2024-05-14T10:12:13.488230+0000","last_clean":"2024-05-14T10:12:13.488230+0000","last_became_active":"2024-05-14T09:40:45.752627+0000","last_became_peered":"2024-05-14T09:40:45.752627+0000","last_unstale":"2024-05-14T10:12:13.488230+0000","last_undegraded":"2024-05-14T10:12:13.488230+0000","last_fullsized":"2024-05-14T10:12:13.488230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'57","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:54.318488+0000","last_change":"2024-05-14T09:40:53.662032+0000","last_active":"2024-05-14T10:10:54.318488+0000","last_peered":"2024-05-14T10:10:54.318488+0000","last_clean":"2024-05-14T10:10:54.318488+0000","last_became_active":"2024-05-14T09:40:53.661453+0000","last_became_peered":"2024-05-14T09:40:53.661453+0000","last_unstale":"2024-05-14T10:10:54.318488+0000","last_undegraded":"2024-05-14T10:10:54.318488+0000","last_fullsized":"2024-05-14T10:10:54.318488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:11.724866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'10","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.867388+0000","last_change":"2024-05-14T09:40:43.114965+0000","last_active":"2024-05-14T10:11:57.867388+0000","last_peered":"2024-05-14T10:11:57.867388+0000","last_clean":"2024-05-14T10:11:57.867388+0000","last_became_active":"2024-05-14T09:40:43.114379+0000","last_became_peered":"2024-05-14T09:40:43.114379+0000","last_unstale":"2024-05-14T10:11:57.867388+0000","last_undegraded":"2024-05-14T10:11:57.867388+0000","last_fullsized":"2024-05-14T10:11:57.867388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:43.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'21","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630273+0000","last_change":"2024-05-14T09:40:45.758305+0000","last_active":"2024-05-14T10:12:13.630273+0000","last_peered":"2024-05-14T10:12:13.630273+0000","last_clean":"2024-05-14T10:12:13.630273+0000","last_became_active":"2024-05-14T09:40:45.754110+0000","last_became_peered":"2024-05-14T09:40:45.754110+0000","last_unstale":"2024-05-14T10:12:13.630273+0000","last_undegraded":"2024-05-14T10:12:13.630273+0000","last_fullsized":"2024-05-14T10:12:13.630273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:12:42.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'83","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:01.093757+0000","last_change":"2024-05-14T09:41:04.601574+0000","last_active":"2024-05-14T10:11:01.093757+0000","last_peered":"2024-05-14T10:11:01.093757+0000","last_clean":"2024-05-14T10:11:01.093757+0000","last_became_active":"2024-05-14T09:41:04.599475+0000","last_became_peered":"2024-05-14T09:41:04.599475+0000","last_unstale":"2024-05-14T10:11:01.093757+0000","last_undegraded":"2024-05-14T10:11:01.093757+0000","last_fullsized":"2024-05-14T10:11:01.093757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"33'3","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:44.766090+0000","last_change":"2024-05-14T09:40:43.110296+0000","last_active":"2024-05-14T10:10:44.766090+0000","last_peered":"2024-05-14T10:10:44.766090+0000","last_clean":"2024-05-14T10:10:44.766090+0000","last_became_active":"2024-05-14T09:40:43.109932+0000","last_became_peered":"2024-05-14T09:40:43.109932+0000","last_unstale":"2024-05-14T10:10:44.766090+0000","last_undegraded":"2024-05-14T10:10:44.766090+0000","last_fullsized":"2024-05-14T10:10:44.766090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:29.003048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630118+0000","last_change":"2024-05-14T09:40:45.773110+0000","last_active":"2024-05-14T10:12:13.630118+0000","last_peered":"2024-05-14T10:12:13.630118+0000","last_clean":"2024-05-14T10:12:13.630118+0000","last_became_active":"2024-05-14T09:40:45.770117+0000","last_became_peered":"2024-05-14T09:40:45.770117+0000","last_unstale":"2024-05-14T10:12:13.630118+0000","last_undegraded":"2024-05-14T10:12:13.630118+0000","last_fullsized":"2024-05-14T10:12:13.630118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:28.718450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'79","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.770815+0000","last_change":"2024-05-14T09:40:53.652049+0000","last_active":"2024-05-14T10:11:05.770815+0000","last_peered":"2024-05-14T10:11:05.770815+0000","last_clean":"2024-05-14T10:11:05.770815+0000","last_became_active":"2024-05-14T09:40:53.651570+0000","last_became_peered":"2024-05-14T09:40:53.651570+0000","last_unstale":"2024-05-14T10:11:05.770815+0000","last_undegraded":"2024-05-14T10:11:05.770815+0000","last_fullsized":"2024-05-14T10:11:05.770815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:30.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'20","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.846441+0000","last_change":"2024-05-14T09:40:45.753771+0000","last_active":"2024-05-14T10:12:13.846441+0000","last_peered":"2024-05-14T10:12:13.846441+0000","last_clean":"2024-05-14T10:12:13.846441+0000","last_became_active":"2024-05-14T09:40:45.753319+0000","last_became_peered":"2024-05-14T09:40:45.753319+0000","last_unstale":"2024-05-14T10:12:13.846441+0000","last_undegraded":"2024-05-14T10:12:13.846441+0000","last_fullsized":"2024-05-14T10:12:13.846441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'565","reported_seq":614,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.868105+0000","last_change":"2024-05-14T09:40:43.125708+0000","last_active":"2024-05-14T10:11:57.868105+0000","last_peered":"2024-05-14T10:11:57.868105+0000","last_clean":"2024-05-14T10:11:57.868105+0000","last_became_active":"2024-05-14T09:40:43.125239+0000","last_became_peered":"2024-05-14T09:40:43.125239+0000","last_unstale":"2024-05-14T10:11:57.868105+0000","last_undegraded":"2024-05-14T10:11:57.868105+0000","last_fullsized":"2024-05-14T10:11:57.868105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:22.781125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'67","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:04.491201+0000","last_change":"2024-05-14T09:40:53.663353+0000","last_active":"2024-05-14T10:11:04.491201+0000","last_peered":"2024-05-14T10:11:04.491201+0000","last_clean":"2024-05-14T10:11:04.491201+0000","last_became_active":"2024-05-14T09:40:53.662559+0000","last_became_peered":"2024-05-14T09:40:53.662559+0000","last_unstale":"2024-05-14T10:11:04.491201+0000","last_undegraded":"2024-05-14T10:11:04.491201+0000","last_fullsized":"2024-05-14T10:11:04.491201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:14.708431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'23","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.571812+0000","last_change":"2024-05-14T09:40:45.751929+0000","last_active":"2024-05-14T10:12:13.571812+0000","last_peered":"2024-05-14T10:12:13.571812+0000","last_clean":"2024-05-14T10:12:13.571812+0000","last_became_active":"2024-05-14T09:40:45.751015+0000","last_became_peered":"2024-05-14T09:40:45.751015+0000","last_unstale":"2024-05-14T10:12:13.571812+0000","last_undegraded":"2024-05-14T10:12:13.571812+0000","last_fullsized":"2024-05-14T10:12:13.571812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:12.550231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:45.882832+0000","last_change":"2024-05-14T09:40:43.023070+0000","last_active":"2024-05-14T10:11:45.882832+0000","last_peered":"2024-05-14T10:11:45.882832+0000","last_clean":"2024-05-14T10:11:45.882832+0000","last_became_active":"2024-05-14T09:40:43.022234+0000","last_became_peered":"2024-05-14T09:40:43.022234+0000","last_unstale":"2024-05-14T10:11:45.882832+0000","last_undegraded":"2024-05-14T10:11:45.882832+0000","last_fullsized":"2024-05-14T10:11:45.882832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:30:06.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'86","reported_seq":127,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.518588+0000","last_change":"2024-05-14T09:41:04.601663+0000","last_active":"2024-05-14T10:11:03.518588+0000","last_peered":"2024-05-14T10:11:03.518588+0000","last_clean":"2024-05-14T10:11:03.518588+0000","last_became_active":"2024-05-14T09:41:04.600186+0000","last_became_peered":"2024-05-14T09:41:04.600186+0000","last_unstale":"2024-05-14T10:11:03.518588+0000","last_undegraded":"2024-05-14T10:11:03.518588+0000","last_fullsized":"2024-05-14T10:11:03.518588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'22","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.531558+0000","last_change":"2024-05-14T09:40:45.746999+0000","last_active":"2024-05-14T10:12:13.531558+0000","last_peered":"2024-05-14T10:12:13.531558+0000","last_clean":"2024-05-14T10:12:13.531558+0000","last_became_active":"2024-05-14T09:40:45.746607+0000","last_became_peered":"2024-05-14T09:40:45.746607+0000","last_unstale":"2024-05-14T10:12:13.531558+0000","last_undegraded":"2024-05-14T10:12:13.531558+0000","last_fullsized":"2024-05-14T10:12:13.531558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:03.565510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'11","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.407861+0000","last_change":"2024-05-14T09:40:43.105149+0000","last_active":"2024-05-14T10:11:52.407861+0000","last_peered":"2024-05-14T10:11:52.407861+0000","last_clean":"2024-05-14T10:11:52.407861+0000","last_became_active":"2024-05-14T09:40:43.104277+0000","last_became_peered":"2024-05-14T09:40:43.104277+0000","last_unstale":"2024-05-14T10:11:52.407861+0000","last_undegraded":"2024-05-14T10:11:52.407861+0000","last_fullsized":"2024-05-14T10:11:52.407861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:48.598915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'61","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.199692+0000","last_change":"2024-05-14T09:40:53.649256+0000","last_active":"2024-05-14T10:11:00.199692+0000","last_peered":"2024-05-14T10:11:00.199692+0000","last_clean":"2024-05-14T10:11:00.199692+0000","last_became_active":"2024-05-14T09:40:53.648765+0000","last_became_peered":"2024-05-14T09:40:53.648765+0000","last_unstale":"2024-05-14T10:11:00.199692+0000","last_undegraded":"2024-05-14T10:11:00.199692+0000","last_fullsized":"2024-05-14T10:11:00.199692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:25.060381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":11669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"33'17","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.458918+0000","last_change":"2024-05-14T09:40:45.730862+0000","last_active":"2024-05-14T10:11:06.458918+0000","last_peered":"2024-05-14T10:11:06.458918+0000","last_clean":"2024-05-14T10:11:06.458918+0000","last_became_active":"2024-05-14T09:40:45.730014+0000","last_became_peered":"2024-05-14T09:40:45.730014+0000","last_unstale":"2024-05-14T10:11:06.458918+0000","last_undegraded":"2024-05-14T10:11:06.458918+0000","last_fullsized":"2024-05-14T10:11:06.458918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:05.679719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.868371+0000","last_change":"2024-05-14T09:40:43.112127+0000","last_active":"2024-05-14T10:11:57.868371+0000","last_peered":"2024-05-14T10:11:57.868371+0000","last_clean":"2024-05-14T10:11:57.868371+0000","last_became_active":"2024-05-14T09:40:43.111574+0000","last_became_peered":"2024-05-14T09:40:43.111574+0000","last_unstale":"2024-05-14T10:11:57.868371+0000","last_undegraded":"2024-05-14T10:11:57.868371+0000","last_fullsized":"2024-05-14T10:11:57.868371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:13.668017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'68","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:58.171427+0000","last_change":"2024-05-14T09:40:53.666100+0000","last_active":"2024-05-14T10:10:58.171427+0000","last_peered":"2024-05-14T10:10:58.171427+0000","last_clean":"2024-05-14T10:10:58.171427+0000","last_became_active":"2024-05-14T09:40:53.665635+0000","last_became_peered":"2024-05-14T09:40:53.665635+0000","last_unstale":"2024-05-14T10:10:58.171427+0000","last_undegraded":"2024-05-14T10:10:58.171427+0000","last_fullsized":"2024-05-14T10:10:58.171427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:21.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":6362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"33'26","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.476914+0000","last_change":"2024-05-14T09:40:45.758554+0000","last_active":"2024-05-14T10:12:13.476914+0000","last_peered":"2024-05-14T10:12:13.476914+0000","last_clean":"2024-05-14T10:12:13.476914+0000","last_became_active":"2024-05-14T09:40:45.757938+0000","last_became_peered":"2024-05-14T09:40:45.757938+0000","last_unstale":"2024-05-14T10:12:13.476914+0000","last_undegraded":"2024-05-14T10:12:13.476914+0000","last_fullsized":"2024-05-14T10:12:13.476914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.946780+0000","last_change":"2024-05-14T09:40:43.116767+0000","last_active":"2024-05-14T10:12:02.946780+0000","last_peered":"2024-05-14T10:12:02.946780+0000","last_clean":"2024-05-14T10:12:02.946780+0000","last_became_active":"2024-05-14T09:40:43.116142+0000","last_became_peered":"2024-05-14T09:40:43.116142+0000","last_unstale":"2024-05-14T10:12:02.946780+0000","last_undegraded":"2024-05-14T10:12:02.946780+0000","last_fullsized":"2024-05-14T10:12:02.946780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'50","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:56.148905+0000","last_change":"2024-05-14T09:40:53.666811+0000","last_active":"2024-05-14T10:10:56.148905+0000","last_peered":"2024-05-14T10:10:56.148905+0000","last_clean":"2024-05-14T10:10:56.148905+0000","last_became_active":"2024-05-14T09:40:53.666455+0000","last_became_peered":"2024-05-14T09:40:53.666455+0000","last_unstale":"2024-05-14T10:10:56.148905+0000","last_undegraded":"2024-05-14T10:10:56.148905+0000","last_fullsized":"2024-05-14T10:10:56.148905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:33.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":7373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'19","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.561141+0000","last_change":"2024-05-14T09:40:45.768162+0000","last_active":"2024-05-14T10:12:13.561141+0000","last_peered":"2024-05-14T10:12:13.561141+0000","last_clean":"2024-05-14T10:12:13.561141+0000","last_became_active":"2024-05-14T09:40:45.767810+0000","last_became_peered":"2024-05-14T09:40:45.767810+0000","last_unstale":"2024-05-14T10:12:13.561141+0000","last_undegraded":"2024-05-14T10:12:13.561141+0000","last_fullsized":"2024-05-14T10:12:13.561141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:25.075246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'1178","reported_seq":1227,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:11.947139+0000","last_change":"2024-05-14T09:40:43.115650+0000","last_active":"2024-05-14T10:12:11.947139+0000","last_peered":"2024-05-14T10:12:11.947139+0000","last_clean":"2024-05-14T10:12:11.947139+0000","last_became_active":"2024-05-14T09:40:43.114902+0000","last_became_peered":"2024-05-14T09:40:43.114902+0000","last_unstale":"2024-05-14T10:12:11.947139+0000","last_undegraded":"2024-05-14T10:12:11.947139+0000","last_fullsized":"2024-05-14T10:12:11.947139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1178,"log_dups_size":0,"ondisk_log_size":1178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:19.284998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2830,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'101","reported_seq":137,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:01.705830+0000","last_change":"2024-05-14T09:40:53.650297+0000","last_active":"2024-05-14T10:11:01.705830+0000","last_peered":"2024-05-14T10:11:01.705830+0000","last_clean":"2024-05-14T10:11:01.705830+0000","last_became_active":"2024-05-14T09:40:53.649263+0000","last_became_peered":"2024-05-14T09:40:53.649263+0000","last_unstale":"2024-05-14T10:11:01.705830+0000","last_undegraded":"2024-05-14T10:11:01.705830+0000","last_fullsized":"2024-05-14T10:11:01.705830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:22.637337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":14510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'21","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.483357+0000","last_change":"2024-05-14T09:40:45.733131+0000","last_active":"2024-05-14T10:12:13.483357+0000","last_peered":"2024-05-14T10:12:13.483357+0000","last_clean":"2024-05-14T10:12:13.483357+0000","last_became_active":"2024-05-14T09:40:45.732154+0000","last_became_peered":"2024-05-14T09:40:45.732154+0000","last_unstale":"2024-05-14T10:12:13.483357+0000","last_undegraded":"2024-05-14T10:12:13.483357+0000","last_fullsized":"2024-05-14T10:12:13.483357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:23:16.904648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:09.343002+0000","last_change":"2024-05-14T09:40:43.112841+0000","last_active":"2024-05-14T10:12:09.343002+0000","last_peered":"2024-05-14T10:12:09.343002+0000","last_clean":"2024-05-14T10:12:09.343002+0000","last_became_active":"2024-05-14T09:40:43.110703+0000","last_became_peered":"2024-05-14T09:40:43.110703+0000","last_unstale":"2024-05-14T10:12:09.343002+0000","last_undegraded":"2024-05-14T10:12:09.343002+0000","last_fullsized":"2024-05-14T10:12:09.343002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:01.271389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'52","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.551997+0000","last_change":"2024-05-14T09:40:53.657532+0000","last_active":"2024-05-14T10:11:05.551997+0000","last_peered":"2024-05-14T10:11:05.551997+0000","last_clean":"2024-05-14T10:11:05.551997+0000","last_became_active":"2024-05-14T09:40:53.657073+0000","last_became_peered":"2024-05-14T09:40:53.657073+0000","last_unstale":"2024-05-14T10:11:05.551997+0000","last_undegraded":"2024-05-14T10:11:05.551997+0000","last_fullsized":"2024-05-14T10:11:05.551997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:56.882153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623157+0000","last_change":"2024-05-14T09:40:45.752122+0000","last_active":"2024-05-14T10:12:13.623157+0000","last_peered":"2024-05-14T10:12:13.623157+0000","last_clean":"2024-05-14T10:12:13.623157+0000","last_became_active":"2024-05-14T09:40:45.751546+0000","last_became_peered":"2024-05-14T09:40:45.751546+0000","last_unstale":"2024-05-14T10:12:13.623157+0000","last_undegraded":"2024-05-14T10:12:13.623157+0000","last_fullsized":"2024-05-14T10:12:13.623157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:19:55.897772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"33'3","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.944302+0000","last_change":"2024-05-14T09:40:43.099478+0000","last_active":"2024-05-14T10:12:02.944302+0000","last_peered":"2024-05-14T10:12:02.944302+0000","last_clean":"2024-05-14T10:12:02.944302+0000","last_became_active":"2024-05-14T09:40:43.098776+0000","last_became_peered":"2024-05-14T09:40:43.098776+0000","last_unstale":"2024-05-14T10:12:02.944302+0000","last_undegraded":"2024-05-14T10:12:02.944302+0000","last_fullsized":"2024-05-14T10:12:02.944302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:35.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'75","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.518532+0000","last_change":"2024-05-14T09:40:53.650794+0000","last_active":"2024-05-14T10:11:05.518532+0000","last_peered":"2024-05-14T10:11:05.518532+0000","last_clean":"2024-05-14T10:11:05.518532+0000","last_became_active":"2024-05-14T09:40:53.650139+0000","last_became_peered":"2024-05-14T09:40:53.650139+0000","last_unstale":"2024-05-14T10:11:05.518532+0000","last_undegraded":"2024-05-14T10:11:05.518532+0000","last_fullsized":"2024-05-14T10:11:05.518532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:36.877806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.639330+0000","last_change":"2024-05-14T09:40:45.748430+0000","last_active":"2024-05-14T10:12:13.639330+0000","last_peered":"2024-05-14T10:12:13.639330+0000","last_clean":"2024-05-14T10:12:13.639330+0000","last_became_active":"2024-05-14T09:40:45.748048+0000","last_became_peered":"2024-05-14T09:40:45.748048+0000","last_unstale":"2024-05-14T10:12:13.639330+0000","last_undegraded":"2024-05-14T10:12:13.639330+0000","last_fullsized":"2024-05-14T10:12:13.639330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:29.240543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'5","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.424978+0000","last_change":"2024-05-14T09:40:43.088293+0000","last_active":"2024-05-14T10:11:52.424978+0000","last_peered":"2024-05-14T10:11:52.424978+0000","last_clean":"2024-05-14T10:11:52.424978+0000","last_became_active":"2024-05-14T09:40:43.087310+0000","last_became_peered":"2024-05-14T09:40:43.087310+0000","last_unstale":"2024-05-14T10:11:52.424978+0000","last_undegraded":"2024-05-14T10:11:52.424978+0000","last_fullsized":"2024-05-14T10:11:52.424978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:38.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'60","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:54.299669+0000","last_change":"2024-05-14T09:41:04.598844+0000","last_active":"2024-05-14T10:10:54.299669+0000","last_peered":"2024-05-14T10:10:54.299669+0000","last_clean":"2024-05-14T10:10:54.299669+0000","last_became_active":"2024-05-14T09:41:04.597473+0000","last_became_peered":"2024-05-14T09:41:04.597473+0000","last_unstale":"2024-05-14T10:10:54.299669+0000","last_undegraded":"2024-05-14T10:10:54.299669+0000","last_fullsized":"2024-05-14T10:10:54.299669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:48.257782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"33'26","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.469769+0000","last_change":"2024-05-14T09:40:45.740074+0000","last_active":"2024-05-14T10:12:13.469769+0000","last_peered":"2024-05-14T10:12:13.469769+0000","last_clean":"2024-05-14T10:12:13.469769+0000","last_became_active":"2024-05-14T09:40:45.739647+0000","last_became_peered":"2024-05-14T09:40:45.739647+0000","last_unstale":"2024-05-14T10:12:13.469769+0000","last_undegraded":"2024-05-14T10:12:13.469769+0000","last_fullsized":"2024-05-14T10:12:13.469769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:38.401151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'449","reported_seq":931,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630978+0000","last_change":"2024-05-14T09:40:43.043210+0000","last_active":"2024-05-14T10:12:13.630978+0000","last_peered":"2024-05-14T10:12:13.630978+0000","last_clean":"2024-05-14T10:12:13.630978+0000","last_became_active":"2024-05-14T09:40:43.042243+0000","last_became_peered":"2024-05-14T09:40:43.042243+0000","last_unstale":"2024-05-14T10:12:13.630978+0000","last_undegraded":"2024-05-14T10:12:13.630978+0000","last_fullsized":"2024-05-14T10:12:13.630978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.946422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117717,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":466,"num_write":444,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'62","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:56.110624+0000","last_change":"2024-05-14T09:40:53.652161+0000","last_active":"2024-05-14T10:10:56.110624+0000","last_peered":"2024-05-14T10:10:56.110624+0000","last_clean":"2024-05-14T10:10:56.110624+0000","last_became_active":"2024-05-14T09:40:53.649990+0000","last_became_peered":"2024-05-14T09:40:53.649990+0000","last_unstale":"2024-05-14T10:10:56.110624+0000","last_undegraded":"2024-05-14T10:10:56.110624+0000","last_fullsized":"2024-05-14T10:10:56.110624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:20:04.057127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"33'12","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.487657+0000","last_change":"2024-05-14T09:40:45.754250+0000","last_active":"2024-05-14T10:12:13.487657+0000","last_peered":"2024-05-14T10:12:13.487657+0000","last_clean":"2024-05-14T10:12:13.487657+0000","last_became_active":"2024-05-14T09:40:45.753850+0000","last_became_peered":"2024-05-14T09:40:45.753850+0000","last_unstale":"2024-05-14T10:12:13.487657+0000","last_undegraded":"2024-05-14T10:12:13.487657+0000","last_fullsized":"2024-05-14T10:12:13.487657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:15.962138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:27.863105+0000","last_change":"2024-05-14T09:40:43.111905+0000","last_active":"2024-05-14T10:11:27.863105+0000","last_peered":"2024-05-14T10:11:27.863105+0000","last_clean":"2024-05-14T10:11:27.863105+0000","last_became_active":"2024-05-14T09:40:43.108233+0000","last_became_peered":"2024-05-14T09:40:43.108233+0000","last_unstale":"2024-05-14T10:11:27.863105+0000","last_undegraded":"2024-05-14T10:11:27.863105+0000","last_fullsized":"2024-05-14T10:11:27.863105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'88","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.514041+0000","last_change":"2024-05-14T09:40:53.663789+0000","last_active":"2024-05-14T10:11:03.514041+0000","last_peered":"2024-05-14T10:11:03.514041+0000","last_clean":"2024-05-14T10:11:03.514041+0000","last_became_active":"2024-05-14T09:40:53.662980+0000","last_became_peered":"2024-05-14T09:40:53.662980+0000","last_unstale":"2024-05-14T10:11:03.514041+0000","last_undegraded":"2024-05-14T10:11:03.514041+0000","last_fullsized":"2024-05-14T10:11:03.514041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:46.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.521730+0000","last_change":"2024-05-14T09:40:45.754347+0000","last_active":"2024-05-14T10:12:13.521730+0000","last_peered":"2024-05-14T10:12:13.521730+0000","last_clean":"2024-05-14T10:12:13.521730+0000","last_became_active":"2024-05-14T09:40:45.753869+0000","last_became_peered":"2024-05-14T09:40:45.753869+0000","last_unstale":"2024-05-14T10:12:13.521730+0000","last_undegraded":"2024-05-14T10:12:13.521730+0000","last_fullsized":"2024-05-14T10:12:13.521730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'8","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:45.883971+0000","last_change":"2024-05-14T09:40:43.087481+0000","last_active":"2024-05-14T10:11:45.883971+0000","last_peered":"2024-05-14T10:11:45.883971+0000","last_clean":"2024-05-14T10:11:45.883971+0000","last_became_active":"2024-05-14T09:40:43.086487+0000","last_became_peered":"2024-05-14T09:40:43.086487+0000","last_unstale":"2024-05-14T10:11:45.883971+0000","last_undegraded":"2024-05-14T10:11:45.883971+0000","last_fullsized":"2024-05-14T10:11:45.883971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:54.225063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":148,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:08:20.122885+0000","last_change":"2024-05-14T09:40:22.705545+0000","last_active":"2024-05-14T10:08:20.122885+0000","last_peered":"2024-05-14T10:08:20.122885+0000","last_clean":"2024-05-14T10:08:20.122885+0000","last_became_active":"2024-05-14T09:40:22.701797+0000","last_became_peered":"2024-05-14T09:40:22.701797+0000","last_unstale":"2024-05-14T10:08:20.122885+0000","last_undegraded":"2024-05-14T10:08:20.122885+0000","last_fullsized":"2024-05-14T10:08:20.122885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_clean_scrub_stamp":"2024-05-14T09:40:17.767400+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:48:21.700172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'61","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:49.080123+0000","last_change":"2024-05-14T09:40:53.681915+0000","last_active":"2024-05-14T10:10:49.080123+0000","last_peered":"2024-05-14T10:10:49.080123+0000","last_clean":"2024-05-14T10:10:49.080123+0000","last_became_active":"2024-05-14T09:40:53.681296+0000","last_became_peered":"2024-05-14T09:40:53.681296+0000","last_unstale":"2024-05-14T10:10:49.080123+0000","last_undegraded":"2024-05-14T10:10:49.080123+0000","last_fullsized":"2024-05-14T10:10:49.080123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:21.455981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'23","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.633400+0000","last_change":"2024-05-14T09:41:04.213355+0000","last_active":"2024-05-14T10:12:13.633400+0000","last_peered":"2024-05-14T10:12:13.633400+0000","last_clean":"2024-05-14T10:12:13.633400+0000","last_became_active":"2024-05-14T09:41:04.212709+0000","last_became_peered":"2024-05-14T09:41:04.212709+0000","last_unstale":"2024-05-14T10:12:13.633400+0000","last_undegraded":"2024-05-14T10:12:13.633400+0000","last_fullsized":"2024-05-14T10:12:13.633400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"33'5","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.892390+0000","last_change":"2024-05-14T09:40:43.090401+0000","last_active":"2024-05-14T10:12:02.892390+0000","last_peered":"2024-05-14T10:12:02.892390+0000","last_clean":"2024-05-14T10:12:02.892390+0000","last_became_active":"2024-05-14T09:40:43.089548+0000","last_became_peered":"2024-05-14T09:40:43.089548+0000","last_unstale":"2024-05-14T10:12:02.892390+0000","last_undegraded":"2024-05-14T10:12:02.892390+0000","last_fullsized":"2024-05-14T10:12:02.892390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:03.385598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'79","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:07.506476+0000","last_change":"2024-05-14T09:40:53.677072+0000","last_active":"2024-05-14T10:11:07.506476+0000","last_peered":"2024-05-14T10:11:07.506476+0000","last_clean":"2024-05-14T10:11:07.506476+0000","last_became_active":"2024-05-14T09:40:53.676636+0000","last_became_peered":"2024-05-14T09:40:53.676636+0000","last_unstale":"2024-05-14T10:11:07.506476+0000","last_undegraded":"2024-05-14T10:11:07.506476+0000","last_fullsized":"2024-05-14T10:11:07.506476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":7859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'21","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623051+0000","last_change":"2024-05-14T09:40:45.750962+0000","last_active":"2024-05-14T10:12:13.623051+0000","last_peered":"2024-05-14T10:12:13.623051+0000","last_clean":"2024-05-14T10:12:13.623051+0000","last_became_active":"2024-05-14T09:40:45.750539+0000","last_became_peered":"2024-05-14T09:40:45.750539+0000","last_unstale":"2024-05-14T10:12:13.623051+0000","last_undegraded":"2024-05-14T10:12:13.623051+0000","last_fullsized":"2024-05-14T10:12:13.623051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:42.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:39.462630+0000","last_change":"2024-05-14T09:40:43.122483+0000","last_active":"2024-05-14T10:11:39.462630+0000","last_peered":"2024-05-14T10:11:39.462630+0000","last_clean":"2024-05-14T10:11:39.462630+0000","last_became_active":"2024-05-14T09:40:43.121427+0000","last_became_peered":"2024-05-14T09:40:43.121427+0000","last_unstale":"2024-05-14T10:11:39.462630+0000","last_undegraded":"2024-05-14T10:11:39.462630+0000","last_fullsized":"2024-05-14T10:11:39.462630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:31.384470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'90","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:58.172126+0000","last_change":"2024-05-14T09:40:53.656157+0000","last_active":"2024-05-14T10:10:58.172126+0000","last_peered":"2024-05-14T10:10:58.172126+0000","last_clean":"2024-05-14T10:10:58.172126+0000","last_became_active":"2024-05-14T09:40:53.655141+0000","last_became_peered":"2024-05-14T09:40:53.655141+0000","last_unstale":"2024-05-14T10:10:58.172126+0000","last_undegraded":"2024-05-14T10:10:58.172126+0000","last_fullsized":"2024-05-14T10:10:58.172126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'24","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655627+0000","last_change":"2024-05-14T09:40:45.778555+0000","last_active":"2024-05-14T10:12:13.655627+0000","last_peered":"2024-05-14T10:12:13.655627+0000","last_clean":"2024-05-14T10:12:13.655627+0000","last_became_active":"2024-05-14T09:40:45.776967+0000","last_became_peered":"2024-05-14T09:40:45.776967+0000","last_unstale":"2024-05-14T10:12:13.655627+0000","last_undegraded":"2024-05-14T10:12:13.655627+0000","last_fullsized":"2024-05-14T10:12:13.655627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:45:35.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"33'3","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:10.445726+0000","last_change":"2024-05-14T09:40:43.043359+0000","last_active":"2024-05-14T10:12:10.445726+0000","last_peered":"2024-05-14T10:12:10.445726+0000","last_clean":"2024-05-14T10:12:10.445726+0000","last_became_active":"2024-05-14T09:40:43.042486+0000","last_became_peered":"2024-05-14T09:40:43.042486+0000","last_unstale":"2024-05-14T10:12:10.445726+0000","last_undegraded":"2024-05-14T10:12:10.445726+0000","last_fullsized":"2024-05-14T10:12:10.445726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:15.480365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'69","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.556561+0000","last_change":"2024-05-14T09:40:53.662719+0000","last_active":"2024-05-14T10:11:05.556561+0000","last_peered":"2024-05-14T10:11:05.556561+0000","last_clean":"2024-05-14T10:11:05.556561+0000","last_became_active":"2024-05-14T09:40:53.660933+0000","last_became_peered":"2024-05-14T09:40:53.660933+0000","last_unstale":"2024-05-14T10:11:05.556561+0000","last_undegraded":"2024-05-14T10:11:05.556561+0000","last_fullsized":"2024-05-14T10:11:05.556561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:02.584358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'15","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655467+0000","last_change":"2024-05-14T09:40:45.776336+0000","last_active":"2024-05-14T10:12:13.655467+0000","last_peered":"2024-05-14T10:12:13.655467+0000","last_clean":"2024-05-14T10:12:13.655467+0000","last_became_active":"2024-05-14T09:40:45.775936+0000","last_became_peered":"2024-05-14T09:40:45.775936+0000","last_unstale":"2024-05-14T10:12:13.655467+0000","last_undegraded":"2024-05-14T10:12:13.655467+0000","last_fullsized":"2024-05-14T10:12:13.655467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:59.300900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'7","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:46.920404+0000","last_change":"2024-05-14T09:40:43.124714+0000","last_active":"2024-05-14T10:11:46.920404+0000","last_peered":"2024-05-14T10:11:46.920404+0000","last_clean":"2024-05-14T10:11:46.920404+0000","last_became_active":"2024-05-14T09:40:43.124370+0000","last_became_peered":"2024-05-14T09:40:43.124370+0000","last_unstale":"2024-05-14T10:11:46.920404+0000","last_undegraded":"2024-05-14T10:11:46.920404+0000","last_fullsized":"2024-05-14T10:11:46.920404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:52.132214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'76","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.457975+0000","last_change":"2024-05-14T09:40:53.667102+0000","last_active":"2024-05-14T10:11:06.457975+0000","last_peered":"2024-05-14T10:11:06.457975+0000","last_clean":"2024-05-14T10:11:06.457975+0000","last_became_active":"2024-05-14T09:40:53.666666+0000","last_became_peered":"2024-05-14T09:40:53.666666+0000","last_unstale":"2024-05-14T10:11:06.457975+0000","last_undegraded":"2024-05-14T10:11:06.457975+0000","last_fullsized":"2024-05-14T10:11:06.457975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'22","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.645621+0000","last_change":"2024-05-14T09:40:45.777251+0000","last_active":"2024-05-14T10:12:13.645621+0000","last_peered":"2024-05-14T10:12:13.645621+0000","last_clean":"2024-05-14T10:12:13.645621+0000","last_became_active":"2024-05-14T09:40:45.775668+0000","last_became_peered":"2024-05-14T09:40:45.775668+0000","last_unstale":"2024-05-14T10:12:13.645621+0000","last_undegraded":"2024-05-14T10:12:13.645621+0000","last_fullsized":"2024-05-14T10:12:13.645621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:54.917354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'18","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.417385+0000","last_change":"2024-05-14T09:40:43.040000+0000","last_active":"2024-05-14T10:11:52.417385+0000","last_peered":"2024-05-14T10:11:52.417385+0000","last_clean":"2024-05-14T10:11:52.417385+0000","last_became_active":"2024-05-14T09:40:43.039186+0000","last_became_peered":"2024-05-14T09:40:43.039186+0000","last_unstale":"2024-05-14T10:11:52.417385+0000","last_undegraded":"2024-05-14T10:11:52.417385+0000","last_fullsized":"2024-05-14T10:11:52.417385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:41:44.514114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'79","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.461104+0000","last_change":"2024-05-14T09:40:53.667056+0000","last_active":"2024-05-14T10:11:03.461104+0000","last_peered":"2024-05-14T10:11:03.461104+0000","last_clean":"2024-05-14T10:11:03.461104+0000","last_became_active":"2024-05-14T09:40:53.666575+0000","last_became_peered":"2024-05-14T09:40:53.666575+0000","last_unstale":"2024-05-14T10:11:03.461104+0000","last_undegraded":"2024-05-14T10:11:03.461104+0000","last_fullsized":"2024-05-14T10:11:03.461104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":7996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'21","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.850810+0000","last_change":"2024-05-14T09:40:45.754466+0000","last_active":"2024-05-14T10:12:13.850810+0000","last_peered":"2024-05-14T10:12:13.850810+0000","last_clean":"2024-05-14T10:12:13.850810+0000","last_became_active":"2024-05-14T09:40:45.753839+0000","last_became_peered":"2024-05-14T09:40:45.753839+0000","last_unstale":"2024-05-14T10:12:13.850810+0000","last_undegraded":"2024-05-14T10:12:13.850810+0000","last_fullsized":"2024-05-14T10:12:13.850810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'5","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:34.188111+0000","last_change":"2024-05-14T09:40:43.121744+0000","last_active":"2024-05-14T10:11:34.188111+0000","last_peered":"2024-05-14T10:11:34.188111+0000","last_clean":"2024-05-14T10:11:34.188111+0000","last_became_active":"2024-05-14T09:40:43.121388+0000","last_became_peered":"2024-05-14T09:40:43.121388+0000","last_unstale":"2024-05-14T10:11:34.188111+0000","last_undegraded":"2024-05-14T10:11:34.188111+0000","last_fullsized":"2024-05-14T10:11:34.188111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'76","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.890093+0000","last_change":"2024-05-14T09:40:53.659658+0000","last_active":"2024-05-14T10:11:00.890093+0000","last_peered":"2024-05-14T10:11:00.890093+0000","last_clean":"2024-05-14T10:11:00.890093+0000","last_became_active":"2024-05-14T09:40:53.659191+0000","last_became_peered":"2024-05-14T09:40:53.659191+0000","last_unstale":"2024-05-14T10:11:00.890093+0000","last_undegraded":"2024-05-14T10:11:00.890093+0000","last_fullsized":"2024-05-14T10:11:00.890093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:15:39.587593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":8058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655238+0000","last_change":"2024-05-14T09:40:45.776748+0000","last_active":"2024-05-14T10:12:13.655238+0000","last_peered":"2024-05-14T10:12:13.655238+0000","last_clean":"2024-05-14T10:12:13.655238+0000","last_became_active":"2024-05-14T09:40:45.776451+0000","last_became_peered":"2024-05-14T09:40:45.776451+0000","last_unstale":"2024-05-14T10:12:13.655238+0000","last_undegraded":"2024-05-14T10:12:13.655238+0000","last_fullsized":"2024-05-14T10:12:13.655238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:39.890407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:09.356299+0000","last_change":"2024-05-14T09:40:43.086185+0000","last_active":"2024-05-14T10:12:09.356299+0000","last_peered":"2024-05-14T10:12:09.356299+0000","last_clean":"2024-05-14T10:12:09.356299+0000","last_became_active":"2024-05-14T09:40:43.085320+0000","last_became_peered":"2024-05-14T09:40:43.085320+0000","last_unstale":"2024-05-14T10:12:09.356299+0000","last_undegraded":"2024-05-14T10:12:09.356299+0000","last_fullsized":"2024-05-14T10:12:09.356299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:26:22.301593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'63","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:01.698322+0000","last_change":"2024-05-14T09:40:53.673710+0000","last_active":"2024-05-14T10:11:01.698322+0000","last_peered":"2024-05-14T10:11:01.698322+0000","last_clean":"2024-05-14T10:11:01.698322+0000","last_became_active":"2024-05-14T09:40:53.672089+0000","last_became_peered":"2024-05-14T09:40:53.672089+0000","last_unstale":"2024-05-14T10:11:01.698322+0000","last_undegraded":"2024-05-14T10:11:01.698322+0000","last_fullsized":"2024-05-14T10:11:01.698322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:48:16.697615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":6897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'25","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.484748+0000","last_change":"2024-05-14T09:40:45.767220+0000","last_active":"2024-05-14T10:12:13.484748+0000","last_peered":"2024-05-14T10:12:13.484748+0000","last_clean":"2024-05-14T10:12:13.484748+0000","last_became_active":"2024-05-14T09:40:45.766895+0000","last_became_peered":"2024-05-14T09:40:45.766895+0000","last_unstale":"2024-05-14T10:12:13.484748+0000","last_undegraded":"2024-05-14T10:12:13.484748+0000","last_fullsized":"2024-05-14T10:12:13.484748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'10","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:34.189842+0000","last_change":"2024-05-14T09:40:43.124937+0000","last_active":"2024-05-14T10:11:34.189842+0000","last_peered":"2024-05-14T10:11:34.189842+0000","last_clean":"2024-05-14T10:11:34.189842+0000","last_became_active":"2024-05-14T09:40:43.124129+0000","last_became_peered":"2024-05-14T09:40:43.124129+0000","last_unstale":"2024-05-14T10:11:34.189842+0000","last_undegraded":"2024-05-14T10:11:34.189842+0000","last_fullsized":"2024-05-14T10:11:34.189842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'71","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.445761+0000","last_change":"2024-05-14T09:40:53.664722+0000","last_active":"2024-05-14T10:11:06.445761+0000","last_peered":"2024-05-14T10:11:06.445761+0000","last_clean":"2024-05-14T10:11:06.445761+0000","last_became_active":"2024-05-14T09:40:53.664194+0000","last_became_peered":"2024-05-14T09:40:53.664194+0000","last_unstale":"2024-05-14T10:11:06.445761+0000","last_undegraded":"2024-05-14T10:11:06.445761+0000","last_fullsized":"2024-05-14T10:11:06.445761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:35:57.826557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":7358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'20","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.643712+0000","last_change":"2024-05-14T09:40:45.770662+0000","last_active":"2024-05-14T10:12:13.643712+0000","last_peered":"2024-05-14T10:12:13.643712+0000","last_clean":"2024-05-14T10:12:13.643712+0000","last_became_active":"2024-05-14T09:40:45.768058+0000","last_became_peered":"2024-05-14T09:40:45.768058+0000","last_unstale":"2024-05-14T10:12:13.643712+0000","last_undegraded":"2024-05-14T10:12:13.643712+0000","last_fullsized":"2024-05-14T10:12:13.643712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:13.296625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'824","reported_seq":872,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:56.423487+0000","last_change":"2024-05-14T09:40:43.113989+0000","last_active":"2024-05-14T10:11:56.423487+0000","last_peered":"2024-05-14T10:11:56.423487+0000","last_clean":"2024-05-14T10:11:56.423487+0000","last_became_active":"2024-05-14T09:40:43.113589+0000","last_became_peered":"2024-05-14T09:40:43.113589+0000","last_unstale":"2024-05-14T10:11:56.423487+0000","last_undegraded":"2024-05-14T10:11:56.423487+0000","last_fullsized":"2024-05-14T10:11:56.423487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:42:17.351523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'80","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:04.469761+0000","last_change":"2024-05-14T09:40:53.663887+0000","last_active":"2024-05-14T10:11:04.469761+0000","last_peered":"2024-05-14T10:11:04.469761+0000","last_clean":"2024-05-14T10:11:04.469761+0000","last_became_active":"2024-05-14T09:40:53.663419+0000","last_became_peered":"2024-05-14T09:40:53.663419+0000","last_unstale":"2024-05-14T10:11:04.469761+0000","last_undegraded":"2024-05-14T10:11:04.469761+0000","last_fullsized":"2024-05-14T10:11:04.469761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:18.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":12628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"33'24","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.653832+0000","last_change":"2024-05-14T09:40:45.767184+0000","last_active":"2024-05-14T10:12:13.653832+0000","last_peered":"2024-05-14T10:12:13.653832+0000","last_clean":"2024-05-14T10:12:13.653832+0000","last_became_active":"2024-05-14T09:40:45.766784+0000","last_became_peered":"2024-05-14T09:40:45.766784+0000","last_unstale":"2024-05-14T10:12:13.653832+0000","last_undegraded":"2024-05-14T10:12:13.653832+0000","last_fullsized":"2024-05-14T10:12:13.653832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'307","reported_seq":355,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:12.356956+0000","last_change":"2024-05-14T09:40:43.089869+0000","last_active":"2024-05-14T10:12:12.356956+0000","last_peered":"2024-05-14T10:12:12.356956+0000","last_clean":"2024-05-14T10:12:12.356956+0000","last_became_active":"2024-05-14T09:40:43.088906+0000","last_became_peered":"2024-05-14T09:40:43.088906+0000","last_unstale":"2024-05-14T10:12:12.356956+0000","last_undegraded":"2024-05-14T10:12:12.356956+0000","last_fullsized":"2024-05-14T10:12:12.356956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:28.223322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'115","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.819059+0000","last_change":"2024-05-14T09:40:53.667412+0000","last_active":"2024-05-14T10:11:05.819059+0000","last_peered":"2024-05-14T10:11:05.819059+0000","last_clean":"2024-05-14T10:11:05.819059+0000","last_became_active":"2024-05-14T09:40:53.666533+0000","last_became_peered":"2024-05-14T09:40:53.666533+0000","last_unstale":"2024-05-14T10:11:05.819059+0000","last_undegraded":"2024-05-14T10:11:05.819059+0000","last_fullsized":"2024-05-14T10:11:05.819059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:53:41.310701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'25","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.473306+0000","last_change":"2024-05-14T09:41:04.250664+0000","last_active":"2024-05-14T10:12:13.473306+0000","last_peered":"2024-05-14T10:12:13.473306+0000","last_clean":"2024-05-14T10:12:13.473306+0000","last_became_active":"2024-05-14T09:41:04.250043+0000","last_became_peered":"2024-05-14T09:41:04.250043+0000","last_unstale":"2024-05-14T10:12:13.473306+0000","last_undegraded":"2024-05-14T10:12:13.473306+0000","last_fullsized":"2024-05-14T10:12:13.473306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:46:49.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:54.436624+0000","last_change":"2024-05-14T09:40:43.116130+0000","last_active":"2024-05-14T10:11:54.436624+0000","last_peered":"2024-05-14T10:11:54.436624+0000","last_clean":"2024-05-14T10:11:54.436624+0000","last_became_active":"2024-05-14T09:40:43.115741+0000","last_became_peered":"2024-05-14T09:40:43.115741+0000","last_unstale":"2024-05-14T10:11:54.436624+0000","last_undegraded":"2024-05-14T10:11:54.436624+0000","last_fullsized":"2024-05-14T10:11:54.436624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:35.083285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'83","reported_seq":117,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.889971+0000","last_change":"2024-05-14T09:40:53.667088+0000","last_active":"2024-05-14T10:11:00.889971+0000","last_peered":"2024-05-14T10:11:00.889971+0000","last_clean":"2024-05-14T10:11:00.889971+0000","last_became_active":"2024-05-14T09:40:53.662581+0000","last_became_peered":"2024-05-14T09:40:53.662581+0000","last_unstale":"2024-05-14T10:11:00.889971+0000","last_undegraded":"2024-05-14T10:11:00.889971+0000","last_fullsized":"2024-05-14T10:11:00.889971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:14:18.824424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.617351+0000","last_change":"2024-05-14T09:40:45.774302+0000","last_active":"2024-05-14T10:12:13.617351+0000","last_peered":"2024-05-14T10:12:13.617351+0000","last_clean":"2024-05-14T10:12:13.617351+0000","last_became_active":"2024-05-14T09:40:45.773879+0000","last_became_peered":"2024-05-14T09:40:45.773879+0000","last_unstale":"2024-05-14T10:12:13.617351+0000","last_undegraded":"2024-05-14T10:12:13.617351+0000","last_fullsized":"2024-05-14T10:12:13.617351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:09.921679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:10.831471+0000","last_change":"2024-05-14T09:40:43.116616+0000","last_active":"2024-05-14T10:12:10.831471+0000","last_peered":"2024-05-14T10:12:10.831471+0000","last_clean":"2024-05-14T10:12:10.831471+0000","last_became_active":"2024-05-14T09:40:43.115166+0000","last_became_peered":"2024-05-14T09:40:43.115166+0000","last_unstale":"2024-05-14T10:12:10.831471+0000","last_undegraded":"2024-05-14T10:12:10.831471+0000","last_fullsized":"2024-05-14T10:12:10.831471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:52.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'85","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:51.094065+0000","last_change":"2024-05-14T09:40:53.668423+0000","last_active":"2024-05-14T10:10:51.094065+0000","last_peered":"2024-05-14T10:10:51.094065+0000","last_clean":"2024-05-14T10:10:51.094065+0000","last_became_active":"2024-05-14T09:40:53.664838+0000","last_became_peered":"2024-05-14T09:40:53.664838+0000","last_unstale":"2024-05-14T10:10:51.094065+0000","last_undegraded":"2024-05-14T10:10:51.094065+0000","last_fullsized":"2024-05-14T10:10:51.094065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:00:35.633754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":10155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'59","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.793458+0000","last_change":"2024-05-14T09:40:53.656095+0000","last_active":"2024-05-14T10:11:00.793458+0000","last_peered":"2024-05-14T10:11:00.793458+0000","last_clean":"2024-05-14T10:11:00.793458+0000","last_became_active":"2024-05-14T09:40:53.655439+0000","last_became_peered":"2024-05-14T09:40:53.655439+0000","last_unstale":"2024-05-14T10:11:00.793458+0000","last_undegraded":"2024-05-14T10:11:00.793458+0000","last_fullsized":"2024-05-14T10:11:00.793458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:44.521319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.501706+0000","last_change":"2024-05-14T09:40:45.744447+0000","last_active":"2024-05-14T10:12:13.501706+0000","last_peered":"2024-05-14T10:12:13.501706+0000","last_clean":"2024-05-14T10:12:13.501706+0000","last_became_active":"2024-05-14T09:40:45.743611+0000","last_became_peered":"2024-05-14T09:40:45.743611+0000","last_unstale":"2024-05-14T10:12:13.501706+0000","last_undegraded":"2024-05-14T10:12:13.501706+0000","last_fullsized":"2024-05-14T10:12:13.501706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:56.519183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'7","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:04.107149+0000","last_change":"2024-05-14T09:40:43.122005+0000","last_active":"2024-05-14T10:12:04.107149+0000","last_peered":"2024-05-14T10:12:04.107149+0000","last_clean":"2024-05-14T10:12:04.107149+0000","last_became_active":"2024-05-14T09:40:43.121629+0000","last_became_peered":"2024-05-14T09:40:43.121629+0000","last_unstale":"2024-05-14T10:12:04.107149+0000","last_undegraded":"2024-05-14T10:12:04.107149+0000","last_fullsized":"2024-05-14T10:12:04.107149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:31:03.016812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'63","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.462172+0000","last_change":"2024-05-14T09:40:53.679415+0000","last_active":"2024-05-14T10:11:03.462172+0000","last_peered":"2024-05-14T10:11:03.462172+0000","last_clean":"2024-05-14T10:11:03.462172+0000","last_became_active":"2024-05-14T09:40:53.678851+0000","last_became_peered":"2024-05-14T09:40:53.678851+0000","last_unstale":"2024-05-14T10:11:03.462172+0000","last_undegraded":"2024-05-14T10:11:03.462172+0000","last_fullsized":"2024-05-14T10:11:03.462172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:48.049763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.537840+0000","last_change":"2024-05-14T09:40:45.743111+0000","last_active":"2024-05-14T10:12:13.537840+0000","last_peered":"2024-05-14T10:12:13.537840+0000","last_clean":"2024-05-14T10:12:13.537840+0000","last_became_active":"2024-05-14T09:40:45.742702+0000","last_became_peered":"2024-05-14T09:40:45.742702+0000","last_unstale":"2024-05-14T10:12:13.537840+0000","last_undegraded":"2024-05-14T10:12:13.537840+0000","last_fullsized":"2024-05-14T10:12:13.537840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:17:39.673477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.984144+0000","last_change":"2024-05-14T09:40:43.116535+0000","last_active":"2024-05-14T10:12:02.984144+0000","last_peered":"2024-05-14T10:12:02.984144+0000","last_clean":"2024-05-14T10:12:02.984144+0000","last_became_active":"2024-05-14T09:40:43.115860+0000","last_became_peered":"2024-05-14T09:40:43.115860+0000","last_unstale":"2024-05-14T10:12:02.984144+0000","last_undegraded":"2024-05-14T10:12:02.984144+0000","last_fullsized":"2024-05-14T10:12:02.984144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'339","reported_seq":386,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.430157+0000","last_change":"2024-05-14T09:40:43.120700+0000","last_active":"2024-05-14T10:11:52.430157+0000","last_peered":"2024-05-14T10:11:52.430157+0000","last_clean":"2024-05-14T10:11:52.430157+0000","last_became_active":"2024-05-14T09:40:43.120353+0000","last_became_peered":"2024-05-14T09:40:43.120353+0000","last_unstale":"2024-05-14T10:11:52.430157+0000","last_undegraded":"2024-05-14T10:11:52.430157+0000","last_fullsized":"2024-05-14T10:11:52.430157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:35.425012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'24","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.485676+0000","last_change":"2024-05-14T09:40:45.758385+0000","last_active":"2024-05-14T10:12:13.485676+0000","last_peered":"2024-05-14T10:12:13.485676+0000","last_clean":"2024-05-14T10:12:13.485676+0000","last_became_active":"2024-05-14T09:40:45.758017+0000","last_became_peered":"2024-05-14T09:40:45.758017+0000","last_unstale":"2024-05-14T10:12:13.485676+0000","last_undegraded":"2024-05-14T10:12:13.485676+0000","last_fullsized":"2024-05-14T10:12:13.485676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'56","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.890744+0000","last_change":"2024-05-14T09:40:53.671995+0000","last_active":"2024-05-14T10:11:00.890744+0000","last_peered":"2024-05-14T10:11:00.890744+0000","last_clean":"2024-05-14T10:11:00.890744+0000","last_became_active":"2024-05-14T09:40:53.671145+0000","last_became_peered":"2024-05-14T09:40:53.671145+0000","last_unstale":"2024-05-14T10:11:00.890744+0000","last_undegraded":"2024-05-14T10:11:00.890744+0000","last_fullsized":"2024-05-14T10:11:00.890744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:02.991096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'472","reported_seq":519,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.865101+0000","last_change":"2024-05-14T09:40:43.105812+0000","last_active":"2024-05-14T10:11:57.865101+0000","last_peered":"2024-05-14T10:11:57.865101+0000","last_clean":"2024-05-14T10:11:57.865101+0000","last_became_active":"2024-05-14T09:40:43.104821+0000","last_became_peered":"2024-05-14T09:40:43.104821+0000","last_unstale":"2024-05-14T10:11:57.865101+0000","last_undegraded":"2024-05-14T10:11:57.865101+0000","last_fullsized":"2024-05-14T10:11:57.865101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'22","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.640694+0000","last_change":"2024-05-14T09:40:45.746294+0000","last_active":"2024-05-14T10:12:13.640694+0000","last_peered":"2024-05-14T10:12:13.640694+0000","last_clean":"2024-05-14T10:12:13.640694+0000","last_became_active":"2024-05-14T09:40:45.745850+0000","last_became_peered":"2024-05-14T09:40:45.745850+0000","last_unstale":"2024-05-14T10:12:13.640694+0000","last_undegraded":"2024-05-14T10:12:13.640694+0000","last_fullsized":"2024-05-14T10:12:13.640694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:17.774486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'74","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:58.132031+0000","last_change":"2024-05-14T09:40:53.670990+0000","last_active":"2024-05-14T10:10:58.132031+0000","last_peered":"2024-05-14T10:10:58.132031+0000","last_clean":"2024-05-14T10:10:58.132031+0000","last_became_active":"2024-05-14T09:40:53.669094+0000","last_became_peered":"2024-05-14T09:40:53.669094+0000","last_unstale":"2024-05-14T10:10:58.132031+0000","last_undegraded":"2024-05-14T10:10:58.132031+0000","last_fullsized":"2024-05-14T10:10:58.132031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:35:15.483140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":7350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.851152+0000","last_change":"2024-05-14T09:40:45.754615+0000","last_active":"2024-05-14T10:12:13.851152+0000","last_peered":"2024-05-14T10:12:13.851152+0000","last_clean":"2024-05-14T10:12:13.851152+0000","last_became_active":"2024-05-14T09:40:45.754283+0000","last_became_peered":"2024-05-14T09:40:45.754283+0000","last_unstale":"2024-05-14T10:12:13.851152+0000","last_undegraded":"2024-05-14T10:12:13.851152+0000","last_fullsized":"2024-05-14T10:12:13.851152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'26","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.628640+0000","last_change":"2024-05-14T09:40:45.753218+0000","last_active":"2024-05-14T10:12:13.628640+0000","last_peered":"2024-05-14T10:12:13.628640+0000","last_clean":"2024-05-14T10:12:13.628640+0000","last_became_active":"2024-05-14T09:40:45.752599+0000","last_became_peered":"2024-05-14T09:40:45.752599+0000","last_unstale":"2024-05-14T10:12:13.628640+0000","last_undegraded":"2024-05-14T10:12:13.628640+0000","last_fullsized":"2024-05-14T10:12:13.628640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'26","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.615687+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T10:12:13.615687+0000","last_peered":"2024-05-14T10:12:13.615687+0000","last_clean":"2024-05-14T10:12:13.615687+0000","last_became_active":"2024-05-14T09:40:45.750387+0000","last_became_peered":"2024-05-14T09:40:45.750387+0000","last_unstale":"2024-05-14T10:12:13.615687+0000","last_undegraded":"2024-05-14T10:12:13.615687+0000","last_fullsized":"2024-05-14T10:12:13.615687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:54.689111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'18","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.475232+0000","last_change":"2024-05-14T09:41:04.251002+0000","last_active":"2024-05-14T10:12:13.475232+0000","last_peered":"2024-05-14T10:12:13.475232+0000","last_clean":"2024-05-14T10:12:13.475232+0000","last_became_active":"2024-05-14T09:41:04.250037+0000","last_became_peered":"2024-05-14T09:41:04.250037+0000","last_unstale":"2024-05-14T10:12:13.475232+0000","last_undegraded":"2024-05-14T10:12:13.475232+0000","last_fullsized":"2024-05-14T10:12:13.475232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:42:35.669137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'17","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.572074+0000","last_change":"2024-05-14T09:40:45.723956+0000","last_active":"2024-05-14T10:12:13.572074+0000","last_peered":"2024-05-14T10:12:13.572074+0000","last_clean":"2024-05-14T10:12:13.572074+0000","last_became_active":"2024-05-14T09:40:45.723040+0000","last_became_peered":"2024-05-14T09:40:45.723040+0000","last_unstale":"2024-05-14T10:12:13.572074+0000","last_undegraded":"2024-05-14T10:12:13.572074+0000","last_fullsized":"2024-05-14T10:12:13.572074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:45.690725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'18","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.485881+0000","last_change":"2024-05-14T09:40:45.746942+0000","last_active":"2024-05-14T10:12:13.485881+0000","last_peered":"2024-05-14T10:12:13.485881+0000","last_clean":"2024-05-14T10:12:13.485881+0000","last_became_active":"2024-05-14T09:40:45.745393+0000","last_became_peered":"2024-05-14T09:40:45.745393+0000","last_unstale":"2024-05-14T10:12:13.485881+0000","last_undegraded":"2024-05-14T10:12:13.485881+0000","last_fullsized":"2024-05-14T10:12:13.485881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:37.377406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'32","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.860871+0000","last_change":"2024-05-14T09:40:45.772238+0000","last_active":"2024-05-14T10:12:13.860871+0000","last_peered":"2024-05-14T10:12:13.860871+0000","last_clean":"2024-05-14T10:12:13.860871+0000","last_became_active":"2024-05-14T09:40:45.771838+0000","last_became_peered":"2024-05-14T09:40:45.771838+0000","last_unstale":"2024-05-14T10:12:13.860871+0000","last_undegraded":"2024-05-14T10:12:13.860871+0000","last_fullsized":"2024-05-14T10:12:13.860871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"33'17","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.502633+0000","last_change":"2024-05-14T09:40:45.727770+0000","last_active":"2024-05-14T10:12:13.502633+0000","last_peered":"2024-05-14T10:12:13.502633+0000","last_clean":"2024-05-14T10:12:13.502633+0000","last_became_active":"2024-05-14T09:40:45.725283+0000","last_became_peered":"2024-05-14T09:40:45.725283+0000","last_unstale":"2024-05-14T10:12:13.502633+0000","last_undegraded":"2024-05-14T10:12:13.502633+0000","last_fullsized":"2024-05-14T10:12:13.502633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:22.638700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'19","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.624093+0000","last_change":"2024-05-14T09:40:45.749288+0000","last_active":"2024-05-14T10:12:13.624093+0000","last_peered":"2024-05-14T10:12:13.624093+0000","last_clean":"2024-05-14T10:12:13.624093+0000","last_became_active":"2024-05-14T09:40:45.748925+0000","last_became_peered":"2024-05-14T09:40:45.748925+0000","last_unstale":"2024-05-14T10:12:13.624093+0000","last_undegraded":"2024-05-14T10:12:13.624093+0000","last_fullsized":"2024-05-14T10:12:13.624093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:03.576418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'25","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.557987+0000","last_change":"2024-05-14T09:40:45.724197+0000","last_active":"2024-05-14T10:12:13.557987+0000","last_peered":"2024-05-14T10:12:13.557987+0000","last_clean":"2024-05-14T10:12:13.557987+0000","last_became_active":"2024-05-14T09:40:45.723317+0000","last_became_peered":"2024-05-14T09:40:45.723317+0000","last_unstale":"2024-05-14T10:12:13.557987+0000","last_undegraded":"2024-05-14T10:12:13.557987+0000","last_fullsized":"2024-05-14T10:12:13.557987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'24","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.621654+0000","last_change":"2024-05-14T09:40:45.770723+0000","last_active":"2024-05-14T10:12:13.621654+0000","last_peered":"2024-05-14T10:12:13.621654+0000","last_clean":"2024-05-14T10:12:13.621654+0000","last_became_active":"2024-05-14T09:40:45.769772+0000","last_became_peered":"2024-05-14T09:40:45.769772+0000","last_unstale":"2024-05-14T10:12:13.621654+0000","last_undegraded":"2024-05-14T10:12:13.621654+0000","last_fullsized":"2024-05-14T10:12:13.621654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:44.852533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"33'33","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.486834+0000","last_change":"2024-05-14T09:40:45.766217+0000","last_active":"2024-05-14T10:12:13.486834+0000","last_peered":"2024-05-14T10:12:13.486834+0000","last_clean":"2024-05-14T10:12:13.486834+0000","last_became_active":"2024-05-14T09:40:45.765830+0000","last_became_peered":"2024-05-14T09:40:45.765830+0000","last_unstale":"2024-05-14T10:12:13.486834+0000","last_undegraded":"2024-05-14T10:12:13.486834+0000","last_fullsized":"2024-05-14T10:12:13.486834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'27","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.854039+0000","last_change":"2024-05-14T09:40:45.760838+0000","last_active":"2024-05-14T10:12:13.854039+0000","last_peered":"2024-05-14T10:12:13.854039+0000","last_clean":"2024-05-14T10:12:13.854039+0000","last_became_active":"2024-05-14T09:40:45.760535+0000","last_became_peered":"2024-05-14T09:40:45.760535+0000","last_unstale":"2024-05-14T10:12:13.854039+0000","last_undegraded":"2024-05-14T10:12:13.854039+0000","last_fullsized":"2024-05-14T10:12:13.854039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"33'23","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.646606+0000","last_change":"2024-05-14T09:40:45.778218+0000","last_active":"2024-05-14T10:12:13.646606+0000","last_peered":"2024-05-14T10:12:13.646606+0000","last_clean":"2024-05-14T10:12:13.646606+0000","last_became_active":"2024-05-14T09:40:45.775602+0000","last_became_peered":"2024-05-14T09:40:45.775602+0000","last_unstale":"2024-05-14T10:12:13.646606+0000","last_undegraded":"2024-05-14T10:12:13.646606+0000","last_fullsized":"2024-05-14T10:12:13.646606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:40.574917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'33","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.629831+0000","last_change":"2024-05-14T09:40:45.748996+0000","last_active":"2024-05-14T10:12:13.629831+0000","last_peered":"2024-05-14T10:12:13.629831+0000","last_clean":"2024-05-14T10:12:13.629831+0000","last_became_active":"2024-05-14T09:40:45.748266+0000","last_became_peered":"2024-05-14T09:40:45.748266+0000","last_unstale":"2024-05-14T10:12:13.629831+0000","last_undegraded":"2024-05-14T10:12:13.629831+0000","last_fullsized":"2024-05-14T10:12:13.629831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'22","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.621627+0000","last_change":"2024-05-14T09:41:04.613266+0000","last_active":"2024-05-14T10:12:13.621627+0000","last_peered":"2024-05-14T10:12:13.621627+0000","last_clean":"2024-05-14T10:12:13.621627+0000","last_became_active":"2024-05-14T09:41:04.612160+0000","last_became_peered":"2024-05-14T09:41:04.612160+0000","last_unstale":"2024-05-14T10:12:13.621627+0000","last_undegraded":"2024-05-14T10:12:13.621627+0000","last_fullsized":"2024-05-14T10:12:13.621627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'28","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623303+0000","last_change":"2024-05-14T09:40:45.757279+0000","last_active":"2024-05-14T10:12:13.623303+0000","last_peered":"2024-05-14T10:12:13.623303+0000","last_clean":"2024-05-14T10:12:13.623303+0000","last_became_active":"2024-05-14T09:40:45.749692+0000","last_became_peered":"2024-05-14T09:40:45.749692+0000","last_unstale":"2024-05-14T10:12:13.623303+0000","last_undegraded":"2024-05-14T10:12:13.623303+0000","last_fullsized":"2024-05-14T10:12:13.623303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:39:52.486187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'27","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.487188+0000","last_change":"2024-05-14T09:40:45.744802+0000","last_active":"2024-05-14T10:12:13.487188+0000","last_peered":"2024-05-14T10:12:13.487188+0000","last_clean":"2024-05-14T10:12:13.487188+0000","last_became_active":"2024-05-14T09:40:45.744011+0000","last_became_peered":"2024-05-14T09:40:45.744011+0000","last_unstale":"2024-05-14T10:12:13.487188+0000","last_undegraded":"2024-05-14T10:12:13.487188+0000","last_fullsized":"2024-05-14T10:12:13.487188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:20.468216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'24","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.486825+0000","last_change":"2024-05-14T09:40:45.757983+0000","last_active":"2024-05-14T10:12:13.486825+0000","last_peered":"2024-05-14T10:12:13.486825+0000","last_clean":"2024-05-14T10:12:13.486825+0000","last_became_active":"2024-05-14T09:40:45.757450+0000","last_became_peered":"2024-05-14T09:40:45.757450+0000","last_unstale":"2024-05-14T10:12:13.486825+0000","last_undegraded":"2024-05-14T10:12:13.486825+0000","last_fullsized":"2024-05-14T10:12:13.486825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:07.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'33","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.565326+0000","last_change":"2024-05-14T09:40:45.745021+0000","last_active":"2024-05-14T10:12:13.565326+0000","last_peered":"2024-05-14T10:12:13.565326+0000","last_clean":"2024-05-14T10:12:13.565326+0000","last_became_active":"2024-05-14T09:40:45.744550+0000","last_became_peered":"2024-05-14T09:40:45.744550+0000","last_unstale":"2024-05-14T10:12:13.565326+0000","last_undegraded":"2024-05-14T10:12:13.565326+0000","last_fullsized":"2024-05-14T10:12:13.565326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'17","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.644582+0000","last_change":"2024-05-14T09:40:45.749109+0000","last_active":"2024-05-14T10:12:13.644582+0000","last_peered":"2024-05-14T10:12:13.644582+0000","last_clean":"2024-05-14T10:12:13.644582+0000","last_became_active":"2024-05-14T09:40:45.748419+0000","last_became_peered":"2024-05-14T09:40:45.748419+0000","last_unstale":"2024-05-14T10:12:13.644582+0000","last_undegraded":"2024-05-14T10:12:13.644582+0000","last_fullsized":"2024-05-14T10:12:13.644582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'23","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.846466+0000","last_change":"2024-05-14T09:40:45.753508+0000","last_active":"2024-05-14T10:12:13.846466+0000","last_peered":"2024-05-14T10:12:13.846466+0000","last_clean":"2024-05-14T10:12:13.846466+0000","last_became_active":"2024-05-14T09:40:45.752982+0000","last_became_peered":"2024-05-14T09:40:45.752982+0000","last_unstale":"2024-05-14T10:12:13.846466+0000","last_undegraded":"2024-05-14T10:12:13.846466+0000","last_fullsized":"2024-05-14T10:12:13.846466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"33'32","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.861693+0000","last_change":"2024-05-14T09:40:45.759266+0000","last_active":"2024-05-14T10:12:13.861693+0000","last_peered":"2024-05-14T10:12:13.861693+0000","last_clean":"2024-05-14T10:12:13.861693+0000","last_became_active":"2024-05-14T09:40:45.758912+0000","last_became_peered":"2024-05-14T09:40:45.758912+0000","last_unstale":"2024-05-14T10:12:13.861693+0000","last_undegraded":"2024-05-14T10:12:13.861693+0000","last_fullsized":"2024-05-14T10:12:13.861693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'28","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655653+0000","last_change":"2024-05-14T09:40:45.780527+0000","last_active":"2024-05-14T10:12:13.655653+0000","last_peered":"2024-05-14T10:12:13.655653+0000","last_clean":"2024-05-14T10:12:13.655653+0000","last_became_active":"2024-05-14T09:40:45.780197+0000","last_became_peered":"2024-05-14T09:40:45.780197+0000","last_unstale":"2024-05-14T10:12:13.655653+0000","last_undegraded":"2024-05-14T10:12:13.655653+0000","last_fullsized":"2024-05-14T10:12:13.655653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:38.220230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'19","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.562504+0000","last_change":"2024-05-14T09:40:45.761049+0000","last_active":"2024-05-14T10:12:13.562504+0000","last_peered":"2024-05-14T10:12:13.562504+0000","last_clean":"2024-05-14T10:12:13.562504+0000","last_became_active":"2024-05-14T09:40:45.760738+0000","last_became_peered":"2024-05-14T09:40:45.760738+0000","last_unstale":"2024-05-14T10:12:13.562504+0000","last_undegraded":"2024-05-14T10:12:13.562504+0000","last_fullsized":"2024-05-14T10:12:13.562504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'17","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.645430+0000","last_change":"2024-05-14T09:40:45.776380+0000","last_active":"2024-05-14T10:12:13.645430+0000","last_peered":"2024-05-14T10:12:13.645430+0000","last_clean":"2024-05-14T10:12:13.645430+0000","last_became_active":"2024-05-14T09:40:45.776005+0000","last_became_peered":"2024-05-14T09:40:45.776005+0000","last_unstale":"2024-05-14T10:12:13.645430+0000","last_undegraded":"2024-05-14T10:12:13.645430+0000","last_fullsized":"2024-05-14T10:12:13.645430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:27.969792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'24","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623089+0000","last_change":"2024-05-14T09:41:04.214552+0000","last_active":"2024-05-14T10:12:13.623089+0000","last_peered":"2024-05-14T10:12:13.623089+0000","last_clean":"2024-05-14T10:12:13.623089+0000","last_became_active":"2024-05-14T09:41:04.213721+0000","last_became_peered":"2024-05-14T09:41:04.213721+0000","last_unstale":"2024-05-14T10:12:13.623089+0000","last_undegraded":"2024-05-14T10:12:13.623089+0000","last_fullsized":"2024-05-14T10:12:13.623089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"33'23","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.650378+0000","last_change":"2024-05-14T09:40:45.776955+0000","last_active":"2024-05-14T10:12:13.650378+0000","last_peered":"2024-05-14T10:12:13.650378+0000","last_clean":"2024-05-14T10:12:13.650378+0000","last_became_active":"2024-05-14T09:40:45.775953+0000","last_became_peered":"2024-05-14T09:40:45.775953+0000","last_unstale":"2024-05-14T10:12:13.650378+0000","last_undegraded":"2024-05-14T10:12:13.650378+0000","last_fullsized":"2024-05-14T10:12:13.650378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:13.534273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.626341+0000","last_change":"2024-05-14T09:40:45.750766+0000","last_active":"2024-05-14T10:12:13.626341+0000","last_peered":"2024-05-14T10:12:13.626341+0000","last_clean":"2024-05-14T10:12:13.626341+0000","last_became_active":"2024-05-14T09:40:45.750416+0000","last_became_peered":"2024-05-14T09:40:45.750416+0000","last_unstale":"2024-05-14T10:12:13.626341+0000","last_undegraded":"2024-05-14T10:12:13.626341+0000","last_fullsized":"2024-05-14T10:12:13.626341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:29:30.022171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"33'25","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.486470+0000","last_change":"2024-05-14T09:40:45.748573+0000","last_active":"2024-05-14T10:12:13.486470+0000","last_peered":"2024-05-14T10:12:13.486470+0000","last_clean":"2024-05-14T10:12:13.486470+0000","last_became_active":"2024-05-14T09:40:45.746640+0000","last_became_peered":"2024-05-14T09:40:45.746640+0000","last_unstale":"2024-05-14T10:12:13.486470+0000","last_undegraded":"2024-05-14T10:12:13.486470+0000","last_fullsized":"2024-05-14T10:12:13.486470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"33'19","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.446564+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T10:12:13.446564+0000","last_peered":"2024-05-14T10:12:13.446564+0000","last_clean":"2024-05-14T10:12:13.446564+0000","last_became_active":"2024-05-14T09:40:45.752589+0000","last_became_peered":"2024-05-14T09:40:45.752589+0000","last_unstale":"2024-05-14T10:12:13.446564+0000","last_undegraded":"2024-05-14T10:12:13.446564+0000","last_fullsized":"2024-05-14T10:12:13.446564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:43.043120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.652852+0000","last_change":"2024-05-14T09:40:45.771577+0000","last_active":"2024-05-14T10:12:13.652852+0000","last_peered":"2024-05-14T10:12:13.652852+0000","last_clean":"2024-05-14T10:12:13.652852+0000","last_became_active":"2024-05-14T09:40:45.771228+0000","last_became_peered":"2024-05-14T09:40:45.771228+0000","last_unstale":"2024-05-14T10:12:13.652852+0000","last_undegraded":"2024-05-14T10:12:13.652852+0000","last_fullsized":"2024-05-14T10:12:13.652852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:36.361964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2167,"num_write_kb":250271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2329,"ondisk_log_size":2329,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1480,"ondisk_log_size":1480,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21977357,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":432,"num_read_kb":466,"num_write":6515,"num_write_kb":24638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44105728,"data_stored":43953576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4957,"ondisk_log_size":4957,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719477124,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39728,"kb_used_data":8552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332112,"statfs":{"total":96636764160,"available":96596082688,"internally_reserved":0,"allocated":8757248,"data_stored":8538561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719477126,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52208,"kb_used_data":8552,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319632,"statfs":{"total":96636764160,"available":96583303168,"internally_reserved":0,"allocated":8757248,"data_stored":8537925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":16,"seq":68719477127,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40712,"kb_used_data":9536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331128,"statfs":{"total":96636764160,"available":96595075072,"internally_reserved":0,"allocated":9764864,"data_stored":9539012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719477123,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":267048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477123,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45396,"kb_used_data":5900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326444,"statfs":{"total":96636764160,"available":96590278656,"internally_reserved":0,"allocated":6041600,"data_stored":5816143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509828,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40248,"kb_used_data":13232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331592,"statfs":{"total":96636764160,"available":96595550208,"internally_reserved":0,"allocated":13549568,"data_stored":13323781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542530,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39860,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331980,"statfs":{"total":96636764160,"available":96595947520,"internally_reserved":0,"allocated":372736,"data_stored":149981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542532,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":149547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5095424,"data_stored":5077172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":118445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9412608,"data_stored":9391547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12603392,"data_stored":12584810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T10:12:20.561 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T10:12:20.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.875+0000 7ff997400640 1 Processor -- start 2024-05-14T10:12:20.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.875+0000 7ff997400640 1 -- start start 2024-05-14T10:12:20.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.877+0000 7ff997400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff990071fe0 0x7ff990154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:20.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.877+0000 7ff997400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff990074810 0x7ff9900c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:20.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.877+0000 7ff997400640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99015b160 con 0x7ff9900c97c0 2024-05-14T10:12:20.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.877+0000 7ff997400640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff99015ac30 con 0x7ff990074810 2024-05-14T10:12:20.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.877+0000 7ff997400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff99015ae80 con 0x7ff990071fe0 2024-05-14T10:12:20.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.880+0000 7ff98fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff990074810 0x7ff9900c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:20.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.881+0000 7ff995400640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7ff9900c97c0 0x7ff9900c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:41802/0 (socket says 172.21.15.135:41802) 2024-05-14T10:12:20.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.881+0000 7ff995400640 1 -- 172.21.15.135:0/3839344190 learned_addr learned my addr 172.21.15.135:0/3839344190 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:20.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.884+0000 7ff994a00640 1 --2- 172.21.15.135:0/3839344190 >> v2:172.21.15.196:3300/0 conn(0x7ff990071fe0 0x7ff990154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:20.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.884+0000 7ff98fe00640 1 -- 172.21.15.135:0/3839344190 >> v2:172.21.15.196:3300/0 conn(0x7ff990071fe0 msgr2=0x7ff990154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:20.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.884+0000 7ff98fe00640 1 --2- 172.21.15.135:0/3839344190 >> v2:172.21.15.196:3300/0 conn(0x7ff990071fe0 0x7ff990154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:20.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.884+0000 7ff98fe00640 1 -- 172.21.15.135:0/3839344190 >> v1:172.21.15.135:6789/0 conn(0x7ff9900c97c0 legacy=0x7ff9900c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:20.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.884+0000 7ff98fe00640 1 -- 172.21.15.135:0/3839344190 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9900c8ce0 con 0x7ff990074810 2024-05-14T10:12:20.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.895+0000 7ff98fe00640 1 --2- 172.21.15.135:0/3839344190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff990074810 0x7ff9900c84d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff990073240 tx=0x7ff97c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efd6f53a53a8bb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:20.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.901+0000 7ff98f400640 1 -- 172.21.15.135:0/3839344190 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c037070 con 0x7ff990074810 2024-05-14T10:12:20.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.901+0000 7ff98f400640 1 -- 172.21.15.135:0/3839344190 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97c032440 con 0x7ff990074810 2024-05-14T10:12:20.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.901+0000 7ff98f400640 1 -- 172.21.15.135:0/3839344190 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c032810 con 0x7ff990074810 2024-05-14T10:12:20.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.902+0000 7ff997400640 1 -- 172.21.15.135:0/3839344190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff990074810 msgr2=0x7ff9900c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:20.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.902+0000 7ff997400640 1 --2- 172.21.15.135:0/3839344190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff990074810 0x7ff9900c84d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff990073240 tx=0x7ff97c02a1a0 comp rx=0 tx=0).stop 2024-05-14T10:12:20.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.902+0000 7ff997400640 1 -- 172.21.15.135:0/3839344190 shutdown_connections 2024-05-14T10:12:20.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.902+0000 7ff997400640 1 --2- 172.21.15.135:0/3839344190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff990074810 0x7ff9900c84d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:20.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.902+0000 7ff997400640 1 --2- 172.21.15.135:0/3839344190 >> v2:172.21.15.196:3300/0 conn(0x7ff990071fe0 0x7ff990154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:20.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.902+0000 7ff997400640 1 -- 172.21.15.135:0/3839344190 >> 172.21.15.135:0/3839344190 conn(0x7ff990073cf0 msgr2=0x7ff990074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:20.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.902+0000 7ff997400640 1 -- 172.21.15.135:0/3839344190 shutdown_connections 2024-05-14T10:12:20.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.902+0000 7ff997400640 1 -- 172.21.15.135:0/3839344190 wait complete. 2024-05-14T10:12:20.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.905+0000 7ff997400640 1 Processor -- start 2024-05-14T10:12:20.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.906+0000 7ff997400640 1 -- start start 2024-05-14T10:12:20.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.907+0000 7ff997400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff990071fe0 0x7ff9901f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:20.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.907+0000 7ff997400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff990074810 0x7ff99014a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:20.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.907+0000 7ff997400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9900c97c0 0x7ff9900c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:20.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.907+0000 7ff997400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9900c72a0 con 0x7ff990071fe0 2024-05-14T10:12:20.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.907+0000 7ff997400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff9900c92a0 con 0x7ff990074810 2024-05-14T10:12:20.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.907+0000 7ff997400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff9900c7420 con 0x7ff9900c97c0 2024-05-14T10:12:20.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.908+0000 7ff994a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff990071fe0 0x7ff9901f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:20.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.908+0000 7ff994a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff990071fe0 0x7ff9901f66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44740/0 (socket says 172.21.15.135:44740) 2024-05-14T10:12:20.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.908+0000 7ff994a00640 1 -- 172.21.15.135:0/314661442 learned_addr learned my addr 172.21.15.135:0/314661442 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:20.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.909+0000 7ff98fe00640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff990074810 0x7ff99014a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:20.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.909+0000 7ff995400640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9900c97c0 0x7ff9900c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:20.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.913+0000 7ff994a00640 1 -- 172.21.15.135:0/314661442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9900c97c0 msgr2=0x7ff9900c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:20.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.913+0000 7ff994a00640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9900c97c0 0x7ff9900c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:20.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.913+0000 7ff994a00640 1 -- 172.21.15.135:0/314661442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff990074810 msgr2=0x7ff99014a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:20.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.913+0000 7ff994a00640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff990074810 0x7ff99014a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:20.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.913+0000 7ff994a00640 1 -- 172.21.15.135:0/314661442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9901f6c20 con 0x7ff990071fe0 2024-05-14T10:12:20.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.913+0000 7ff995400640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9900c97c0 0x7ff9900c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:12:20.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.916+0000 7ff994a00640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff990071fe0 0x7ff9901f66e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff98400c820 tx=0x7ff98400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:20.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.921+0000 7ff98cc00640 1 -- 172.21.15.135:0/314661442 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984015070 con 0x7ff990071fe0 2024-05-14T10:12:20.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.921+0000 7ff98cc00640 1 -- 172.21.15.135:0/314661442 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff984004020 con 0x7ff990071fe0 2024-05-14T10:12:20.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.921+0000 7ff98cc00640 1 -- 172.21.15.135:0/314661442 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9840043f0 con 0x7ff990071fe0 2024-05-14T10:12:20.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.921+0000 7ff997400640 1 -- 172.21.15.135:0/314661442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9900c50a0 con 0x7ff990071fe0 2024-05-14T10:12:20.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.921+0000 7ff997400640 1 -- 172.21.15.135:0/314661442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9900cbc80 con 0x7ff990071fe0 2024-05-14T10:12:20.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.923+0000 7ff997400640 1 -- 172.21.15.135:0/314661442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff990069a90 con 0x7ff990071fe0 2024-05-14T10:12:20.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.965+0000 7ff98cc00640 1 -- 172.21.15.135:0/314661442 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff984007830 con 0x7ff990071fe0 2024-05-14T10:12:20.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.969+0000 7ff98cc00640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff970076350 0x7ff970078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:20.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.970+0000 7ff98fe00640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff970076350 0x7ff970078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:20.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:20.971+0000 7ff98fe00640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff970076350 0x7ff970078860 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff97c034000 tx=0x7ff97c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:21.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.315+0000 7ff98cc00640 1 -- 172.21.15.135:0/314661442 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7ff98405ccd0 con 0x7ff990071fe0 2024-05-14T10:12:21.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.316+0000 7ff98cc00640 1 -- 172.21.15.135:0/314661442 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff984060a40 con 0x7ff990071fe0 2024-05-14T10:12:21.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.529+0000 7ff997400640 1 -- 172.21.15.135:0/314661442 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9900c4e50 con 0x7ff970076350 2024-05-14T10:12:21.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.543+0000 7ff98cc00640 1 -- 172.21.15.135:0/314661442 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333447 (secure 0 0 0) 0x7ff9900c4e50 con 0x7ff970076350 2024-05-14T10:12:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T10:12:21.550 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-14T10:12:21.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.550+0000 7ff997400640 1 -- 172.21.15.135:0/314661442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff970076350 msgr2=0x7ff970078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:21.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.550+0000 7ff997400640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff970076350 0x7ff970078860 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff97c034000 tx=0x7ff97c02e000 comp rx=0 tx=0).stop 2024-05-14T10:12:21.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.551+0000 7ff997400640 1 -- 172.21.15.135:0/314661442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff990071fe0 msgr2=0x7ff9901f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:21.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.551+0000 7ff997400640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff990071fe0 0x7ff9901f66e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff98400c820 tx=0x7ff98400cce0 comp rx=0 tx=0).stop 2024-05-14T10:12:21.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.551+0000 7ff997400640 1 -- 172.21.15.135:0/314661442 shutdown_connections 2024-05-14T10:12:21.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.551+0000 7ff997400640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff970076350 0x7ff970078860 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:21.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.551+0000 7ff997400640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff990074810 0x7ff99014a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:21.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.551+0000 7ff997400640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff9900c97c0 0x7ff9900c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:21.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.551+0000 7ff997400640 1 --2- 172.21.15.135:0/314661442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff990071fe0 0x7ff9901f66e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:21.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.551+0000 7ff997400640 1 -- 172.21.15.135:0/314661442 >> 172.21.15.135:0/314661442 conn(0x7ff990073cf0 msgr2=0x7ff9900c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:21.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.551+0000 7ff997400640 1 -- 172.21.15.135:0/314661442 shutdown_connections 2024-05-14T10:12:21.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.551+0000 7ff997400640 1 -- 172.21.15.135:0/314661442 wait complete. 2024-05-14T10:12:21.579 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":992,"stamp":"2024-05-14T10:12:21.377359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22567725,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":498,"num_read_kb":521,"num_write":8783,"num_write_kb":276537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8838,"ondisk_log_size":8838,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329672,"kb_used_data":46984,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754645048,"statfs":{"total":773094113280,"available":772756529152,"internally_reserved":0,"allocated":48111616,"data_stored":46323136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":289394226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40276,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":38,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005927"},"pg_stats":[{"pgid":"2.1f","version":"33'574","reported_seq":624,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:00.807469+0000","last_change":"2024-05-14T09:40:43.106486+0000","last_active":"2024-05-14T10:12:00.807469+0000","last_peered":"2024-05-14T10:12:00.807469+0000","last_clean":"2024-05-14T10:12:00.807469+0000","last_became_active":"2024-05-14T09:40:43.105731+0000","last_became_peered":"2024-05-14T09:40:43.105731+0000","last_unstale":"2024-05-14T10:12:00.807469+0000","last_undegraded":"2024-05-14T10:12:00.807469+0000","last_fullsized":"2024-05-14T10:12:00.807469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:32:09.735265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573,"num_write_kb":4404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'15","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.501309+0000","last_change":"2024-05-14T09:40:45.750103+0000","last_active":"2024-05-14T10:12:13.501309+0000","last_peered":"2024-05-14T10:12:13.501309+0000","last_clean":"2024-05-14T10:12:13.501309+0000","last_became_active":"2024-05-14T09:40:45.747865+0000","last_became_peered":"2024-05-14T09:40:45.747865+0000","last_unstale":"2024-05-14T10:12:13.501309+0000","last_undegraded":"2024-05-14T10:12:13.501309+0000","last_fullsized":"2024-05-14T10:12:13.501309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:06.549076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'61","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:53.409756+0000","last_change":"2024-05-14T09:40:53.664918+0000","last_active":"2024-05-14T10:10:53.409756+0000","last_peered":"2024-05-14T10:10:53.409756+0000","last_clean":"2024-05-14T10:10:53.409756+0000","last_became_active":"2024-05-14T09:40:53.664366+0000","last_became_peered":"2024-05-14T09:40:53.664366+0000","last_unstale":"2024-05-14T10:10:53.409756+0000","last_undegraded":"2024-05-14T10:10:53.409756+0000","last_fullsized":"2024-05-14T10:10:53.409756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:20:52.204134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'88","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.980596+0000","last_change":"2024-05-14T09:40:43.101185+0000","last_active":"2024-05-14T10:12:13.980596+0000","last_peered":"2024-05-14T10:12:13.980596+0000","last_clean":"2024-05-14T10:12:13.980596+0000","last_became_active":"2024-05-14T09:40:43.098862+0000","last_became_peered":"2024-05-14T09:40:43.098862+0000","last_unstale":"2024-05-14T10:12:13.980596+0000","last_undegraded":"2024-05-14T10:12:13.980596+0000","last_fullsized":"2024-05-14T10:12:13.980596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883346,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.488230+0000","last_change":"2024-05-14T09:40:45.752960+0000","last_active":"2024-05-14T10:12:13.488230+0000","last_peered":"2024-05-14T10:12:13.488230+0000","last_clean":"2024-05-14T10:12:13.488230+0000","last_became_active":"2024-05-14T09:40:45.752627+0000","last_became_peered":"2024-05-14T09:40:45.752627+0000","last_unstale":"2024-05-14T10:12:13.488230+0000","last_undegraded":"2024-05-14T10:12:13.488230+0000","last_fullsized":"2024-05-14T10:12:13.488230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'57","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.348476+0000","last_change":"2024-05-14T09:40:53.662032+0000","last_active":"2024-05-14T10:11:03.348476+0000","last_peered":"2024-05-14T10:11:03.348476+0000","last_clean":"2024-05-14T10:11:03.348476+0000","last_became_active":"2024-05-14T09:40:53.661453+0000","last_became_peered":"2024-05-14T09:40:53.661453+0000","last_unstale":"2024-05-14T10:11:03.348476+0000","last_undegraded":"2024-05-14T10:11:03.348476+0000","last_fullsized":"2024-05-14T10:11:03.348476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:11.724866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'10","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.867388+0000","last_change":"2024-05-14T09:40:43.114965+0000","last_active":"2024-05-14T10:11:57.867388+0000","last_peered":"2024-05-14T10:11:57.867388+0000","last_clean":"2024-05-14T10:11:57.867388+0000","last_became_active":"2024-05-14T09:40:43.114379+0000","last_became_peered":"2024-05-14T09:40:43.114379+0000","last_unstale":"2024-05-14T10:11:57.867388+0000","last_undegraded":"2024-05-14T10:11:57.867388+0000","last_fullsized":"2024-05-14T10:11:57.867388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:43.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'21","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630273+0000","last_change":"2024-05-14T09:40:45.758305+0000","last_active":"2024-05-14T10:12:13.630273+0000","last_peered":"2024-05-14T10:12:13.630273+0000","last_clean":"2024-05-14T10:12:13.630273+0000","last_became_active":"2024-05-14T09:40:45.754110+0000","last_became_peered":"2024-05-14T09:40:45.754110+0000","last_unstale":"2024-05-14T10:12:13.630273+0000","last_undegraded":"2024-05-14T10:12:13.630273+0000","last_fullsized":"2024-05-14T10:12:13.630273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:12:42.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'83","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:01.093757+0000","last_change":"2024-05-14T09:41:04.601574+0000","last_active":"2024-05-14T10:11:01.093757+0000","last_peered":"2024-05-14T10:11:01.093757+0000","last_clean":"2024-05-14T10:11:01.093757+0000","last_became_active":"2024-05-14T09:41:04.599475+0000","last_became_peered":"2024-05-14T09:41:04.599475+0000","last_unstale":"2024-05-14T10:11:01.093757+0000","last_undegraded":"2024-05-14T10:11:01.093757+0000","last_fullsized":"2024-05-14T10:11:01.093757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"33'3","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:44.766090+0000","last_change":"2024-05-14T09:40:43.110296+0000","last_active":"2024-05-14T10:10:44.766090+0000","last_peered":"2024-05-14T10:10:44.766090+0000","last_clean":"2024-05-14T10:10:44.766090+0000","last_became_active":"2024-05-14T09:40:43.109932+0000","last_became_peered":"2024-05-14T09:40:43.109932+0000","last_unstale":"2024-05-14T10:10:44.766090+0000","last_undegraded":"2024-05-14T10:10:44.766090+0000","last_fullsized":"2024-05-14T10:10:44.766090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:29.003048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630118+0000","last_change":"2024-05-14T09:40:45.773110+0000","last_active":"2024-05-14T10:12:13.630118+0000","last_peered":"2024-05-14T10:12:13.630118+0000","last_clean":"2024-05-14T10:12:13.630118+0000","last_became_active":"2024-05-14T09:40:45.770117+0000","last_became_peered":"2024-05-14T09:40:45.770117+0000","last_unstale":"2024-05-14T10:12:13.630118+0000","last_undegraded":"2024-05-14T10:12:13.630118+0000","last_fullsized":"2024-05-14T10:12:13.630118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:28.718450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'79","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.770815+0000","last_change":"2024-05-14T09:40:53.652049+0000","last_active":"2024-05-14T10:11:05.770815+0000","last_peered":"2024-05-14T10:11:05.770815+0000","last_clean":"2024-05-14T10:11:05.770815+0000","last_became_active":"2024-05-14T09:40:53.651570+0000","last_became_peered":"2024-05-14T09:40:53.651570+0000","last_unstale":"2024-05-14T10:11:05.770815+0000","last_undegraded":"2024-05-14T10:11:05.770815+0000","last_fullsized":"2024-05-14T10:11:05.770815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:30.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'20","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.846441+0000","last_change":"2024-05-14T09:40:45.753771+0000","last_active":"2024-05-14T10:12:13.846441+0000","last_peered":"2024-05-14T10:12:13.846441+0000","last_clean":"2024-05-14T10:12:13.846441+0000","last_became_active":"2024-05-14T09:40:45.753319+0000","last_became_peered":"2024-05-14T09:40:45.753319+0000","last_unstale":"2024-05-14T10:12:13.846441+0000","last_undegraded":"2024-05-14T10:12:13.846441+0000","last_fullsized":"2024-05-14T10:12:13.846441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'565","reported_seq":614,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.868105+0000","last_change":"2024-05-14T09:40:43.125708+0000","last_active":"2024-05-14T10:11:57.868105+0000","last_peered":"2024-05-14T10:11:57.868105+0000","last_clean":"2024-05-14T10:11:57.868105+0000","last_became_active":"2024-05-14T09:40:43.125239+0000","last_became_peered":"2024-05-14T09:40:43.125239+0000","last_unstale":"2024-05-14T10:11:57.868105+0000","last_undegraded":"2024-05-14T10:11:57.868105+0000","last_fullsized":"2024-05-14T10:11:57.868105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:22.781125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'67","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:04.491201+0000","last_change":"2024-05-14T09:40:53.663353+0000","last_active":"2024-05-14T10:11:04.491201+0000","last_peered":"2024-05-14T10:11:04.491201+0000","last_clean":"2024-05-14T10:11:04.491201+0000","last_became_active":"2024-05-14T09:40:53.662559+0000","last_became_peered":"2024-05-14T09:40:53.662559+0000","last_unstale":"2024-05-14T10:11:04.491201+0000","last_undegraded":"2024-05-14T10:11:04.491201+0000","last_fullsized":"2024-05-14T10:11:04.491201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:14.708431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'23","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.571812+0000","last_change":"2024-05-14T09:40:45.751929+0000","last_active":"2024-05-14T10:12:13.571812+0000","last_peered":"2024-05-14T10:12:13.571812+0000","last_clean":"2024-05-14T10:12:13.571812+0000","last_became_active":"2024-05-14T09:40:45.751015+0000","last_became_peered":"2024-05-14T09:40:45.751015+0000","last_unstale":"2024-05-14T10:12:13.571812+0000","last_undegraded":"2024-05-14T10:12:13.571812+0000","last_fullsized":"2024-05-14T10:12:13.571812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:12.550231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:45.882832+0000","last_change":"2024-05-14T09:40:43.023070+0000","last_active":"2024-05-14T10:11:45.882832+0000","last_peered":"2024-05-14T10:11:45.882832+0000","last_clean":"2024-05-14T10:11:45.882832+0000","last_became_active":"2024-05-14T09:40:43.022234+0000","last_became_peered":"2024-05-14T09:40:43.022234+0000","last_unstale":"2024-05-14T10:11:45.882832+0000","last_undegraded":"2024-05-14T10:11:45.882832+0000","last_fullsized":"2024-05-14T10:11:45.882832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:30:06.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'86","reported_seq":127,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.518588+0000","last_change":"2024-05-14T09:41:04.601663+0000","last_active":"2024-05-14T10:11:03.518588+0000","last_peered":"2024-05-14T10:11:03.518588+0000","last_clean":"2024-05-14T10:11:03.518588+0000","last_became_active":"2024-05-14T09:41:04.600186+0000","last_became_peered":"2024-05-14T09:41:04.600186+0000","last_unstale":"2024-05-14T10:11:03.518588+0000","last_undegraded":"2024-05-14T10:11:03.518588+0000","last_fullsized":"2024-05-14T10:11:03.518588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'22","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.531558+0000","last_change":"2024-05-14T09:40:45.746999+0000","last_active":"2024-05-14T10:12:13.531558+0000","last_peered":"2024-05-14T10:12:13.531558+0000","last_clean":"2024-05-14T10:12:13.531558+0000","last_became_active":"2024-05-14T09:40:45.746607+0000","last_became_peered":"2024-05-14T09:40:45.746607+0000","last_unstale":"2024-05-14T10:12:13.531558+0000","last_undegraded":"2024-05-14T10:12:13.531558+0000","last_fullsized":"2024-05-14T10:12:13.531558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:03.565510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'11","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.407861+0000","last_change":"2024-05-14T09:40:43.105149+0000","last_active":"2024-05-14T10:11:52.407861+0000","last_peered":"2024-05-14T10:11:52.407861+0000","last_clean":"2024-05-14T10:11:52.407861+0000","last_became_active":"2024-05-14T09:40:43.104277+0000","last_became_peered":"2024-05-14T09:40:43.104277+0000","last_unstale":"2024-05-14T10:11:52.407861+0000","last_undegraded":"2024-05-14T10:11:52.407861+0000","last_fullsized":"2024-05-14T10:11:52.407861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:48.598915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'61","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.199692+0000","last_change":"2024-05-14T09:40:53.649256+0000","last_active":"2024-05-14T10:11:00.199692+0000","last_peered":"2024-05-14T10:11:00.199692+0000","last_clean":"2024-05-14T10:11:00.199692+0000","last_became_active":"2024-05-14T09:40:53.648765+0000","last_became_peered":"2024-05-14T09:40:53.648765+0000","last_unstale":"2024-05-14T10:11:00.199692+0000","last_undegraded":"2024-05-14T10:11:00.199692+0000","last_fullsized":"2024-05-14T10:11:00.199692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:25.060381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":11669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"33'17","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.458918+0000","last_change":"2024-05-14T09:40:45.730862+0000","last_active":"2024-05-14T10:11:06.458918+0000","last_peered":"2024-05-14T10:11:06.458918+0000","last_clean":"2024-05-14T10:11:06.458918+0000","last_became_active":"2024-05-14T09:40:45.730014+0000","last_became_peered":"2024-05-14T09:40:45.730014+0000","last_unstale":"2024-05-14T10:11:06.458918+0000","last_undegraded":"2024-05-14T10:11:06.458918+0000","last_fullsized":"2024-05-14T10:11:06.458918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:05.679719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.868371+0000","last_change":"2024-05-14T09:40:43.112127+0000","last_active":"2024-05-14T10:11:57.868371+0000","last_peered":"2024-05-14T10:11:57.868371+0000","last_clean":"2024-05-14T10:11:57.868371+0000","last_became_active":"2024-05-14T09:40:43.111574+0000","last_became_peered":"2024-05-14T09:40:43.111574+0000","last_unstale":"2024-05-14T10:11:57.868371+0000","last_undegraded":"2024-05-14T10:11:57.868371+0000","last_fullsized":"2024-05-14T10:11:57.868371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:13.668017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'68","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:58.171427+0000","last_change":"2024-05-14T09:40:53.666100+0000","last_active":"2024-05-14T10:10:58.171427+0000","last_peered":"2024-05-14T10:10:58.171427+0000","last_clean":"2024-05-14T10:10:58.171427+0000","last_became_active":"2024-05-14T09:40:53.665635+0000","last_became_peered":"2024-05-14T09:40:53.665635+0000","last_unstale":"2024-05-14T10:10:58.171427+0000","last_undegraded":"2024-05-14T10:10:58.171427+0000","last_fullsized":"2024-05-14T10:10:58.171427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:21.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":6362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"33'26","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.476914+0000","last_change":"2024-05-14T09:40:45.758554+0000","last_active":"2024-05-14T10:12:13.476914+0000","last_peered":"2024-05-14T10:12:13.476914+0000","last_clean":"2024-05-14T10:12:13.476914+0000","last_became_active":"2024-05-14T09:40:45.757938+0000","last_became_peered":"2024-05-14T09:40:45.757938+0000","last_unstale":"2024-05-14T10:12:13.476914+0000","last_undegraded":"2024-05-14T10:12:13.476914+0000","last_fullsized":"2024-05-14T10:12:13.476914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.946780+0000","last_change":"2024-05-14T09:40:43.116767+0000","last_active":"2024-05-14T10:12:02.946780+0000","last_peered":"2024-05-14T10:12:02.946780+0000","last_clean":"2024-05-14T10:12:02.946780+0000","last_became_active":"2024-05-14T09:40:43.116142+0000","last_became_peered":"2024-05-14T09:40:43.116142+0000","last_unstale":"2024-05-14T10:12:02.946780+0000","last_undegraded":"2024-05-14T10:12:02.946780+0000","last_fullsized":"2024-05-14T10:12:02.946780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'50","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:56.148905+0000","last_change":"2024-05-14T09:40:53.666811+0000","last_active":"2024-05-14T10:10:56.148905+0000","last_peered":"2024-05-14T10:10:56.148905+0000","last_clean":"2024-05-14T10:10:56.148905+0000","last_became_active":"2024-05-14T09:40:53.666455+0000","last_became_peered":"2024-05-14T09:40:53.666455+0000","last_unstale":"2024-05-14T10:10:56.148905+0000","last_undegraded":"2024-05-14T10:10:56.148905+0000","last_fullsized":"2024-05-14T10:10:56.148905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:33.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":7373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'19","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.561141+0000","last_change":"2024-05-14T09:40:45.768162+0000","last_active":"2024-05-14T10:12:13.561141+0000","last_peered":"2024-05-14T10:12:13.561141+0000","last_clean":"2024-05-14T10:12:13.561141+0000","last_became_active":"2024-05-14T09:40:45.767810+0000","last_became_peered":"2024-05-14T09:40:45.767810+0000","last_unstale":"2024-05-14T10:12:13.561141+0000","last_undegraded":"2024-05-14T10:12:13.561141+0000","last_fullsized":"2024-05-14T10:12:13.561141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:25.075246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'1178","reported_seq":1227,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:11.947139+0000","last_change":"2024-05-14T09:40:43.115650+0000","last_active":"2024-05-14T10:12:11.947139+0000","last_peered":"2024-05-14T10:12:11.947139+0000","last_clean":"2024-05-14T10:12:11.947139+0000","last_became_active":"2024-05-14T09:40:43.114902+0000","last_became_peered":"2024-05-14T09:40:43.114902+0000","last_unstale":"2024-05-14T10:12:11.947139+0000","last_undegraded":"2024-05-14T10:12:11.947139+0000","last_fullsized":"2024-05-14T10:12:11.947139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1178,"log_dups_size":0,"ondisk_log_size":1178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:19.284998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2830,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'101","reported_seq":137,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:01.705830+0000","last_change":"2024-05-14T09:40:53.650297+0000","last_active":"2024-05-14T10:11:01.705830+0000","last_peered":"2024-05-14T10:11:01.705830+0000","last_clean":"2024-05-14T10:11:01.705830+0000","last_became_active":"2024-05-14T09:40:53.649263+0000","last_became_peered":"2024-05-14T09:40:53.649263+0000","last_unstale":"2024-05-14T10:11:01.705830+0000","last_undegraded":"2024-05-14T10:11:01.705830+0000","last_fullsized":"2024-05-14T10:11:01.705830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:22.637337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":14510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'21","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.483357+0000","last_change":"2024-05-14T09:40:45.733131+0000","last_active":"2024-05-14T10:12:13.483357+0000","last_peered":"2024-05-14T10:12:13.483357+0000","last_clean":"2024-05-14T10:12:13.483357+0000","last_became_active":"2024-05-14T09:40:45.732154+0000","last_became_peered":"2024-05-14T09:40:45.732154+0000","last_unstale":"2024-05-14T10:12:13.483357+0000","last_undegraded":"2024-05-14T10:12:13.483357+0000","last_fullsized":"2024-05-14T10:12:13.483357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:23:16.904648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:09.343002+0000","last_change":"2024-05-14T09:40:43.112841+0000","last_active":"2024-05-14T10:12:09.343002+0000","last_peered":"2024-05-14T10:12:09.343002+0000","last_clean":"2024-05-14T10:12:09.343002+0000","last_became_active":"2024-05-14T09:40:43.110703+0000","last_became_peered":"2024-05-14T09:40:43.110703+0000","last_unstale":"2024-05-14T10:12:09.343002+0000","last_undegraded":"2024-05-14T10:12:09.343002+0000","last_fullsized":"2024-05-14T10:12:09.343002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:01.271389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'52","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.551997+0000","last_change":"2024-05-14T09:40:53.657532+0000","last_active":"2024-05-14T10:11:05.551997+0000","last_peered":"2024-05-14T10:11:05.551997+0000","last_clean":"2024-05-14T10:11:05.551997+0000","last_became_active":"2024-05-14T09:40:53.657073+0000","last_became_peered":"2024-05-14T09:40:53.657073+0000","last_unstale":"2024-05-14T10:11:05.551997+0000","last_undegraded":"2024-05-14T10:11:05.551997+0000","last_fullsized":"2024-05-14T10:11:05.551997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:56.882153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623157+0000","last_change":"2024-05-14T09:40:45.752122+0000","last_active":"2024-05-14T10:12:13.623157+0000","last_peered":"2024-05-14T10:12:13.623157+0000","last_clean":"2024-05-14T10:12:13.623157+0000","last_became_active":"2024-05-14T09:40:45.751546+0000","last_became_peered":"2024-05-14T09:40:45.751546+0000","last_unstale":"2024-05-14T10:12:13.623157+0000","last_undegraded":"2024-05-14T10:12:13.623157+0000","last_fullsized":"2024-05-14T10:12:13.623157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:19:55.897772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"33'3","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.944302+0000","last_change":"2024-05-14T09:40:43.099478+0000","last_active":"2024-05-14T10:12:02.944302+0000","last_peered":"2024-05-14T10:12:02.944302+0000","last_clean":"2024-05-14T10:12:02.944302+0000","last_became_active":"2024-05-14T09:40:43.098776+0000","last_became_peered":"2024-05-14T09:40:43.098776+0000","last_unstale":"2024-05-14T10:12:02.944302+0000","last_undegraded":"2024-05-14T10:12:02.944302+0000","last_fullsized":"2024-05-14T10:12:02.944302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:35.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'75","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.518532+0000","last_change":"2024-05-14T09:40:53.650794+0000","last_active":"2024-05-14T10:11:05.518532+0000","last_peered":"2024-05-14T10:11:05.518532+0000","last_clean":"2024-05-14T10:11:05.518532+0000","last_became_active":"2024-05-14T09:40:53.650139+0000","last_became_peered":"2024-05-14T09:40:53.650139+0000","last_unstale":"2024-05-14T10:11:05.518532+0000","last_undegraded":"2024-05-14T10:11:05.518532+0000","last_fullsized":"2024-05-14T10:11:05.518532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:36.877806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.639330+0000","last_change":"2024-05-14T09:40:45.748430+0000","last_active":"2024-05-14T10:12:13.639330+0000","last_peered":"2024-05-14T10:12:13.639330+0000","last_clean":"2024-05-14T10:12:13.639330+0000","last_became_active":"2024-05-14T09:40:45.748048+0000","last_became_peered":"2024-05-14T09:40:45.748048+0000","last_unstale":"2024-05-14T10:12:13.639330+0000","last_undegraded":"2024-05-14T10:12:13.639330+0000","last_fullsized":"2024-05-14T10:12:13.639330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:29.240543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'5","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.424978+0000","last_change":"2024-05-14T09:40:43.088293+0000","last_active":"2024-05-14T10:11:52.424978+0000","last_peered":"2024-05-14T10:11:52.424978+0000","last_clean":"2024-05-14T10:11:52.424978+0000","last_became_active":"2024-05-14T09:40:43.087310+0000","last_became_peered":"2024-05-14T09:40:43.087310+0000","last_unstale":"2024-05-14T10:11:52.424978+0000","last_undegraded":"2024-05-14T10:11:52.424978+0000","last_fullsized":"2024-05-14T10:11:52.424978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:38.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'60","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:54.299669+0000","last_change":"2024-05-14T09:41:04.598844+0000","last_active":"2024-05-14T10:10:54.299669+0000","last_peered":"2024-05-14T10:10:54.299669+0000","last_clean":"2024-05-14T10:10:54.299669+0000","last_became_active":"2024-05-14T09:41:04.597473+0000","last_became_peered":"2024-05-14T09:41:04.597473+0000","last_unstale":"2024-05-14T10:10:54.299669+0000","last_undegraded":"2024-05-14T10:10:54.299669+0000","last_fullsized":"2024-05-14T10:10:54.299669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:48.257782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"33'26","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.469769+0000","last_change":"2024-05-14T09:40:45.740074+0000","last_active":"2024-05-14T10:12:13.469769+0000","last_peered":"2024-05-14T10:12:13.469769+0000","last_clean":"2024-05-14T10:12:13.469769+0000","last_became_active":"2024-05-14T09:40:45.739647+0000","last_became_peered":"2024-05-14T09:40:45.739647+0000","last_unstale":"2024-05-14T10:12:13.469769+0000","last_undegraded":"2024-05-14T10:12:13.469769+0000","last_fullsized":"2024-05-14T10:12:13.469769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:38.401151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'449","reported_seq":931,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630978+0000","last_change":"2024-05-14T09:40:43.043210+0000","last_active":"2024-05-14T10:12:13.630978+0000","last_peered":"2024-05-14T10:12:13.630978+0000","last_clean":"2024-05-14T10:12:13.630978+0000","last_became_active":"2024-05-14T09:40:43.042243+0000","last_became_peered":"2024-05-14T09:40:43.042243+0000","last_unstale":"2024-05-14T10:12:13.630978+0000","last_undegraded":"2024-05-14T10:12:13.630978+0000","last_fullsized":"2024-05-14T10:12:13.630978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.946422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117717,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":466,"num_write":444,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'62","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:56.110624+0000","last_change":"2024-05-14T09:40:53.652161+0000","last_active":"2024-05-14T10:10:56.110624+0000","last_peered":"2024-05-14T10:10:56.110624+0000","last_clean":"2024-05-14T10:10:56.110624+0000","last_became_active":"2024-05-14T09:40:53.649990+0000","last_became_peered":"2024-05-14T09:40:53.649990+0000","last_unstale":"2024-05-14T10:10:56.110624+0000","last_undegraded":"2024-05-14T10:10:56.110624+0000","last_fullsized":"2024-05-14T10:10:56.110624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:20:04.057127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"33'12","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.487657+0000","last_change":"2024-05-14T09:40:45.754250+0000","last_active":"2024-05-14T10:12:13.487657+0000","last_peered":"2024-05-14T10:12:13.487657+0000","last_clean":"2024-05-14T10:12:13.487657+0000","last_became_active":"2024-05-14T09:40:45.753850+0000","last_became_peered":"2024-05-14T09:40:45.753850+0000","last_unstale":"2024-05-14T10:12:13.487657+0000","last_undegraded":"2024-05-14T10:12:13.487657+0000","last_fullsized":"2024-05-14T10:12:13.487657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:15.962138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:27.863105+0000","last_change":"2024-05-14T09:40:43.111905+0000","last_active":"2024-05-14T10:11:27.863105+0000","last_peered":"2024-05-14T10:11:27.863105+0000","last_clean":"2024-05-14T10:11:27.863105+0000","last_became_active":"2024-05-14T09:40:43.108233+0000","last_became_peered":"2024-05-14T09:40:43.108233+0000","last_unstale":"2024-05-14T10:11:27.863105+0000","last_undegraded":"2024-05-14T10:11:27.863105+0000","last_fullsized":"2024-05-14T10:11:27.863105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'88","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.514041+0000","last_change":"2024-05-14T09:40:53.663789+0000","last_active":"2024-05-14T10:11:03.514041+0000","last_peered":"2024-05-14T10:11:03.514041+0000","last_clean":"2024-05-14T10:11:03.514041+0000","last_became_active":"2024-05-14T09:40:53.662980+0000","last_became_peered":"2024-05-14T09:40:53.662980+0000","last_unstale":"2024-05-14T10:11:03.514041+0000","last_undegraded":"2024-05-14T10:11:03.514041+0000","last_fullsized":"2024-05-14T10:11:03.514041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:46.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.521730+0000","last_change":"2024-05-14T09:40:45.754347+0000","last_active":"2024-05-14T10:12:13.521730+0000","last_peered":"2024-05-14T10:12:13.521730+0000","last_clean":"2024-05-14T10:12:13.521730+0000","last_became_active":"2024-05-14T09:40:45.753869+0000","last_became_peered":"2024-05-14T09:40:45.753869+0000","last_unstale":"2024-05-14T10:12:13.521730+0000","last_undegraded":"2024-05-14T10:12:13.521730+0000","last_fullsized":"2024-05-14T10:12:13.521730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'8","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:45.883971+0000","last_change":"2024-05-14T09:40:43.087481+0000","last_active":"2024-05-14T10:11:45.883971+0000","last_peered":"2024-05-14T10:11:45.883971+0000","last_clean":"2024-05-14T10:11:45.883971+0000","last_became_active":"2024-05-14T09:40:43.086487+0000","last_became_peered":"2024-05-14T09:40:43.086487+0000","last_unstale":"2024-05-14T10:11:45.883971+0000","last_undegraded":"2024-05-14T10:11:45.883971+0000","last_fullsized":"2024-05-14T10:11:45.883971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:54.225063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":148,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:08:20.122885+0000","last_change":"2024-05-14T09:40:22.705545+0000","last_active":"2024-05-14T10:08:20.122885+0000","last_peered":"2024-05-14T10:08:20.122885+0000","last_clean":"2024-05-14T10:08:20.122885+0000","last_became_active":"2024-05-14T09:40:22.701797+0000","last_became_peered":"2024-05-14T09:40:22.701797+0000","last_unstale":"2024-05-14T10:08:20.122885+0000","last_undegraded":"2024-05-14T10:08:20.122885+0000","last_fullsized":"2024-05-14T10:08:20.122885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_clean_scrub_stamp":"2024-05-14T09:40:17.767400+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:48:21.700172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'61","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:49.080123+0000","last_change":"2024-05-14T09:40:53.681915+0000","last_active":"2024-05-14T10:10:49.080123+0000","last_peered":"2024-05-14T10:10:49.080123+0000","last_clean":"2024-05-14T10:10:49.080123+0000","last_became_active":"2024-05-14T09:40:53.681296+0000","last_became_peered":"2024-05-14T09:40:53.681296+0000","last_unstale":"2024-05-14T10:10:49.080123+0000","last_undegraded":"2024-05-14T10:10:49.080123+0000","last_fullsized":"2024-05-14T10:10:49.080123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:21.455981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'23","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.633400+0000","last_change":"2024-05-14T09:41:04.213355+0000","last_active":"2024-05-14T10:12:13.633400+0000","last_peered":"2024-05-14T10:12:13.633400+0000","last_clean":"2024-05-14T10:12:13.633400+0000","last_became_active":"2024-05-14T09:41:04.212709+0000","last_became_peered":"2024-05-14T09:41:04.212709+0000","last_unstale":"2024-05-14T10:12:13.633400+0000","last_undegraded":"2024-05-14T10:12:13.633400+0000","last_fullsized":"2024-05-14T10:12:13.633400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"33'5","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.892390+0000","last_change":"2024-05-14T09:40:43.090401+0000","last_active":"2024-05-14T10:12:02.892390+0000","last_peered":"2024-05-14T10:12:02.892390+0000","last_clean":"2024-05-14T10:12:02.892390+0000","last_became_active":"2024-05-14T09:40:43.089548+0000","last_became_peered":"2024-05-14T09:40:43.089548+0000","last_unstale":"2024-05-14T10:12:02.892390+0000","last_undegraded":"2024-05-14T10:12:02.892390+0000","last_fullsized":"2024-05-14T10:12:02.892390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:03.385598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'79","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:07.506476+0000","last_change":"2024-05-14T09:40:53.677072+0000","last_active":"2024-05-14T10:11:07.506476+0000","last_peered":"2024-05-14T10:11:07.506476+0000","last_clean":"2024-05-14T10:11:07.506476+0000","last_became_active":"2024-05-14T09:40:53.676636+0000","last_became_peered":"2024-05-14T09:40:53.676636+0000","last_unstale":"2024-05-14T10:11:07.506476+0000","last_undegraded":"2024-05-14T10:11:07.506476+0000","last_fullsized":"2024-05-14T10:11:07.506476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":7859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'21","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623051+0000","last_change":"2024-05-14T09:40:45.750962+0000","last_active":"2024-05-14T10:12:13.623051+0000","last_peered":"2024-05-14T10:12:13.623051+0000","last_clean":"2024-05-14T10:12:13.623051+0000","last_became_active":"2024-05-14T09:40:45.750539+0000","last_became_peered":"2024-05-14T09:40:45.750539+0000","last_unstale":"2024-05-14T10:12:13.623051+0000","last_undegraded":"2024-05-14T10:12:13.623051+0000","last_fullsized":"2024-05-14T10:12:13.623051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:42.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:39.462630+0000","last_change":"2024-05-14T09:40:43.122483+0000","last_active":"2024-05-14T10:11:39.462630+0000","last_peered":"2024-05-14T10:11:39.462630+0000","last_clean":"2024-05-14T10:11:39.462630+0000","last_became_active":"2024-05-14T09:40:43.121427+0000","last_became_peered":"2024-05-14T09:40:43.121427+0000","last_unstale":"2024-05-14T10:11:39.462630+0000","last_undegraded":"2024-05-14T10:11:39.462630+0000","last_fullsized":"2024-05-14T10:11:39.462630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:31.384470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'90","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:58.172126+0000","last_change":"2024-05-14T09:40:53.656157+0000","last_active":"2024-05-14T10:10:58.172126+0000","last_peered":"2024-05-14T10:10:58.172126+0000","last_clean":"2024-05-14T10:10:58.172126+0000","last_became_active":"2024-05-14T09:40:53.655141+0000","last_became_peered":"2024-05-14T09:40:53.655141+0000","last_unstale":"2024-05-14T10:10:58.172126+0000","last_undegraded":"2024-05-14T10:10:58.172126+0000","last_fullsized":"2024-05-14T10:10:58.172126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'24","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655700+0000","last_change":"2024-05-14T09:40:45.778555+0000","last_active":"2024-05-14T10:12:13.655700+0000","last_peered":"2024-05-14T10:12:13.655700+0000","last_clean":"2024-05-14T10:12:13.655700+0000","last_became_active":"2024-05-14T09:40:45.776967+0000","last_became_peered":"2024-05-14T09:40:45.776967+0000","last_unstale":"2024-05-14T10:12:13.655700+0000","last_undegraded":"2024-05-14T10:12:13.655700+0000","last_fullsized":"2024-05-14T10:12:13.655700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:45:35.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"33'3","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:10.445726+0000","last_change":"2024-05-14T09:40:43.043359+0000","last_active":"2024-05-14T10:12:10.445726+0000","last_peered":"2024-05-14T10:12:10.445726+0000","last_clean":"2024-05-14T10:12:10.445726+0000","last_became_active":"2024-05-14T09:40:43.042486+0000","last_became_peered":"2024-05-14T09:40:43.042486+0000","last_unstale":"2024-05-14T10:12:10.445726+0000","last_undegraded":"2024-05-14T10:12:10.445726+0000","last_fullsized":"2024-05-14T10:12:10.445726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:15.480365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'69","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.556561+0000","last_change":"2024-05-14T09:40:53.662719+0000","last_active":"2024-05-14T10:11:05.556561+0000","last_peered":"2024-05-14T10:11:05.556561+0000","last_clean":"2024-05-14T10:11:05.556561+0000","last_became_active":"2024-05-14T09:40:53.660933+0000","last_became_peered":"2024-05-14T09:40:53.660933+0000","last_unstale":"2024-05-14T10:11:05.556561+0000","last_undegraded":"2024-05-14T10:11:05.556561+0000","last_fullsized":"2024-05-14T10:11:05.556561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:02.584358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'15","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655467+0000","last_change":"2024-05-14T09:40:45.776336+0000","last_active":"2024-05-14T10:12:13.655467+0000","last_peered":"2024-05-14T10:12:13.655467+0000","last_clean":"2024-05-14T10:12:13.655467+0000","last_became_active":"2024-05-14T09:40:45.775936+0000","last_became_peered":"2024-05-14T09:40:45.775936+0000","last_unstale":"2024-05-14T10:12:13.655467+0000","last_undegraded":"2024-05-14T10:12:13.655467+0000","last_fullsized":"2024-05-14T10:12:13.655467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:59.300900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'7","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:04.105943+0000","last_change":"2024-05-14T09:40:43.124714+0000","last_active":"2024-05-14T10:12:04.105943+0000","last_peered":"2024-05-14T10:12:04.105943+0000","last_clean":"2024-05-14T10:12:04.105943+0000","last_became_active":"2024-05-14T09:40:43.124370+0000","last_became_peered":"2024-05-14T09:40:43.124370+0000","last_unstale":"2024-05-14T10:12:04.105943+0000","last_undegraded":"2024-05-14T10:12:04.105943+0000","last_fullsized":"2024-05-14T10:12:04.105943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:52.132214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'76","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.457975+0000","last_change":"2024-05-14T09:40:53.667102+0000","last_active":"2024-05-14T10:11:06.457975+0000","last_peered":"2024-05-14T10:11:06.457975+0000","last_clean":"2024-05-14T10:11:06.457975+0000","last_became_active":"2024-05-14T09:40:53.666666+0000","last_became_peered":"2024-05-14T09:40:53.666666+0000","last_unstale":"2024-05-14T10:11:06.457975+0000","last_undegraded":"2024-05-14T10:11:06.457975+0000","last_fullsized":"2024-05-14T10:11:06.457975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'22","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.645621+0000","last_change":"2024-05-14T09:40:45.777251+0000","last_active":"2024-05-14T10:12:13.645621+0000","last_peered":"2024-05-14T10:12:13.645621+0000","last_clean":"2024-05-14T10:12:13.645621+0000","last_became_active":"2024-05-14T09:40:45.775668+0000","last_became_peered":"2024-05-14T09:40:45.775668+0000","last_unstale":"2024-05-14T10:12:13.645621+0000","last_undegraded":"2024-05-14T10:12:13.645621+0000","last_fullsized":"2024-05-14T10:12:13.645621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:54.917354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'18","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.417385+0000","last_change":"2024-05-14T09:40:43.040000+0000","last_active":"2024-05-14T10:11:52.417385+0000","last_peered":"2024-05-14T10:11:52.417385+0000","last_clean":"2024-05-14T10:11:52.417385+0000","last_became_active":"2024-05-14T09:40:43.039186+0000","last_became_peered":"2024-05-14T09:40:43.039186+0000","last_unstale":"2024-05-14T10:11:52.417385+0000","last_undegraded":"2024-05-14T10:11:52.417385+0000","last_fullsized":"2024-05-14T10:11:52.417385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:41:44.514114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'79","reported_seq":113,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.550442+0000","last_change":"2024-05-14T09:40:53.667056+0000","last_active":"2024-05-14T10:11:05.550442+0000","last_peered":"2024-05-14T10:11:05.550442+0000","last_clean":"2024-05-14T10:11:05.550442+0000","last_became_active":"2024-05-14T09:40:53.666575+0000","last_became_peered":"2024-05-14T09:40:53.666575+0000","last_unstale":"2024-05-14T10:11:05.550442+0000","last_undegraded":"2024-05-14T10:11:05.550442+0000","last_fullsized":"2024-05-14T10:11:05.550442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":7996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'21","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.850810+0000","last_change":"2024-05-14T09:40:45.754466+0000","last_active":"2024-05-14T10:12:13.850810+0000","last_peered":"2024-05-14T10:12:13.850810+0000","last_clean":"2024-05-14T10:12:13.850810+0000","last_became_active":"2024-05-14T09:40:45.753839+0000","last_became_peered":"2024-05-14T09:40:45.753839+0000","last_unstale":"2024-05-14T10:12:13.850810+0000","last_undegraded":"2024-05-14T10:12:13.850810+0000","last_fullsized":"2024-05-14T10:12:13.850810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'5","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:34.188111+0000","last_change":"2024-05-14T09:40:43.121744+0000","last_active":"2024-05-14T10:11:34.188111+0000","last_peered":"2024-05-14T10:11:34.188111+0000","last_clean":"2024-05-14T10:11:34.188111+0000","last_became_active":"2024-05-14T09:40:43.121388+0000","last_became_peered":"2024-05-14T09:40:43.121388+0000","last_unstale":"2024-05-14T10:11:34.188111+0000","last_undegraded":"2024-05-14T10:11:34.188111+0000","last_fullsized":"2024-05-14T10:11:34.188111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'76","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.890093+0000","last_change":"2024-05-14T09:40:53.659658+0000","last_active":"2024-05-14T10:11:00.890093+0000","last_peered":"2024-05-14T10:11:00.890093+0000","last_clean":"2024-05-14T10:11:00.890093+0000","last_became_active":"2024-05-14T09:40:53.659191+0000","last_became_peered":"2024-05-14T09:40:53.659191+0000","last_unstale":"2024-05-14T10:11:00.890093+0000","last_undegraded":"2024-05-14T10:11:00.890093+0000","last_fullsized":"2024-05-14T10:11:00.890093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:15:39.587593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":8058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655238+0000","last_change":"2024-05-14T09:40:45.776748+0000","last_active":"2024-05-14T10:12:13.655238+0000","last_peered":"2024-05-14T10:12:13.655238+0000","last_clean":"2024-05-14T10:12:13.655238+0000","last_became_active":"2024-05-14T09:40:45.776451+0000","last_became_peered":"2024-05-14T09:40:45.776451+0000","last_unstale":"2024-05-14T10:12:13.655238+0000","last_undegraded":"2024-05-14T10:12:13.655238+0000","last_fullsized":"2024-05-14T10:12:13.655238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:39.890407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:09.356299+0000","last_change":"2024-05-14T09:40:43.086185+0000","last_active":"2024-05-14T10:12:09.356299+0000","last_peered":"2024-05-14T10:12:09.356299+0000","last_clean":"2024-05-14T10:12:09.356299+0000","last_became_active":"2024-05-14T09:40:43.085320+0000","last_became_peered":"2024-05-14T09:40:43.085320+0000","last_unstale":"2024-05-14T10:12:09.356299+0000","last_undegraded":"2024-05-14T10:12:09.356299+0000","last_fullsized":"2024-05-14T10:12:09.356299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:26:22.301593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'63","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:01.698322+0000","last_change":"2024-05-14T09:40:53.673710+0000","last_active":"2024-05-14T10:11:01.698322+0000","last_peered":"2024-05-14T10:11:01.698322+0000","last_clean":"2024-05-14T10:11:01.698322+0000","last_became_active":"2024-05-14T09:40:53.672089+0000","last_became_peered":"2024-05-14T09:40:53.672089+0000","last_unstale":"2024-05-14T10:11:01.698322+0000","last_undegraded":"2024-05-14T10:11:01.698322+0000","last_fullsized":"2024-05-14T10:11:01.698322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:48:16.697615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":6897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'25","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.484748+0000","last_change":"2024-05-14T09:40:45.767220+0000","last_active":"2024-05-14T10:12:13.484748+0000","last_peered":"2024-05-14T10:12:13.484748+0000","last_clean":"2024-05-14T10:12:13.484748+0000","last_became_active":"2024-05-14T09:40:45.766895+0000","last_became_peered":"2024-05-14T09:40:45.766895+0000","last_unstale":"2024-05-14T10:12:13.484748+0000","last_undegraded":"2024-05-14T10:12:13.484748+0000","last_fullsized":"2024-05-14T10:12:13.484748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'10","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:34.189842+0000","last_change":"2024-05-14T09:40:43.124937+0000","last_active":"2024-05-14T10:11:34.189842+0000","last_peered":"2024-05-14T10:11:34.189842+0000","last_clean":"2024-05-14T10:11:34.189842+0000","last_became_active":"2024-05-14T09:40:43.124129+0000","last_became_peered":"2024-05-14T09:40:43.124129+0000","last_unstale":"2024-05-14T10:11:34.189842+0000","last_undegraded":"2024-05-14T10:11:34.189842+0000","last_fullsized":"2024-05-14T10:11:34.189842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'71","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.445761+0000","last_change":"2024-05-14T09:40:53.664722+0000","last_active":"2024-05-14T10:11:06.445761+0000","last_peered":"2024-05-14T10:11:06.445761+0000","last_clean":"2024-05-14T10:11:06.445761+0000","last_became_active":"2024-05-14T09:40:53.664194+0000","last_became_peered":"2024-05-14T09:40:53.664194+0000","last_unstale":"2024-05-14T10:11:06.445761+0000","last_undegraded":"2024-05-14T10:11:06.445761+0000","last_fullsized":"2024-05-14T10:11:06.445761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:35:57.826557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":7358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'20","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.643712+0000","last_change":"2024-05-14T09:40:45.770662+0000","last_active":"2024-05-14T10:12:13.643712+0000","last_peered":"2024-05-14T10:12:13.643712+0000","last_clean":"2024-05-14T10:12:13.643712+0000","last_became_active":"2024-05-14T09:40:45.768058+0000","last_became_peered":"2024-05-14T09:40:45.768058+0000","last_unstale":"2024-05-14T10:12:13.643712+0000","last_undegraded":"2024-05-14T10:12:13.643712+0000","last_fullsized":"2024-05-14T10:12:13.643712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:13.296625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'824","reported_seq":872,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:56.423487+0000","last_change":"2024-05-14T09:40:43.113989+0000","last_active":"2024-05-14T10:11:56.423487+0000","last_peered":"2024-05-14T10:11:56.423487+0000","last_clean":"2024-05-14T10:11:56.423487+0000","last_became_active":"2024-05-14T09:40:43.113589+0000","last_became_peered":"2024-05-14T09:40:43.113589+0000","last_unstale":"2024-05-14T10:11:56.423487+0000","last_undegraded":"2024-05-14T10:11:56.423487+0000","last_fullsized":"2024-05-14T10:11:56.423487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:42:17.351523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'80","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:04.469761+0000","last_change":"2024-05-14T09:40:53.663887+0000","last_active":"2024-05-14T10:11:04.469761+0000","last_peered":"2024-05-14T10:11:04.469761+0000","last_clean":"2024-05-14T10:11:04.469761+0000","last_became_active":"2024-05-14T09:40:53.663419+0000","last_became_peered":"2024-05-14T09:40:53.663419+0000","last_unstale":"2024-05-14T10:11:04.469761+0000","last_undegraded":"2024-05-14T10:11:04.469761+0000","last_fullsized":"2024-05-14T10:11:04.469761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:18.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":12628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"33'24","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.653832+0000","last_change":"2024-05-14T09:40:45.767184+0000","last_active":"2024-05-14T10:12:13.653832+0000","last_peered":"2024-05-14T10:12:13.653832+0000","last_clean":"2024-05-14T10:12:13.653832+0000","last_became_active":"2024-05-14T09:40:45.766784+0000","last_became_peered":"2024-05-14T09:40:45.766784+0000","last_unstale":"2024-05-14T10:12:13.653832+0000","last_undegraded":"2024-05-14T10:12:13.653832+0000","last_fullsized":"2024-05-14T10:12:13.653832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'307","reported_seq":355,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:12.356956+0000","last_change":"2024-05-14T09:40:43.089869+0000","last_active":"2024-05-14T10:12:12.356956+0000","last_peered":"2024-05-14T10:12:12.356956+0000","last_clean":"2024-05-14T10:12:12.356956+0000","last_became_active":"2024-05-14T09:40:43.088906+0000","last_became_peered":"2024-05-14T09:40:43.088906+0000","last_unstale":"2024-05-14T10:12:12.356956+0000","last_undegraded":"2024-05-14T10:12:12.356956+0000","last_fullsized":"2024-05-14T10:12:12.356956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:28.223322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'115","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.819059+0000","last_change":"2024-05-14T09:40:53.667412+0000","last_active":"2024-05-14T10:11:05.819059+0000","last_peered":"2024-05-14T10:11:05.819059+0000","last_clean":"2024-05-14T10:11:05.819059+0000","last_became_active":"2024-05-14T09:40:53.666533+0000","last_became_peered":"2024-05-14T09:40:53.666533+0000","last_unstale":"2024-05-14T10:11:05.819059+0000","last_undegraded":"2024-05-14T10:11:05.819059+0000","last_fullsized":"2024-05-14T10:11:05.819059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:53:41.310701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'25","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.473306+0000","last_change":"2024-05-14T09:41:04.250664+0000","last_active":"2024-05-14T10:12:13.473306+0000","last_peered":"2024-05-14T10:12:13.473306+0000","last_clean":"2024-05-14T10:12:13.473306+0000","last_became_active":"2024-05-14T09:41:04.250043+0000","last_became_peered":"2024-05-14T09:41:04.250043+0000","last_unstale":"2024-05-14T10:12:13.473306+0000","last_undegraded":"2024-05-14T10:12:13.473306+0000","last_fullsized":"2024-05-14T10:12:13.473306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:46:49.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:54.436624+0000","last_change":"2024-05-14T09:40:43.116130+0000","last_active":"2024-05-14T10:11:54.436624+0000","last_peered":"2024-05-14T10:11:54.436624+0000","last_clean":"2024-05-14T10:11:54.436624+0000","last_became_active":"2024-05-14T09:40:43.115741+0000","last_became_peered":"2024-05-14T09:40:43.115741+0000","last_unstale":"2024-05-14T10:11:54.436624+0000","last_undegraded":"2024-05-14T10:11:54.436624+0000","last_fullsized":"2024-05-14T10:11:54.436624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:35.083285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'83","reported_seq":117,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.889971+0000","last_change":"2024-05-14T09:40:53.667088+0000","last_active":"2024-05-14T10:11:00.889971+0000","last_peered":"2024-05-14T10:11:00.889971+0000","last_clean":"2024-05-14T10:11:00.889971+0000","last_became_active":"2024-05-14T09:40:53.662581+0000","last_became_peered":"2024-05-14T09:40:53.662581+0000","last_unstale":"2024-05-14T10:11:00.889971+0000","last_undegraded":"2024-05-14T10:11:00.889971+0000","last_fullsized":"2024-05-14T10:11:00.889971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:14:18.824424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.617351+0000","last_change":"2024-05-14T09:40:45.774302+0000","last_active":"2024-05-14T10:12:13.617351+0000","last_peered":"2024-05-14T10:12:13.617351+0000","last_clean":"2024-05-14T10:12:13.617351+0000","last_became_active":"2024-05-14T09:40:45.773879+0000","last_became_peered":"2024-05-14T09:40:45.773879+0000","last_unstale":"2024-05-14T10:12:13.617351+0000","last_undegraded":"2024-05-14T10:12:13.617351+0000","last_fullsized":"2024-05-14T10:12:13.617351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:09.921679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:10.831471+0000","last_change":"2024-05-14T09:40:43.116616+0000","last_active":"2024-05-14T10:12:10.831471+0000","last_peered":"2024-05-14T10:12:10.831471+0000","last_clean":"2024-05-14T10:12:10.831471+0000","last_became_active":"2024-05-14T09:40:43.115166+0000","last_became_peered":"2024-05-14T09:40:43.115166+0000","last_unstale":"2024-05-14T10:12:10.831471+0000","last_undegraded":"2024-05-14T10:12:10.831471+0000","last_fullsized":"2024-05-14T10:12:10.831471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:52.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'85","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:51.094065+0000","last_change":"2024-05-14T09:40:53.668423+0000","last_active":"2024-05-14T10:10:51.094065+0000","last_peered":"2024-05-14T10:10:51.094065+0000","last_clean":"2024-05-14T10:10:51.094065+0000","last_became_active":"2024-05-14T09:40:53.664838+0000","last_became_peered":"2024-05-14T09:40:53.664838+0000","last_unstale":"2024-05-14T10:10:51.094065+0000","last_undegraded":"2024-05-14T10:10:51.094065+0000","last_fullsized":"2024-05-14T10:10:51.094065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:00:35.633754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":10155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'59","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.793458+0000","last_change":"2024-05-14T09:40:53.656095+0000","last_active":"2024-05-14T10:11:00.793458+0000","last_peered":"2024-05-14T10:11:00.793458+0000","last_clean":"2024-05-14T10:11:00.793458+0000","last_became_active":"2024-05-14T09:40:53.655439+0000","last_became_peered":"2024-05-14T09:40:53.655439+0000","last_unstale":"2024-05-14T10:11:00.793458+0000","last_undegraded":"2024-05-14T10:11:00.793458+0000","last_fullsized":"2024-05-14T10:11:00.793458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:44.521319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.501706+0000","last_change":"2024-05-14T09:40:45.744447+0000","last_active":"2024-05-14T10:12:13.501706+0000","last_peered":"2024-05-14T10:12:13.501706+0000","last_clean":"2024-05-14T10:12:13.501706+0000","last_became_active":"2024-05-14T09:40:45.743611+0000","last_became_peered":"2024-05-14T09:40:45.743611+0000","last_unstale":"2024-05-14T10:12:13.501706+0000","last_undegraded":"2024-05-14T10:12:13.501706+0000","last_fullsized":"2024-05-14T10:12:13.501706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:56.519183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'7","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:04.107149+0000","last_change":"2024-05-14T09:40:43.122005+0000","last_active":"2024-05-14T10:12:04.107149+0000","last_peered":"2024-05-14T10:12:04.107149+0000","last_clean":"2024-05-14T10:12:04.107149+0000","last_became_active":"2024-05-14T09:40:43.121629+0000","last_became_peered":"2024-05-14T09:40:43.121629+0000","last_unstale":"2024-05-14T10:12:04.107149+0000","last_undegraded":"2024-05-14T10:12:04.107149+0000","last_fullsized":"2024-05-14T10:12:04.107149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:31:03.016812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'63","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.462172+0000","last_change":"2024-05-14T09:40:53.679415+0000","last_active":"2024-05-14T10:11:03.462172+0000","last_peered":"2024-05-14T10:11:03.462172+0000","last_clean":"2024-05-14T10:11:03.462172+0000","last_became_active":"2024-05-14T09:40:53.678851+0000","last_became_peered":"2024-05-14T09:40:53.678851+0000","last_unstale":"2024-05-14T10:11:03.462172+0000","last_undegraded":"2024-05-14T10:11:03.462172+0000","last_fullsized":"2024-05-14T10:11:03.462172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:48.049763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.537840+0000","last_change":"2024-05-14T09:40:45.743111+0000","last_active":"2024-05-14T10:12:13.537840+0000","last_peered":"2024-05-14T10:12:13.537840+0000","last_clean":"2024-05-14T10:12:13.537840+0000","last_became_active":"2024-05-14T09:40:45.742702+0000","last_became_peered":"2024-05-14T09:40:45.742702+0000","last_unstale":"2024-05-14T10:12:13.537840+0000","last_undegraded":"2024-05-14T10:12:13.537840+0000","last_fullsized":"2024-05-14T10:12:13.537840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:17:39.673477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.984144+0000","last_change":"2024-05-14T09:40:43.116535+0000","last_active":"2024-05-14T10:12:02.984144+0000","last_peered":"2024-05-14T10:12:02.984144+0000","last_clean":"2024-05-14T10:12:02.984144+0000","last_became_active":"2024-05-14T09:40:43.115860+0000","last_became_peered":"2024-05-14T09:40:43.115860+0000","last_unstale":"2024-05-14T10:12:02.984144+0000","last_undegraded":"2024-05-14T10:12:02.984144+0000","last_fullsized":"2024-05-14T10:12:02.984144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'339","reported_seq":386,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.430157+0000","last_change":"2024-05-14T09:40:43.120700+0000","last_active":"2024-05-14T10:11:52.430157+0000","last_peered":"2024-05-14T10:11:52.430157+0000","last_clean":"2024-05-14T10:11:52.430157+0000","last_became_active":"2024-05-14T09:40:43.120353+0000","last_became_peered":"2024-05-14T09:40:43.120353+0000","last_unstale":"2024-05-14T10:11:52.430157+0000","last_undegraded":"2024-05-14T10:11:52.430157+0000","last_fullsized":"2024-05-14T10:11:52.430157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:35.425012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'24","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.485676+0000","last_change":"2024-05-14T09:40:45.758385+0000","last_active":"2024-05-14T10:12:13.485676+0000","last_peered":"2024-05-14T10:12:13.485676+0000","last_clean":"2024-05-14T10:12:13.485676+0000","last_became_active":"2024-05-14T09:40:45.758017+0000","last_became_peered":"2024-05-14T09:40:45.758017+0000","last_unstale":"2024-05-14T10:12:13.485676+0000","last_undegraded":"2024-05-14T10:12:13.485676+0000","last_fullsized":"2024-05-14T10:12:13.485676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'56","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.890744+0000","last_change":"2024-05-14T09:40:53.671995+0000","last_active":"2024-05-14T10:11:00.890744+0000","last_peered":"2024-05-14T10:11:00.890744+0000","last_clean":"2024-05-14T10:11:00.890744+0000","last_became_active":"2024-05-14T09:40:53.671145+0000","last_became_peered":"2024-05-14T09:40:53.671145+0000","last_unstale":"2024-05-14T10:11:00.890744+0000","last_undegraded":"2024-05-14T10:11:00.890744+0000","last_fullsized":"2024-05-14T10:11:00.890744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:02.991096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'472","reported_seq":519,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.865101+0000","last_change":"2024-05-14T09:40:43.105812+0000","last_active":"2024-05-14T10:11:57.865101+0000","last_peered":"2024-05-14T10:11:57.865101+0000","last_clean":"2024-05-14T10:11:57.865101+0000","last_became_active":"2024-05-14T09:40:43.104821+0000","last_became_peered":"2024-05-14T09:40:43.104821+0000","last_unstale":"2024-05-14T10:11:57.865101+0000","last_undegraded":"2024-05-14T10:11:57.865101+0000","last_fullsized":"2024-05-14T10:11:57.865101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'22","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.640694+0000","last_change":"2024-05-14T09:40:45.746294+0000","last_active":"2024-05-14T10:12:13.640694+0000","last_peered":"2024-05-14T10:12:13.640694+0000","last_clean":"2024-05-14T10:12:13.640694+0000","last_became_active":"2024-05-14T09:40:45.745850+0000","last_became_peered":"2024-05-14T09:40:45.745850+0000","last_unstale":"2024-05-14T10:12:13.640694+0000","last_undegraded":"2024-05-14T10:12:13.640694+0000","last_fullsized":"2024-05-14T10:12:13.640694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:17.774486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'74","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:58.132031+0000","last_change":"2024-05-14T09:40:53.670990+0000","last_active":"2024-05-14T10:10:58.132031+0000","last_peered":"2024-05-14T10:10:58.132031+0000","last_clean":"2024-05-14T10:10:58.132031+0000","last_became_active":"2024-05-14T09:40:53.669094+0000","last_became_peered":"2024-05-14T09:40:53.669094+0000","last_unstale":"2024-05-14T10:10:58.132031+0000","last_undegraded":"2024-05-14T10:10:58.132031+0000","last_fullsized":"2024-05-14T10:10:58.132031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:35:15.483140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":7350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.851152+0000","last_change":"2024-05-14T09:40:45.754615+0000","last_active":"2024-05-14T10:12:13.851152+0000","last_peered":"2024-05-14T10:12:13.851152+0000","last_clean":"2024-05-14T10:12:13.851152+0000","last_became_active":"2024-05-14T09:40:45.754283+0000","last_became_peered":"2024-05-14T09:40:45.754283+0000","last_unstale":"2024-05-14T10:12:13.851152+0000","last_undegraded":"2024-05-14T10:12:13.851152+0000","last_fullsized":"2024-05-14T10:12:13.851152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'26","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.628640+0000","last_change":"2024-05-14T09:40:45.753218+0000","last_active":"2024-05-14T10:12:13.628640+0000","last_peered":"2024-05-14T10:12:13.628640+0000","last_clean":"2024-05-14T10:12:13.628640+0000","last_became_active":"2024-05-14T09:40:45.752599+0000","last_became_peered":"2024-05-14T09:40:45.752599+0000","last_unstale":"2024-05-14T10:12:13.628640+0000","last_undegraded":"2024-05-14T10:12:13.628640+0000","last_fullsized":"2024-05-14T10:12:13.628640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'26","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.615687+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T10:12:13.615687+0000","last_peered":"2024-05-14T10:12:13.615687+0000","last_clean":"2024-05-14T10:12:13.615687+0000","last_became_active":"2024-05-14T09:40:45.750387+0000","last_became_peered":"2024-05-14T09:40:45.750387+0000","last_unstale":"2024-05-14T10:12:13.615687+0000","last_undegraded":"2024-05-14T10:12:13.615687+0000","last_fullsized":"2024-05-14T10:12:13.615687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:54.689111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'18","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.475232+0000","last_change":"2024-05-14T09:41:04.251002+0000","last_active":"2024-05-14T10:12:13.475232+0000","last_peered":"2024-05-14T10:12:13.475232+0000","last_clean":"2024-05-14T10:12:13.475232+0000","last_became_active":"2024-05-14T09:41:04.250037+0000","last_became_peered":"2024-05-14T09:41:04.250037+0000","last_unstale":"2024-05-14T10:12:13.475232+0000","last_undegraded":"2024-05-14T10:12:13.475232+0000","last_fullsized":"2024-05-14T10:12:13.475232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:42:35.669137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'17","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.572074+0000","last_change":"2024-05-14T09:40:45.723956+0000","last_active":"2024-05-14T10:12:13.572074+0000","last_peered":"2024-05-14T10:12:13.572074+0000","last_clean":"2024-05-14T10:12:13.572074+0000","last_became_active":"2024-05-14T09:40:45.723040+0000","last_became_peered":"2024-05-14T09:40:45.723040+0000","last_unstale":"2024-05-14T10:12:13.572074+0000","last_undegraded":"2024-05-14T10:12:13.572074+0000","last_fullsized":"2024-05-14T10:12:13.572074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:45.690725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'18","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.485881+0000","last_change":"2024-05-14T09:40:45.746942+0000","last_active":"2024-05-14T10:12:13.485881+0000","last_peered":"2024-05-14T10:12:13.485881+0000","last_clean":"2024-05-14T10:12:13.485881+0000","last_became_active":"2024-05-14T09:40:45.745393+0000","last_became_peered":"2024-05-14T09:40:45.745393+0000","last_unstale":"2024-05-14T10:12:13.485881+0000","last_undegraded":"2024-05-14T10:12:13.485881+0000","last_fullsized":"2024-05-14T10:12:13.485881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:37.377406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'32","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.860871+0000","last_change":"2024-05-14T09:40:45.772238+0000","last_active":"2024-05-14T10:12:13.860871+0000","last_peered":"2024-05-14T10:12:13.860871+0000","last_clean":"2024-05-14T10:12:13.860871+0000","last_became_active":"2024-05-14T09:40:45.771838+0000","last_became_peered":"2024-05-14T09:40:45.771838+0000","last_unstale":"2024-05-14T10:12:13.860871+0000","last_undegraded":"2024-05-14T10:12:13.860871+0000","last_fullsized":"2024-05-14T10:12:13.860871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"33'17","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.502633+0000","last_change":"2024-05-14T09:40:45.727770+0000","last_active":"2024-05-14T10:12:13.502633+0000","last_peered":"2024-05-14T10:12:13.502633+0000","last_clean":"2024-05-14T10:12:13.502633+0000","last_became_active":"2024-05-14T09:40:45.725283+0000","last_became_peered":"2024-05-14T09:40:45.725283+0000","last_unstale":"2024-05-14T10:12:13.502633+0000","last_undegraded":"2024-05-14T10:12:13.502633+0000","last_fullsized":"2024-05-14T10:12:13.502633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:22.638700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'19","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.624093+0000","last_change":"2024-05-14T09:40:45.749288+0000","last_active":"2024-05-14T10:12:13.624093+0000","last_peered":"2024-05-14T10:12:13.624093+0000","last_clean":"2024-05-14T10:12:13.624093+0000","last_became_active":"2024-05-14T09:40:45.748925+0000","last_became_peered":"2024-05-14T09:40:45.748925+0000","last_unstale":"2024-05-14T10:12:13.624093+0000","last_undegraded":"2024-05-14T10:12:13.624093+0000","last_fullsized":"2024-05-14T10:12:13.624093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:03.576418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'25","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.557987+0000","last_change":"2024-05-14T09:40:45.724197+0000","last_active":"2024-05-14T10:12:13.557987+0000","last_peered":"2024-05-14T10:12:13.557987+0000","last_clean":"2024-05-14T10:12:13.557987+0000","last_became_active":"2024-05-14T09:40:45.723317+0000","last_became_peered":"2024-05-14T09:40:45.723317+0000","last_unstale":"2024-05-14T10:12:13.557987+0000","last_undegraded":"2024-05-14T10:12:13.557987+0000","last_fullsized":"2024-05-14T10:12:13.557987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'24","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.621654+0000","last_change":"2024-05-14T09:40:45.770723+0000","last_active":"2024-05-14T10:12:13.621654+0000","last_peered":"2024-05-14T10:12:13.621654+0000","last_clean":"2024-05-14T10:12:13.621654+0000","last_became_active":"2024-05-14T09:40:45.769772+0000","last_became_peered":"2024-05-14T09:40:45.769772+0000","last_unstale":"2024-05-14T10:12:13.621654+0000","last_undegraded":"2024-05-14T10:12:13.621654+0000","last_fullsized":"2024-05-14T10:12:13.621654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:44.852533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"33'33","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.486834+0000","last_change":"2024-05-14T09:40:45.766217+0000","last_active":"2024-05-14T10:12:13.486834+0000","last_peered":"2024-05-14T10:12:13.486834+0000","last_clean":"2024-05-14T10:12:13.486834+0000","last_became_active":"2024-05-14T09:40:45.765830+0000","last_became_peered":"2024-05-14T09:40:45.765830+0000","last_unstale":"2024-05-14T10:12:13.486834+0000","last_undegraded":"2024-05-14T10:12:13.486834+0000","last_fullsized":"2024-05-14T10:12:13.486834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'27","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.854039+0000","last_change":"2024-05-14T09:40:45.760838+0000","last_active":"2024-05-14T10:12:13.854039+0000","last_peered":"2024-05-14T10:12:13.854039+0000","last_clean":"2024-05-14T10:12:13.854039+0000","last_became_active":"2024-05-14T09:40:45.760535+0000","last_became_peered":"2024-05-14T09:40:45.760535+0000","last_unstale":"2024-05-14T10:12:13.854039+0000","last_undegraded":"2024-05-14T10:12:13.854039+0000","last_fullsized":"2024-05-14T10:12:13.854039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"33'23","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.648019+0000","last_change":"2024-05-14T09:40:45.778218+0000","last_active":"2024-05-14T10:12:13.648019+0000","last_peered":"2024-05-14T10:12:13.648019+0000","last_clean":"2024-05-14T10:12:13.648019+0000","last_became_active":"2024-05-14T09:40:45.775602+0000","last_became_peered":"2024-05-14T09:40:45.775602+0000","last_unstale":"2024-05-14T10:12:13.648019+0000","last_undegraded":"2024-05-14T10:12:13.648019+0000","last_fullsized":"2024-05-14T10:12:13.648019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:40.574917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'33","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.629831+0000","last_change":"2024-05-14T09:40:45.748996+0000","last_active":"2024-05-14T10:12:13.629831+0000","last_peered":"2024-05-14T10:12:13.629831+0000","last_clean":"2024-05-14T10:12:13.629831+0000","last_became_active":"2024-05-14T09:40:45.748266+0000","last_became_peered":"2024-05-14T09:40:45.748266+0000","last_unstale":"2024-05-14T10:12:13.629831+0000","last_undegraded":"2024-05-14T10:12:13.629831+0000","last_fullsized":"2024-05-14T10:12:13.629831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'22","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.621627+0000","last_change":"2024-05-14T09:41:04.613266+0000","last_active":"2024-05-14T10:12:13.621627+0000","last_peered":"2024-05-14T10:12:13.621627+0000","last_clean":"2024-05-14T10:12:13.621627+0000","last_became_active":"2024-05-14T09:41:04.612160+0000","last_became_peered":"2024-05-14T09:41:04.612160+0000","last_unstale":"2024-05-14T10:12:13.621627+0000","last_undegraded":"2024-05-14T10:12:13.621627+0000","last_fullsized":"2024-05-14T10:12:13.621627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'28","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623303+0000","last_change":"2024-05-14T09:40:45.757279+0000","last_active":"2024-05-14T10:12:13.623303+0000","last_peered":"2024-05-14T10:12:13.623303+0000","last_clean":"2024-05-14T10:12:13.623303+0000","last_became_active":"2024-05-14T09:40:45.749692+0000","last_became_peered":"2024-05-14T09:40:45.749692+0000","last_unstale":"2024-05-14T10:12:13.623303+0000","last_undegraded":"2024-05-14T10:12:13.623303+0000","last_fullsized":"2024-05-14T10:12:13.623303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:39:52.486187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'27","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.487188+0000","last_change":"2024-05-14T09:40:45.744802+0000","last_active":"2024-05-14T10:12:13.487188+0000","last_peered":"2024-05-14T10:12:13.487188+0000","last_clean":"2024-05-14T10:12:13.487188+0000","last_became_active":"2024-05-14T09:40:45.744011+0000","last_became_peered":"2024-05-14T09:40:45.744011+0000","last_unstale":"2024-05-14T10:12:13.487188+0000","last_undegraded":"2024-05-14T10:12:13.487188+0000","last_fullsized":"2024-05-14T10:12:13.487188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:20.468216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'24","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.486825+0000","last_change":"2024-05-14T09:40:45.757983+0000","last_active":"2024-05-14T10:12:13.486825+0000","last_peered":"2024-05-14T10:12:13.486825+0000","last_clean":"2024-05-14T10:12:13.486825+0000","last_became_active":"2024-05-14T09:40:45.757450+0000","last_became_peered":"2024-05-14T09:40:45.757450+0000","last_unstale":"2024-05-14T10:12:13.486825+0000","last_undegraded":"2024-05-14T10:12:13.486825+0000","last_fullsized":"2024-05-14T10:12:13.486825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:07.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'33","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.565326+0000","last_change":"2024-05-14T09:40:45.745021+0000","last_active":"2024-05-14T10:12:13.565326+0000","last_peered":"2024-05-14T10:12:13.565326+0000","last_clean":"2024-05-14T10:12:13.565326+0000","last_became_active":"2024-05-14T09:40:45.744550+0000","last_became_peered":"2024-05-14T09:40:45.744550+0000","last_unstale":"2024-05-14T10:12:13.565326+0000","last_undegraded":"2024-05-14T10:12:13.565326+0000","last_fullsized":"2024-05-14T10:12:13.565326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'17","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.644582+0000","last_change":"2024-05-14T09:40:45.749109+0000","last_active":"2024-05-14T10:12:13.644582+0000","last_peered":"2024-05-14T10:12:13.644582+0000","last_clean":"2024-05-14T10:12:13.644582+0000","last_became_active":"2024-05-14T09:40:45.748419+0000","last_became_peered":"2024-05-14T09:40:45.748419+0000","last_unstale":"2024-05-14T10:12:13.644582+0000","last_undegraded":"2024-05-14T10:12:13.644582+0000","last_fullsized":"2024-05-14T10:12:13.644582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'23","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.846466+0000","last_change":"2024-05-14T09:40:45.753508+0000","last_active":"2024-05-14T10:12:13.846466+0000","last_peered":"2024-05-14T10:12:13.846466+0000","last_clean":"2024-05-14T10:12:13.846466+0000","last_became_active":"2024-05-14T09:40:45.752982+0000","last_became_peered":"2024-05-14T09:40:45.752982+0000","last_unstale":"2024-05-14T10:12:13.846466+0000","last_undegraded":"2024-05-14T10:12:13.846466+0000","last_fullsized":"2024-05-14T10:12:13.846466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"33'32","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.861693+0000","last_change":"2024-05-14T09:40:45.759266+0000","last_active":"2024-05-14T10:12:13.861693+0000","last_peered":"2024-05-14T10:12:13.861693+0000","last_clean":"2024-05-14T10:12:13.861693+0000","last_became_active":"2024-05-14T09:40:45.758912+0000","last_became_peered":"2024-05-14T09:40:45.758912+0000","last_unstale":"2024-05-14T10:12:13.861693+0000","last_undegraded":"2024-05-14T10:12:13.861693+0000","last_fullsized":"2024-05-14T10:12:13.861693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'28","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655653+0000","last_change":"2024-05-14T09:40:45.780527+0000","last_active":"2024-05-14T10:12:13.655653+0000","last_peered":"2024-05-14T10:12:13.655653+0000","last_clean":"2024-05-14T10:12:13.655653+0000","last_became_active":"2024-05-14T09:40:45.780197+0000","last_became_peered":"2024-05-14T09:40:45.780197+0000","last_unstale":"2024-05-14T10:12:13.655653+0000","last_undegraded":"2024-05-14T10:12:13.655653+0000","last_fullsized":"2024-05-14T10:12:13.655653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:38.220230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'19","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.562504+0000","last_change":"2024-05-14T09:40:45.761049+0000","last_active":"2024-05-14T10:12:13.562504+0000","last_peered":"2024-05-14T10:12:13.562504+0000","last_clean":"2024-05-14T10:12:13.562504+0000","last_became_active":"2024-05-14T09:40:45.760738+0000","last_became_peered":"2024-05-14T09:40:45.760738+0000","last_unstale":"2024-05-14T10:12:13.562504+0000","last_undegraded":"2024-05-14T10:12:13.562504+0000","last_fullsized":"2024-05-14T10:12:13.562504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'17","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.645430+0000","last_change":"2024-05-14T09:40:45.776380+0000","last_active":"2024-05-14T10:12:13.645430+0000","last_peered":"2024-05-14T10:12:13.645430+0000","last_clean":"2024-05-14T10:12:13.645430+0000","last_became_active":"2024-05-14T09:40:45.776005+0000","last_became_peered":"2024-05-14T09:40:45.776005+0000","last_unstale":"2024-05-14T10:12:13.645430+0000","last_undegraded":"2024-05-14T10:12:13.645430+0000","last_fullsized":"2024-05-14T10:12:13.645430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:27.969792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'24","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623089+0000","last_change":"2024-05-14T09:41:04.214552+0000","last_active":"2024-05-14T10:12:13.623089+0000","last_peered":"2024-05-14T10:12:13.623089+0000","last_clean":"2024-05-14T10:12:13.623089+0000","last_became_active":"2024-05-14T09:41:04.213721+0000","last_became_peered":"2024-05-14T09:41:04.213721+0000","last_unstale":"2024-05-14T10:12:13.623089+0000","last_undegraded":"2024-05-14T10:12:13.623089+0000","last_fullsized":"2024-05-14T10:12:13.623089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"33'23","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.650378+0000","last_change":"2024-05-14T09:40:45.776955+0000","last_active":"2024-05-14T10:12:13.650378+0000","last_peered":"2024-05-14T10:12:13.650378+0000","last_clean":"2024-05-14T10:12:13.650378+0000","last_became_active":"2024-05-14T09:40:45.775953+0000","last_became_peered":"2024-05-14T09:40:45.775953+0000","last_unstale":"2024-05-14T10:12:13.650378+0000","last_undegraded":"2024-05-14T10:12:13.650378+0000","last_fullsized":"2024-05-14T10:12:13.650378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:13.534273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.626341+0000","last_change":"2024-05-14T09:40:45.750766+0000","last_active":"2024-05-14T10:12:13.626341+0000","last_peered":"2024-05-14T10:12:13.626341+0000","last_clean":"2024-05-14T10:12:13.626341+0000","last_became_active":"2024-05-14T09:40:45.750416+0000","last_became_peered":"2024-05-14T09:40:45.750416+0000","last_unstale":"2024-05-14T10:12:13.626341+0000","last_undegraded":"2024-05-14T10:12:13.626341+0000","last_fullsized":"2024-05-14T10:12:13.626341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:29:30.022171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"33'25","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.486470+0000","last_change":"2024-05-14T09:40:45.748573+0000","last_active":"2024-05-14T10:12:13.486470+0000","last_peered":"2024-05-14T10:12:13.486470+0000","last_clean":"2024-05-14T10:12:13.486470+0000","last_became_active":"2024-05-14T09:40:45.746640+0000","last_became_peered":"2024-05-14T09:40:45.746640+0000","last_unstale":"2024-05-14T10:12:13.486470+0000","last_undegraded":"2024-05-14T10:12:13.486470+0000","last_fullsized":"2024-05-14T10:12:13.486470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"33'19","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.446564+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T10:12:13.446564+0000","last_peered":"2024-05-14T10:12:13.446564+0000","last_clean":"2024-05-14T10:12:13.446564+0000","last_became_active":"2024-05-14T09:40:45.752589+0000","last_became_peered":"2024-05-14T09:40:45.752589+0000","last_unstale":"2024-05-14T10:12:13.446564+0000","last_undegraded":"2024-05-14T10:12:13.446564+0000","last_fullsized":"2024-05-14T10:12:13.446564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:43.043120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.652852+0000","last_change":"2024-05-14T09:40:45.771577+0000","last_active":"2024-05-14T10:12:13.652852+0000","last_peered":"2024-05-14T10:12:13.652852+0000","last_clean":"2024-05-14T10:12:13.652852+0000","last_became_active":"2024-05-14T09:40:45.771228+0000","last_became_peered":"2024-05-14T09:40:45.771228+0000","last_unstale":"2024-05-14T10:12:13.652852+0000","last_undegraded":"2024-05-14T10:12:13.652852+0000","last_fullsized":"2024-05-14T10:12:13.652852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:36.361964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2167,"num_write_kb":250271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2329,"ondisk_log_size":2329,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1480,"ondisk_log_size":1480,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21977357,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":432,"num_read_kb":466,"num_write":6515,"num_write_kb":24638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44105728,"data_stored":43954714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4957,"ondisk_log_size":4957,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719477125,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39728,"kb_used_data":8552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332112,"statfs":{"total":96636764160,"available":96596082688,"internally_reserved":0,"allocated":8757248,"data_stored":8538561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719477127,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52208,"kb_used_data":8552,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319632,"statfs":{"total":96636764160,"available":96583303168,"internally_reserved":0,"allocated":8757248,"data_stored":8537925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":16,"seq":68719477127,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40712,"kb_used_data":9536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331128,"statfs":{"total":96636764160,"available":96595075072,"internally_reserved":0,"allocated":9764864,"data_stored":9539012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719477124,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":267048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477124,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45396,"kb_used_data":5900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326444,"statfs":{"total":96636764160,"available":96590278656,"internally_reserved":0,"allocated":6041600,"data_stored":5817281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509829,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40248,"kb_used_data":13232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331592,"statfs":{"total":96636764160,"available":96595550208,"internally_reserved":0,"allocated":13549568,"data_stored":13323781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542530,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39860,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331980,"statfs":{"total":96636764160,"available":96595947520,"internally_reserved":0,"allocated":372736,"data_stored":149981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542532,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":149547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5095424,"data_stored":5078310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":118445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9412608,"data_stored":9391547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12603392,"data_stored":12584810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T10:12:21.584 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T10:12:21.584 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T10:12:21.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.894+0000 7ff07b600640 1 Processor -- start 2024-05-14T10:12:21.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.894+0000 7ff07b600640 1 -- start start 2024-05-14T10:12:21.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.896+0000 7ff07b600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074074810 0x7ff074164190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:21.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.897+0000 7ff07b600640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff074161830 con 0x7ff07415acb0 2024-05-14T10:12:21.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.897+0000 7ff07b600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0741609d0 con 0x7ff0741646d0 2024-05-14T10:12:21.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.897+0000 7ff07b600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff074160cb0 con 0x7ff074074810 2024-05-14T10:12:21.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.898+0000 7ff078c00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7ff07415acb0 0x7ff0740c9370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:41810/0 (socket says 172.21.15.135:41810) 2024-05-14T10:12:21.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.898+0000 7ff078c00640 1 -- 172.21.15.135:0/336814559 learned_addr learned my addr 172.21.15.135:0/336814559 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:21.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.899+0000 7ff073e00640 1 --2- 172.21.15.135:0/336814559 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074074810 0x7ff074164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:21.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.901+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556513895 0 0) 0x7ff074161830 con 0x7ff07415acb0 2024-05-14T10:12:21.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.901+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff05c003520 con 0x7ff07415acb0 2024-05-14T10:12:21.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2602356426 0 0) 0x7ff05c003520 con 0x7ff07415acb0 2024-05-14T10:12:21.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074074810 msgr2=0x7ff074164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:21.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 --2- 172.21.15.135:0/336814559 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074074810 0x7ff074164190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:21.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 >> v1:172.21.15.196:6789/0 conn(0x7ff0741646d0 legacy=0x7ff07416b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:21.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff074160f90 con 0x7ff07415acb0 2024-05-14T10:12:21.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7ff0680016f0 con 0x7ff07415acb0 2024-05-14T10:12:21.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 >> v1:172.21.15.135:6789/0 conn(0x7ff07415acb0 legacy=0x7ff0740c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:21.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 --2- 172.21.15.135:0/336814559 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074074810 0x7ff05c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:21.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 --2- 172.21.15.135:0/336814559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c003fe0 0x7ff05c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:21.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 --2- 172.21.15.135:0/336814559 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff05c004d40 0x7ff05c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:21.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff074160cb0 con 0x7ff05c003fe0 2024-05-14T10:12:21.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c00bbd0 con 0x7ff05c004d40 2024-05-14T10:12:21.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.905+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff05c00bdd0 con 0x7ff074074810 2024-05-14T10:12:21.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.909+0000 7ff073e00640 1 --2- 172.21.15.135:0/336814559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c003fe0 0x7ff05c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:21.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.912+0000 7ff079600640 1 --2- 172.21.15.135:0/336814559 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff05c004d40 0x7ff05c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.914+0000 7ff073e00640 1 -- 172.21.15.135:0/336814559 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074074810 msgr2=0x7ff05c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.914+0000 7ff073e00640 1 --2- 172.21.15.135:0/336814559 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074074810 0x7ff05c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.914+0000 7ff073e00640 1 -- 172.21.15.135:0/336814559 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff05c004d40 msgr2=0x7ff05c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.914+0000 7ff073e00640 1 --2- 172.21.15.135:0/336814559 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff05c004d40 0x7ff05c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.914+0000 7ff073e00640 1 -- 172.21.15.135:0/336814559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c003520 con 0x7ff05c003fe0 2024-05-14T10:12:21.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.917+0000 7ff073e00640 1 --2- 172.21.15.135:0/336814559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c003fe0 0x7ff05c004800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff064009ac0 tx=0x7ff05c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06b0899a45ac134 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:21.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.922+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064036070 con 0x7ff05c003fe0 2024-05-14T10:12:21.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.922+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff064031400 con 0x7ff05c003fe0 2024-05-14T10:12:21.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.922+0000 7ff073400640 1 -- 172.21.15.135:0/336814559 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064009690 con 0x7ff05c003fe0 2024-05-14T10:12:21.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.923+0000 7ff07b600640 1 -- 172.21.15.135:0/336814559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c003fe0 msgr2=0x7ff05c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:21.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.923+0000 7ff07b600640 1 --2- 172.21.15.135:0/336814559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff05c003fe0 0x7ff05c004800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff064009ac0 tx=0x7ff05c005830 comp rx=0 tx=0).stop 2024-05-14T10:12:21.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.924+0000 7ff079600640 1 -- 172.21.15.135:0/336814559 reap_dead start 2024-05-14T10:12:21.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.924+0000 7ff07b600640 1 -- 172.21.15.135:0/336814559 shutdown_connections 2024-05-14T10:12:21.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.924+0000 7ff07b600640 1 -- 172.21.15.135:0/336814559 >> 172.21.15.135:0/336814559 conn(0x7ff074073cf0 msgr2=0x7ff074074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:21.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.924+0000 7ff07b600640 1 -- 172.21.15.135:0/336814559 shutdown_connections 2024-05-14T10:12:21.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.924+0000 7ff07b600640 1 -- 172.21.15.135:0/336814559 wait complete. 2024-05-14T10:12:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.926+0000 7ff07b600640 1 Processor -- start 2024-05-14T10:12:21.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.927+0000 7ff07b600640 1 -- start start 2024-05-14T10:12:21.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.928+0000 7ff07b600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0740cc140 0x7ff0740c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:21.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.928+0000 7ff07b600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff07414eb10 0x7ff0741526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:21.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.928+0000 7ff07b600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074152be0 0x7ff074151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:21.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.928+0000 7ff07b600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff0740c69b0 con 0x7ff0740cc140 2024-05-14T10:12:21.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.928+0000 7ff07b600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff074161550 con 0x7ff07414eb10 2024-05-14T10:12:21.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.928+0000 7ff07b600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff074164ae0 con 0x7ff074152be0 2024-05-14T10:12:21.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.929+0000 7ff078c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0740cc140 0x7ff0740c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:21.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.929+0000 7ff078c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0740cc140 0x7ff0740c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44756/0 (socket says 172.21.15.135:44756) 2024-05-14T10:12:21.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.929+0000 7ff078c00640 1 -- 172.21.15.135:0/1278067213 learned_addr learned my addr 172.21.15.135:0/1278067213 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.930+0000 7ff073e00640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff07414eb10 0x7ff0741526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.930+0000 7ff079600640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074152be0 0x7ff074151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.934+0000 7ff078c00640 1 -- 172.21.15.135:0/1278067213 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074152be0 msgr2=0x7ff074151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.934+0000 7ff078c00640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074152be0 0x7ff074151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.934+0000 7ff078c00640 1 -- 172.21.15.135:0/1278067213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff07414eb10 msgr2=0x7ff0741526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.934+0000 7ff078c00640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff07414eb10 0x7ff0741526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.934+0000 7ff078c00640 1 -- 172.21.15.135:0/1278067213 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff074152ff0 con 0x7ff0740cc140 2024-05-14T10:12:21.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.936+0000 7ff078c00640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0740cc140 0x7ff0740c7790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff06800cad0 tx=0x7ff06800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:21.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.940+0000 7ff070c00640 1 -- 172.21.15.135:0/1278067213 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068004cb0 con 0x7ff0740cc140 2024-05-14T10:12:21.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.941+0000 7ff070c00640 1 -- 172.21.15.135:0/1278067213 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff068007110 con 0x7ff0740cc140 2024-05-14T10:12:21.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.941+0000 7ff070c00640 1 -- 172.21.15.135:0/1278067213 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068007500 con 0x7ff0740cc140 2024-05-14T10:12:21.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.941+0000 7ff07b600640 1 -- 172.21.15.135:0/1278067213 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0741fa690 con 0x7ff0740cc140 2024-05-14T10:12:21.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.941+0000 7ff07b600640 1 -- 172.21.15.135:0/1278067213 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff074150720 con 0x7ff0740cc140 2024-05-14T10:12:21.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.942+0000 7ff07b600640 1 -- 172.21.15.135:0/1278067213 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff074069a90 con 0x7ff0740cc140 2024-05-14T10:12:21.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.969+0000 7ff070c00640 1 -- 172.21.15.135:0/1278067213 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff068011070 con 0x7ff0740cc140 2024-05-14T10:12:21.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.971+0000 7ff070c00640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff058076320 0x7ff058078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:21.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.972+0000 7ff070c00640 1 -- 172.21.15.135:0/1278067213 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7ff06805ce60 con 0x7ff0740cc140 2024-05-14T10:12:21.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.972+0000 7ff073e00640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff058076320 0x7ff058078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:21.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:21.973+0000 7ff073e00640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff058076320 0x7ff058078830 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff064033000 tx=0x7ff064008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:22.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.289+0000 7ff070c00640 1 -- 172.21.15.135:0/1278067213 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff068060bd0 con 0x7ff0740cc140 2024-05-14T10:12:22.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.498+0000 7ff07b600640 1 -- 172.21.15.135:0/1278067213 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff0741fa430 con 0x7ff058076320 2024-05-14T10:12:22.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.509+0000 7ff070c00640 1 -- 172.21.15.135:0/1278067213 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333447 (secure 0 0 0) 0x7ff0640040c0 con 0x7ff058076320 2024-05-14T10:12:22.514 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T10:12:22.516 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-14T10:12:22.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 -- 172.21.15.135:0/1278067213 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff058076320 msgr2=0x7ff058078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:22.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff058076320 0x7ff058078830 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff064033000 tx=0x7ff064008030 comp rx=0 tx=0).stop 2024-05-14T10:12:22.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 -- 172.21.15.135:0/1278067213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0740cc140 msgr2=0x7ff0740c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:22.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0740cc140 0x7ff0740c7790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff06800cad0 tx=0x7ff06800cf90 comp rx=0 tx=0).stop 2024-05-14T10:12:22.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 -- 172.21.15.135:0/1278067213 shutdown_connections 2024-05-14T10:12:22.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff058076320 0x7ff058078830 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:22.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff07414eb10 0x7ff0741526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:22.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff074152be0 0x7ff074151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:22.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 --2- 172.21.15.135:0/1278067213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0740cc140 0x7ff0740c7790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:22.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 -- 172.21.15.135:0/1278067213 >> 172.21.15.135:0/1278067213 conn(0x7ff074073cf0 msgr2=0x7ff0740714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:22.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 -- 172.21.15.135:0/1278067213 shutdown_connections 2024-05-14T10:12:22.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.515+0000 7ff07b600640 1 -- 172.21.15.135:0/1278067213 wait complete. 2024-05-14T10:12:22.542 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":992,"stamp":"2024-05-14T10:12:21.377359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22567725,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":498,"num_read_kb":521,"num_write":8783,"num_write_kb":276537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8838,"ondisk_log_size":8838,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329672,"kb_used_data":46984,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754645048,"statfs":{"total":773094113280,"available":772756529152,"internally_reserved":0,"allocated":48111616,"data_stored":46323136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":289394226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40276,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":38,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005927"},"pg_stats":[{"pgid":"2.1f","version":"33'574","reported_seq":624,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:00.807469+0000","last_change":"2024-05-14T09:40:43.106486+0000","last_active":"2024-05-14T10:12:00.807469+0000","last_peered":"2024-05-14T10:12:00.807469+0000","last_clean":"2024-05-14T10:12:00.807469+0000","last_became_active":"2024-05-14T09:40:43.105731+0000","last_became_peered":"2024-05-14T09:40:43.105731+0000","last_unstale":"2024-05-14T10:12:00.807469+0000","last_undegraded":"2024-05-14T10:12:00.807469+0000","last_fullsized":"2024-05-14T10:12:00.807469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:32:09.735265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573,"num_write_kb":4404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'15","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.501309+0000","last_change":"2024-05-14T09:40:45.750103+0000","last_active":"2024-05-14T10:12:13.501309+0000","last_peered":"2024-05-14T10:12:13.501309+0000","last_clean":"2024-05-14T10:12:13.501309+0000","last_became_active":"2024-05-14T09:40:45.747865+0000","last_became_peered":"2024-05-14T09:40:45.747865+0000","last_unstale":"2024-05-14T10:12:13.501309+0000","last_undegraded":"2024-05-14T10:12:13.501309+0000","last_fullsized":"2024-05-14T10:12:13.501309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:06.549076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'61","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:53.409756+0000","last_change":"2024-05-14T09:40:53.664918+0000","last_active":"2024-05-14T10:10:53.409756+0000","last_peered":"2024-05-14T10:10:53.409756+0000","last_clean":"2024-05-14T10:10:53.409756+0000","last_became_active":"2024-05-14T09:40:53.664366+0000","last_became_peered":"2024-05-14T09:40:53.664366+0000","last_unstale":"2024-05-14T10:10:53.409756+0000","last_undegraded":"2024-05-14T10:10:53.409756+0000","last_fullsized":"2024-05-14T10:10:53.409756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:20:52.204134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'88","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.980596+0000","last_change":"2024-05-14T09:40:43.101185+0000","last_active":"2024-05-14T10:12:13.980596+0000","last_peered":"2024-05-14T10:12:13.980596+0000","last_clean":"2024-05-14T10:12:13.980596+0000","last_became_active":"2024-05-14T09:40:43.098862+0000","last_became_peered":"2024-05-14T09:40:43.098862+0000","last_unstale":"2024-05-14T10:12:13.980596+0000","last_undegraded":"2024-05-14T10:12:13.980596+0000","last_fullsized":"2024-05-14T10:12:13.980596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883346,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.488230+0000","last_change":"2024-05-14T09:40:45.752960+0000","last_active":"2024-05-14T10:12:13.488230+0000","last_peered":"2024-05-14T10:12:13.488230+0000","last_clean":"2024-05-14T10:12:13.488230+0000","last_became_active":"2024-05-14T09:40:45.752627+0000","last_became_peered":"2024-05-14T09:40:45.752627+0000","last_unstale":"2024-05-14T10:12:13.488230+0000","last_undegraded":"2024-05-14T10:12:13.488230+0000","last_fullsized":"2024-05-14T10:12:13.488230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'57","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.348476+0000","last_change":"2024-05-14T09:40:53.662032+0000","last_active":"2024-05-14T10:11:03.348476+0000","last_peered":"2024-05-14T10:11:03.348476+0000","last_clean":"2024-05-14T10:11:03.348476+0000","last_became_active":"2024-05-14T09:40:53.661453+0000","last_became_peered":"2024-05-14T09:40:53.661453+0000","last_unstale":"2024-05-14T10:11:03.348476+0000","last_undegraded":"2024-05-14T10:11:03.348476+0000","last_fullsized":"2024-05-14T10:11:03.348476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:11.724866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'10","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.867388+0000","last_change":"2024-05-14T09:40:43.114965+0000","last_active":"2024-05-14T10:11:57.867388+0000","last_peered":"2024-05-14T10:11:57.867388+0000","last_clean":"2024-05-14T10:11:57.867388+0000","last_became_active":"2024-05-14T09:40:43.114379+0000","last_became_peered":"2024-05-14T09:40:43.114379+0000","last_unstale":"2024-05-14T10:11:57.867388+0000","last_undegraded":"2024-05-14T10:11:57.867388+0000","last_fullsized":"2024-05-14T10:11:57.867388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:43.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'21","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630273+0000","last_change":"2024-05-14T09:40:45.758305+0000","last_active":"2024-05-14T10:12:13.630273+0000","last_peered":"2024-05-14T10:12:13.630273+0000","last_clean":"2024-05-14T10:12:13.630273+0000","last_became_active":"2024-05-14T09:40:45.754110+0000","last_became_peered":"2024-05-14T09:40:45.754110+0000","last_unstale":"2024-05-14T10:12:13.630273+0000","last_undegraded":"2024-05-14T10:12:13.630273+0000","last_fullsized":"2024-05-14T10:12:13.630273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:12:42.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'83","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:01.093757+0000","last_change":"2024-05-14T09:41:04.601574+0000","last_active":"2024-05-14T10:11:01.093757+0000","last_peered":"2024-05-14T10:11:01.093757+0000","last_clean":"2024-05-14T10:11:01.093757+0000","last_became_active":"2024-05-14T09:41:04.599475+0000","last_became_peered":"2024-05-14T09:41:04.599475+0000","last_unstale":"2024-05-14T10:11:01.093757+0000","last_undegraded":"2024-05-14T10:11:01.093757+0000","last_fullsized":"2024-05-14T10:11:01.093757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"33'3","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:44.766090+0000","last_change":"2024-05-14T09:40:43.110296+0000","last_active":"2024-05-14T10:10:44.766090+0000","last_peered":"2024-05-14T10:10:44.766090+0000","last_clean":"2024-05-14T10:10:44.766090+0000","last_became_active":"2024-05-14T09:40:43.109932+0000","last_became_peered":"2024-05-14T09:40:43.109932+0000","last_unstale":"2024-05-14T10:10:44.766090+0000","last_undegraded":"2024-05-14T10:10:44.766090+0000","last_fullsized":"2024-05-14T10:10:44.766090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:29.003048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630118+0000","last_change":"2024-05-14T09:40:45.773110+0000","last_active":"2024-05-14T10:12:13.630118+0000","last_peered":"2024-05-14T10:12:13.630118+0000","last_clean":"2024-05-14T10:12:13.630118+0000","last_became_active":"2024-05-14T09:40:45.770117+0000","last_became_peered":"2024-05-14T09:40:45.770117+0000","last_unstale":"2024-05-14T10:12:13.630118+0000","last_undegraded":"2024-05-14T10:12:13.630118+0000","last_fullsized":"2024-05-14T10:12:13.630118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:28.718450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'79","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.770815+0000","last_change":"2024-05-14T09:40:53.652049+0000","last_active":"2024-05-14T10:11:05.770815+0000","last_peered":"2024-05-14T10:11:05.770815+0000","last_clean":"2024-05-14T10:11:05.770815+0000","last_became_active":"2024-05-14T09:40:53.651570+0000","last_became_peered":"2024-05-14T09:40:53.651570+0000","last_unstale":"2024-05-14T10:11:05.770815+0000","last_undegraded":"2024-05-14T10:11:05.770815+0000","last_fullsized":"2024-05-14T10:11:05.770815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:30.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'20","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.846441+0000","last_change":"2024-05-14T09:40:45.753771+0000","last_active":"2024-05-14T10:12:13.846441+0000","last_peered":"2024-05-14T10:12:13.846441+0000","last_clean":"2024-05-14T10:12:13.846441+0000","last_became_active":"2024-05-14T09:40:45.753319+0000","last_became_peered":"2024-05-14T09:40:45.753319+0000","last_unstale":"2024-05-14T10:12:13.846441+0000","last_undegraded":"2024-05-14T10:12:13.846441+0000","last_fullsized":"2024-05-14T10:12:13.846441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'565","reported_seq":614,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.868105+0000","last_change":"2024-05-14T09:40:43.125708+0000","last_active":"2024-05-14T10:11:57.868105+0000","last_peered":"2024-05-14T10:11:57.868105+0000","last_clean":"2024-05-14T10:11:57.868105+0000","last_became_active":"2024-05-14T09:40:43.125239+0000","last_became_peered":"2024-05-14T09:40:43.125239+0000","last_unstale":"2024-05-14T10:11:57.868105+0000","last_undegraded":"2024-05-14T10:11:57.868105+0000","last_fullsized":"2024-05-14T10:11:57.868105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:22.781125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'67","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:04.491201+0000","last_change":"2024-05-14T09:40:53.663353+0000","last_active":"2024-05-14T10:11:04.491201+0000","last_peered":"2024-05-14T10:11:04.491201+0000","last_clean":"2024-05-14T10:11:04.491201+0000","last_became_active":"2024-05-14T09:40:53.662559+0000","last_became_peered":"2024-05-14T09:40:53.662559+0000","last_unstale":"2024-05-14T10:11:04.491201+0000","last_undegraded":"2024-05-14T10:11:04.491201+0000","last_fullsized":"2024-05-14T10:11:04.491201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:14.708431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'23","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.571812+0000","last_change":"2024-05-14T09:40:45.751929+0000","last_active":"2024-05-14T10:12:13.571812+0000","last_peered":"2024-05-14T10:12:13.571812+0000","last_clean":"2024-05-14T10:12:13.571812+0000","last_became_active":"2024-05-14T09:40:45.751015+0000","last_became_peered":"2024-05-14T09:40:45.751015+0000","last_unstale":"2024-05-14T10:12:13.571812+0000","last_undegraded":"2024-05-14T10:12:13.571812+0000","last_fullsized":"2024-05-14T10:12:13.571812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:12.550231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:45.882832+0000","last_change":"2024-05-14T09:40:43.023070+0000","last_active":"2024-05-14T10:11:45.882832+0000","last_peered":"2024-05-14T10:11:45.882832+0000","last_clean":"2024-05-14T10:11:45.882832+0000","last_became_active":"2024-05-14T09:40:43.022234+0000","last_became_peered":"2024-05-14T09:40:43.022234+0000","last_unstale":"2024-05-14T10:11:45.882832+0000","last_undegraded":"2024-05-14T10:11:45.882832+0000","last_fullsized":"2024-05-14T10:11:45.882832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:30:06.240409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'86","reported_seq":127,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.518588+0000","last_change":"2024-05-14T09:41:04.601663+0000","last_active":"2024-05-14T10:11:03.518588+0000","last_peered":"2024-05-14T10:11:03.518588+0000","last_clean":"2024-05-14T10:11:03.518588+0000","last_became_active":"2024-05-14T09:41:04.600186+0000","last_became_peered":"2024-05-14T09:41:04.600186+0000","last_unstale":"2024-05-14T10:11:03.518588+0000","last_undegraded":"2024-05-14T10:11:03.518588+0000","last_fullsized":"2024-05-14T10:11:03.518588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'22","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.531558+0000","last_change":"2024-05-14T09:40:45.746999+0000","last_active":"2024-05-14T10:12:13.531558+0000","last_peered":"2024-05-14T10:12:13.531558+0000","last_clean":"2024-05-14T10:12:13.531558+0000","last_became_active":"2024-05-14T09:40:45.746607+0000","last_became_peered":"2024-05-14T09:40:45.746607+0000","last_unstale":"2024-05-14T10:12:13.531558+0000","last_undegraded":"2024-05-14T10:12:13.531558+0000","last_fullsized":"2024-05-14T10:12:13.531558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:03.565510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'11","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.407861+0000","last_change":"2024-05-14T09:40:43.105149+0000","last_active":"2024-05-14T10:11:52.407861+0000","last_peered":"2024-05-14T10:11:52.407861+0000","last_clean":"2024-05-14T10:11:52.407861+0000","last_became_active":"2024-05-14T09:40:43.104277+0000","last_became_peered":"2024-05-14T09:40:43.104277+0000","last_unstale":"2024-05-14T10:11:52.407861+0000","last_undegraded":"2024-05-14T10:11:52.407861+0000","last_fullsized":"2024-05-14T10:11:52.407861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:05:48.598915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'61","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.199692+0000","last_change":"2024-05-14T09:40:53.649256+0000","last_active":"2024-05-14T10:11:00.199692+0000","last_peered":"2024-05-14T10:11:00.199692+0000","last_clean":"2024-05-14T10:11:00.199692+0000","last_became_active":"2024-05-14T09:40:53.648765+0000","last_became_peered":"2024-05-14T09:40:53.648765+0000","last_unstale":"2024-05-14T10:11:00.199692+0000","last_undegraded":"2024-05-14T10:11:00.199692+0000","last_fullsized":"2024-05-14T10:11:00.199692+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:25.060381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":11669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"33'17","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.458918+0000","last_change":"2024-05-14T09:40:45.730862+0000","last_active":"2024-05-14T10:11:06.458918+0000","last_peered":"2024-05-14T10:11:06.458918+0000","last_clean":"2024-05-14T10:11:06.458918+0000","last_became_active":"2024-05-14T09:40:45.730014+0000","last_became_peered":"2024-05-14T09:40:45.730014+0000","last_unstale":"2024-05-14T10:11:06.458918+0000","last_undegraded":"2024-05-14T10:11:06.458918+0000","last_fullsized":"2024-05-14T10:11:06.458918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:05.679719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.868371+0000","last_change":"2024-05-14T09:40:43.112127+0000","last_active":"2024-05-14T10:11:57.868371+0000","last_peered":"2024-05-14T10:11:57.868371+0000","last_clean":"2024-05-14T10:11:57.868371+0000","last_became_active":"2024-05-14T09:40:43.111574+0000","last_became_peered":"2024-05-14T09:40:43.111574+0000","last_unstale":"2024-05-14T10:11:57.868371+0000","last_undegraded":"2024-05-14T10:11:57.868371+0000","last_fullsized":"2024-05-14T10:11:57.868371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:13.668017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'68","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:58.171427+0000","last_change":"2024-05-14T09:40:53.666100+0000","last_active":"2024-05-14T10:10:58.171427+0000","last_peered":"2024-05-14T10:10:58.171427+0000","last_clean":"2024-05-14T10:10:58.171427+0000","last_became_active":"2024-05-14T09:40:53.665635+0000","last_became_peered":"2024-05-14T09:40:53.665635+0000","last_unstale":"2024-05-14T10:10:58.171427+0000","last_undegraded":"2024-05-14T10:10:58.171427+0000","last_fullsized":"2024-05-14T10:10:58.171427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:21.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":6362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"33'26","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.476914+0000","last_change":"2024-05-14T09:40:45.758554+0000","last_active":"2024-05-14T10:12:13.476914+0000","last_peered":"2024-05-14T10:12:13.476914+0000","last_clean":"2024-05-14T10:12:13.476914+0000","last_became_active":"2024-05-14T09:40:45.757938+0000","last_became_peered":"2024-05-14T09:40:45.757938+0000","last_unstale":"2024-05-14T10:12:13.476914+0000","last_undegraded":"2024-05-14T10:12:13.476914+0000","last_fullsized":"2024-05-14T10:12:13.476914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.946780+0000","last_change":"2024-05-14T09:40:43.116767+0000","last_active":"2024-05-14T10:12:02.946780+0000","last_peered":"2024-05-14T10:12:02.946780+0000","last_clean":"2024-05-14T10:12:02.946780+0000","last_became_active":"2024-05-14T09:40:43.116142+0000","last_became_peered":"2024-05-14T09:40:43.116142+0000","last_unstale":"2024-05-14T10:12:02.946780+0000","last_undegraded":"2024-05-14T10:12:02.946780+0000","last_fullsized":"2024-05-14T10:12:02.946780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'50","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:56.148905+0000","last_change":"2024-05-14T09:40:53.666811+0000","last_active":"2024-05-14T10:10:56.148905+0000","last_peered":"2024-05-14T10:10:56.148905+0000","last_clean":"2024-05-14T10:10:56.148905+0000","last_became_active":"2024-05-14T09:40:53.666455+0000","last_became_peered":"2024-05-14T09:40:53.666455+0000","last_unstale":"2024-05-14T10:10:56.148905+0000","last_undegraded":"2024-05-14T10:10:56.148905+0000","last_fullsized":"2024-05-14T10:10:56.148905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:33.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":7373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'19","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.561141+0000","last_change":"2024-05-14T09:40:45.768162+0000","last_active":"2024-05-14T10:12:13.561141+0000","last_peered":"2024-05-14T10:12:13.561141+0000","last_clean":"2024-05-14T10:12:13.561141+0000","last_became_active":"2024-05-14T09:40:45.767810+0000","last_became_peered":"2024-05-14T09:40:45.767810+0000","last_unstale":"2024-05-14T10:12:13.561141+0000","last_undegraded":"2024-05-14T10:12:13.561141+0000","last_fullsized":"2024-05-14T10:12:13.561141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:25.075246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'1178","reported_seq":1227,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:11.947139+0000","last_change":"2024-05-14T09:40:43.115650+0000","last_active":"2024-05-14T10:12:11.947139+0000","last_peered":"2024-05-14T10:12:11.947139+0000","last_clean":"2024-05-14T10:12:11.947139+0000","last_became_active":"2024-05-14T09:40:43.114902+0000","last_became_peered":"2024-05-14T09:40:43.114902+0000","last_unstale":"2024-05-14T10:12:11.947139+0000","last_undegraded":"2024-05-14T10:12:11.947139+0000","last_fullsized":"2024-05-14T10:12:11.947139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":1178,"log_dups_size":0,"ondisk_log_size":1178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:19.284998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2830,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'101","reported_seq":137,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:01.705830+0000","last_change":"2024-05-14T09:40:53.650297+0000","last_active":"2024-05-14T10:11:01.705830+0000","last_peered":"2024-05-14T10:11:01.705830+0000","last_clean":"2024-05-14T10:11:01.705830+0000","last_became_active":"2024-05-14T09:40:53.649263+0000","last_became_peered":"2024-05-14T09:40:53.649263+0000","last_unstale":"2024-05-14T10:11:01.705830+0000","last_undegraded":"2024-05-14T10:11:01.705830+0000","last_fullsized":"2024-05-14T10:11:01.705830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:22.637337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":14510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'21","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.483357+0000","last_change":"2024-05-14T09:40:45.733131+0000","last_active":"2024-05-14T10:12:13.483357+0000","last_peered":"2024-05-14T10:12:13.483357+0000","last_clean":"2024-05-14T10:12:13.483357+0000","last_became_active":"2024-05-14T09:40:45.732154+0000","last_became_peered":"2024-05-14T09:40:45.732154+0000","last_unstale":"2024-05-14T10:12:13.483357+0000","last_undegraded":"2024-05-14T10:12:13.483357+0000","last_fullsized":"2024-05-14T10:12:13.483357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:23:16.904648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:09.343002+0000","last_change":"2024-05-14T09:40:43.112841+0000","last_active":"2024-05-14T10:12:09.343002+0000","last_peered":"2024-05-14T10:12:09.343002+0000","last_clean":"2024-05-14T10:12:09.343002+0000","last_became_active":"2024-05-14T09:40:43.110703+0000","last_became_peered":"2024-05-14T09:40:43.110703+0000","last_unstale":"2024-05-14T10:12:09.343002+0000","last_undegraded":"2024-05-14T10:12:09.343002+0000","last_fullsized":"2024-05-14T10:12:09.343002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:01.271389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'52","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.551997+0000","last_change":"2024-05-14T09:40:53.657532+0000","last_active":"2024-05-14T10:11:05.551997+0000","last_peered":"2024-05-14T10:11:05.551997+0000","last_clean":"2024-05-14T10:11:05.551997+0000","last_became_active":"2024-05-14T09:40:53.657073+0000","last_became_peered":"2024-05-14T09:40:53.657073+0000","last_unstale":"2024-05-14T10:11:05.551997+0000","last_undegraded":"2024-05-14T10:11:05.551997+0000","last_fullsized":"2024-05-14T10:11:05.551997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:56.882153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623157+0000","last_change":"2024-05-14T09:40:45.752122+0000","last_active":"2024-05-14T10:12:13.623157+0000","last_peered":"2024-05-14T10:12:13.623157+0000","last_clean":"2024-05-14T10:12:13.623157+0000","last_became_active":"2024-05-14T09:40:45.751546+0000","last_became_peered":"2024-05-14T09:40:45.751546+0000","last_unstale":"2024-05-14T10:12:13.623157+0000","last_undegraded":"2024-05-14T10:12:13.623157+0000","last_fullsized":"2024-05-14T10:12:13.623157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:19:55.897772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"33'3","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.944302+0000","last_change":"2024-05-14T09:40:43.099478+0000","last_active":"2024-05-14T10:12:02.944302+0000","last_peered":"2024-05-14T10:12:02.944302+0000","last_clean":"2024-05-14T10:12:02.944302+0000","last_became_active":"2024-05-14T09:40:43.098776+0000","last_became_peered":"2024-05-14T09:40:43.098776+0000","last_unstale":"2024-05-14T10:12:02.944302+0000","last_undegraded":"2024-05-14T10:12:02.944302+0000","last_fullsized":"2024-05-14T10:12:02.944302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:35.647751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'75","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.518532+0000","last_change":"2024-05-14T09:40:53.650794+0000","last_active":"2024-05-14T10:11:05.518532+0000","last_peered":"2024-05-14T10:11:05.518532+0000","last_clean":"2024-05-14T10:11:05.518532+0000","last_became_active":"2024-05-14T09:40:53.650139+0000","last_became_peered":"2024-05-14T09:40:53.650139+0000","last_unstale":"2024-05-14T10:11:05.518532+0000","last_undegraded":"2024-05-14T10:11:05.518532+0000","last_fullsized":"2024-05-14T10:11:05.518532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:36.877806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.639330+0000","last_change":"2024-05-14T09:40:45.748430+0000","last_active":"2024-05-14T10:12:13.639330+0000","last_peered":"2024-05-14T10:12:13.639330+0000","last_clean":"2024-05-14T10:12:13.639330+0000","last_became_active":"2024-05-14T09:40:45.748048+0000","last_became_peered":"2024-05-14T09:40:45.748048+0000","last_unstale":"2024-05-14T10:12:13.639330+0000","last_undegraded":"2024-05-14T10:12:13.639330+0000","last_fullsized":"2024-05-14T10:12:13.639330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:29.240543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'5","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.424978+0000","last_change":"2024-05-14T09:40:43.088293+0000","last_active":"2024-05-14T10:11:52.424978+0000","last_peered":"2024-05-14T10:11:52.424978+0000","last_clean":"2024-05-14T10:11:52.424978+0000","last_became_active":"2024-05-14T09:40:43.087310+0000","last_became_peered":"2024-05-14T09:40:43.087310+0000","last_unstale":"2024-05-14T10:11:52.424978+0000","last_undegraded":"2024-05-14T10:11:52.424978+0000","last_fullsized":"2024-05-14T10:11:52.424978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:38.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'60","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:54.299669+0000","last_change":"2024-05-14T09:41:04.598844+0000","last_active":"2024-05-14T10:10:54.299669+0000","last_peered":"2024-05-14T10:10:54.299669+0000","last_clean":"2024-05-14T10:10:54.299669+0000","last_became_active":"2024-05-14T09:41:04.597473+0000","last_became_peered":"2024-05-14T09:41:04.597473+0000","last_unstale":"2024-05-14T10:10:54.299669+0000","last_undegraded":"2024-05-14T10:10:54.299669+0000","last_fullsized":"2024-05-14T10:10:54.299669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:48.257782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"33'26","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.469769+0000","last_change":"2024-05-14T09:40:45.740074+0000","last_active":"2024-05-14T10:12:13.469769+0000","last_peered":"2024-05-14T10:12:13.469769+0000","last_clean":"2024-05-14T10:12:13.469769+0000","last_became_active":"2024-05-14T09:40:45.739647+0000","last_became_peered":"2024-05-14T09:40:45.739647+0000","last_unstale":"2024-05-14T10:12:13.469769+0000","last_undegraded":"2024-05-14T10:12:13.469769+0000","last_fullsized":"2024-05-14T10:12:13.469769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:38.401151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'449","reported_seq":931,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630978+0000","last_change":"2024-05-14T09:40:43.043210+0000","last_active":"2024-05-14T10:12:13.630978+0000","last_peered":"2024-05-14T10:12:13.630978+0000","last_clean":"2024-05-14T10:12:13.630978+0000","last_became_active":"2024-05-14T09:40:43.042243+0000","last_became_peered":"2024-05-14T09:40:43.042243+0000","last_unstale":"2024-05-14T10:12:13.630978+0000","last_undegraded":"2024-05-14T10:12:13.630978+0000","last_fullsized":"2024-05-14T10:12:13.630978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:26.946422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117717,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":466,"num_write":444,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'62","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:56.110624+0000","last_change":"2024-05-14T09:40:53.652161+0000","last_active":"2024-05-14T10:10:56.110624+0000","last_peered":"2024-05-14T10:10:56.110624+0000","last_clean":"2024-05-14T10:10:56.110624+0000","last_became_active":"2024-05-14T09:40:53.649990+0000","last_became_peered":"2024-05-14T09:40:53.649990+0000","last_unstale":"2024-05-14T10:10:56.110624+0000","last_undegraded":"2024-05-14T10:10:56.110624+0000","last_fullsized":"2024-05-14T10:10:56.110624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:20:04.057127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"33'12","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.487657+0000","last_change":"2024-05-14T09:40:45.754250+0000","last_active":"2024-05-14T10:12:13.487657+0000","last_peered":"2024-05-14T10:12:13.487657+0000","last_clean":"2024-05-14T10:12:13.487657+0000","last_became_active":"2024-05-14T09:40:45.753850+0000","last_became_peered":"2024-05-14T09:40:45.753850+0000","last_unstale":"2024-05-14T10:12:13.487657+0000","last_undegraded":"2024-05-14T10:12:13.487657+0000","last_fullsized":"2024-05-14T10:12:13.487657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:15.962138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:27.863105+0000","last_change":"2024-05-14T09:40:43.111905+0000","last_active":"2024-05-14T10:11:27.863105+0000","last_peered":"2024-05-14T10:11:27.863105+0000","last_clean":"2024-05-14T10:11:27.863105+0000","last_became_active":"2024-05-14T09:40:43.108233+0000","last_became_peered":"2024-05-14T09:40:43.108233+0000","last_unstale":"2024-05-14T10:11:27.863105+0000","last_undegraded":"2024-05-14T10:11:27.863105+0000","last_fullsized":"2024-05-14T10:11:27.863105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'88","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.514041+0000","last_change":"2024-05-14T09:40:53.663789+0000","last_active":"2024-05-14T10:11:03.514041+0000","last_peered":"2024-05-14T10:11:03.514041+0000","last_clean":"2024-05-14T10:11:03.514041+0000","last_became_active":"2024-05-14T09:40:53.662980+0000","last_became_peered":"2024-05-14T09:40:53.662980+0000","last_unstale":"2024-05-14T10:11:03.514041+0000","last_undegraded":"2024-05-14T10:11:03.514041+0000","last_fullsized":"2024-05-14T10:11:03.514041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:46.379586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.521730+0000","last_change":"2024-05-14T09:40:45.754347+0000","last_active":"2024-05-14T10:12:13.521730+0000","last_peered":"2024-05-14T10:12:13.521730+0000","last_clean":"2024-05-14T10:12:13.521730+0000","last_became_active":"2024-05-14T09:40:45.753869+0000","last_became_peered":"2024-05-14T09:40:45.753869+0000","last_unstale":"2024-05-14T10:12:13.521730+0000","last_undegraded":"2024-05-14T10:12:13.521730+0000","last_fullsized":"2024-05-14T10:12:13.521730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'8","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:45.883971+0000","last_change":"2024-05-14T09:40:43.087481+0000","last_active":"2024-05-14T10:11:45.883971+0000","last_peered":"2024-05-14T10:11:45.883971+0000","last_clean":"2024-05-14T10:11:45.883971+0000","last_became_active":"2024-05-14T09:40:43.086487+0000","last_became_peered":"2024-05-14T09:40:43.086487+0000","last_unstale":"2024-05-14T10:11:45.883971+0000","last_undegraded":"2024-05-14T10:11:45.883971+0000","last_fullsized":"2024-05-14T10:11:45.883971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:54.225063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":148,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:08:20.122885+0000","last_change":"2024-05-14T09:40:22.705545+0000","last_active":"2024-05-14T10:08:20.122885+0000","last_peered":"2024-05-14T10:08:20.122885+0000","last_clean":"2024-05-14T10:08:20.122885+0000","last_became_active":"2024-05-14T09:40:22.701797+0000","last_became_peered":"2024-05-14T09:40:22.701797+0000","last_unstale":"2024-05-14T10:08:20.122885+0000","last_undegraded":"2024-05-14T10:08:20.122885+0000","last_fullsized":"2024-05-14T10:08:20.122885+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_clean_scrub_stamp":"2024-05-14T09:40:17.767400+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:48:21.700172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'61","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:49.080123+0000","last_change":"2024-05-14T09:40:53.681915+0000","last_active":"2024-05-14T10:10:49.080123+0000","last_peered":"2024-05-14T10:10:49.080123+0000","last_clean":"2024-05-14T10:10:49.080123+0000","last_became_active":"2024-05-14T09:40:53.681296+0000","last_became_peered":"2024-05-14T09:40:53.681296+0000","last_unstale":"2024-05-14T10:10:49.080123+0000","last_undegraded":"2024-05-14T10:10:49.080123+0000","last_fullsized":"2024-05-14T10:10:49.080123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:21.455981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'23","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.633400+0000","last_change":"2024-05-14T09:41:04.213355+0000","last_active":"2024-05-14T10:12:13.633400+0000","last_peered":"2024-05-14T10:12:13.633400+0000","last_clean":"2024-05-14T10:12:13.633400+0000","last_became_active":"2024-05-14T09:41:04.212709+0000","last_became_peered":"2024-05-14T09:41:04.212709+0000","last_unstale":"2024-05-14T10:12:13.633400+0000","last_undegraded":"2024-05-14T10:12:13.633400+0000","last_fullsized":"2024-05-14T10:12:13.633400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"33'5","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.892390+0000","last_change":"2024-05-14T09:40:43.090401+0000","last_active":"2024-05-14T10:12:02.892390+0000","last_peered":"2024-05-14T10:12:02.892390+0000","last_clean":"2024-05-14T10:12:02.892390+0000","last_became_active":"2024-05-14T09:40:43.089548+0000","last_became_peered":"2024-05-14T09:40:43.089548+0000","last_unstale":"2024-05-14T10:12:02.892390+0000","last_undegraded":"2024-05-14T10:12:02.892390+0000","last_fullsized":"2024-05-14T10:12:02.892390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:03.385598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'79","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:07.506476+0000","last_change":"2024-05-14T09:40:53.677072+0000","last_active":"2024-05-14T10:11:07.506476+0000","last_peered":"2024-05-14T10:11:07.506476+0000","last_clean":"2024-05-14T10:11:07.506476+0000","last_became_active":"2024-05-14T09:40:53.676636+0000","last_became_peered":"2024-05-14T09:40:53.676636+0000","last_unstale":"2024-05-14T10:11:07.506476+0000","last_undegraded":"2024-05-14T10:11:07.506476+0000","last_fullsized":"2024-05-14T10:11:07.506476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":7859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'21","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623051+0000","last_change":"2024-05-14T09:40:45.750962+0000","last_active":"2024-05-14T10:12:13.623051+0000","last_peered":"2024-05-14T10:12:13.623051+0000","last_clean":"2024-05-14T10:12:13.623051+0000","last_became_active":"2024-05-14T09:40:45.750539+0000","last_became_peered":"2024-05-14T09:40:45.750539+0000","last_unstale":"2024-05-14T10:12:13.623051+0000","last_undegraded":"2024-05-14T10:12:13.623051+0000","last_fullsized":"2024-05-14T10:12:13.623051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:42.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:39.462630+0000","last_change":"2024-05-14T09:40:43.122483+0000","last_active":"2024-05-14T10:11:39.462630+0000","last_peered":"2024-05-14T10:11:39.462630+0000","last_clean":"2024-05-14T10:11:39.462630+0000","last_became_active":"2024-05-14T09:40:43.121427+0000","last_became_peered":"2024-05-14T09:40:43.121427+0000","last_unstale":"2024-05-14T10:11:39.462630+0000","last_undegraded":"2024-05-14T10:11:39.462630+0000","last_fullsized":"2024-05-14T10:11:39.462630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:24:31.384470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'90","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:58.172126+0000","last_change":"2024-05-14T09:40:53.656157+0000","last_active":"2024-05-14T10:10:58.172126+0000","last_peered":"2024-05-14T10:10:58.172126+0000","last_clean":"2024-05-14T10:10:58.172126+0000","last_became_active":"2024-05-14T09:40:53.655141+0000","last_became_peered":"2024-05-14T09:40:53.655141+0000","last_unstale":"2024-05-14T10:10:58.172126+0000","last_undegraded":"2024-05-14T10:10:58.172126+0000","last_fullsized":"2024-05-14T10:10:58.172126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'24","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655700+0000","last_change":"2024-05-14T09:40:45.778555+0000","last_active":"2024-05-14T10:12:13.655700+0000","last_peered":"2024-05-14T10:12:13.655700+0000","last_clean":"2024-05-14T10:12:13.655700+0000","last_became_active":"2024-05-14T09:40:45.776967+0000","last_became_peered":"2024-05-14T09:40:45.776967+0000","last_unstale":"2024-05-14T10:12:13.655700+0000","last_undegraded":"2024-05-14T10:12:13.655700+0000","last_fullsized":"2024-05-14T10:12:13.655700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:45:35.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"33'3","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:10.445726+0000","last_change":"2024-05-14T09:40:43.043359+0000","last_active":"2024-05-14T10:12:10.445726+0000","last_peered":"2024-05-14T10:12:10.445726+0000","last_clean":"2024-05-14T10:12:10.445726+0000","last_became_active":"2024-05-14T09:40:43.042486+0000","last_became_peered":"2024-05-14T09:40:43.042486+0000","last_unstale":"2024-05-14T10:12:10.445726+0000","last_undegraded":"2024-05-14T10:12:10.445726+0000","last_fullsized":"2024-05-14T10:12:10.445726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:15.480365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'69","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.556561+0000","last_change":"2024-05-14T09:40:53.662719+0000","last_active":"2024-05-14T10:11:05.556561+0000","last_peered":"2024-05-14T10:11:05.556561+0000","last_clean":"2024-05-14T10:11:05.556561+0000","last_became_active":"2024-05-14T09:40:53.660933+0000","last_became_peered":"2024-05-14T09:40:53.660933+0000","last_unstale":"2024-05-14T10:11:05.556561+0000","last_undegraded":"2024-05-14T10:11:05.556561+0000","last_fullsized":"2024-05-14T10:11:05.556561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:02.584358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'15","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655467+0000","last_change":"2024-05-14T09:40:45.776336+0000","last_active":"2024-05-14T10:12:13.655467+0000","last_peered":"2024-05-14T10:12:13.655467+0000","last_clean":"2024-05-14T10:12:13.655467+0000","last_became_active":"2024-05-14T09:40:45.775936+0000","last_became_peered":"2024-05-14T09:40:45.775936+0000","last_unstale":"2024-05-14T10:12:13.655467+0000","last_undegraded":"2024-05-14T10:12:13.655467+0000","last_fullsized":"2024-05-14T10:12:13.655467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:59.300900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'7","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:04.105943+0000","last_change":"2024-05-14T09:40:43.124714+0000","last_active":"2024-05-14T10:12:04.105943+0000","last_peered":"2024-05-14T10:12:04.105943+0000","last_clean":"2024-05-14T10:12:04.105943+0000","last_became_active":"2024-05-14T09:40:43.124370+0000","last_became_peered":"2024-05-14T09:40:43.124370+0000","last_unstale":"2024-05-14T10:12:04.105943+0000","last_undegraded":"2024-05-14T10:12:04.105943+0000","last_fullsized":"2024-05-14T10:12:04.105943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:52.132214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'76","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.457975+0000","last_change":"2024-05-14T09:40:53.667102+0000","last_active":"2024-05-14T10:11:06.457975+0000","last_peered":"2024-05-14T10:11:06.457975+0000","last_clean":"2024-05-14T10:11:06.457975+0000","last_became_active":"2024-05-14T09:40:53.666666+0000","last_became_peered":"2024-05-14T09:40:53.666666+0000","last_unstale":"2024-05-14T10:11:06.457975+0000","last_undegraded":"2024-05-14T10:11:06.457975+0000","last_fullsized":"2024-05-14T10:11:06.457975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'22","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.645621+0000","last_change":"2024-05-14T09:40:45.777251+0000","last_active":"2024-05-14T10:12:13.645621+0000","last_peered":"2024-05-14T10:12:13.645621+0000","last_clean":"2024-05-14T10:12:13.645621+0000","last_became_active":"2024-05-14T09:40:45.775668+0000","last_became_peered":"2024-05-14T09:40:45.775668+0000","last_unstale":"2024-05-14T10:12:13.645621+0000","last_undegraded":"2024-05-14T10:12:13.645621+0000","last_fullsized":"2024-05-14T10:12:13.645621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:54.917354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'18","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.417385+0000","last_change":"2024-05-14T09:40:43.040000+0000","last_active":"2024-05-14T10:11:52.417385+0000","last_peered":"2024-05-14T10:11:52.417385+0000","last_clean":"2024-05-14T10:11:52.417385+0000","last_became_active":"2024-05-14T09:40:43.039186+0000","last_became_peered":"2024-05-14T09:40:43.039186+0000","last_unstale":"2024-05-14T10:11:52.417385+0000","last_undegraded":"2024-05-14T10:11:52.417385+0000","last_fullsized":"2024-05-14T10:11:52.417385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:41:44.514114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'79","reported_seq":113,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.550442+0000","last_change":"2024-05-14T09:40:53.667056+0000","last_active":"2024-05-14T10:11:05.550442+0000","last_peered":"2024-05-14T10:11:05.550442+0000","last_clean":"2024-05-14T10:11:05.550442+0000","last_became_active":"2024-05-14T09:40:53.666575+0000","last_became_peered":"2024-05-14T09:40:53.666575+0000","last_unstale":"2024-05-14T10:11:05.550442+0000","last_undegraded":"2024-05-14T10:11:05.550442+0000","last_fullsized":"2024-05-14T10:11:05.550442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":7996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'21","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.850810+0000","last_change":"2024-05-14T09:40:45.754466+0000","last_active":"2024-05-14T10:12:13.850810+0000","last_peered":"2024-05-14T10:12:13.850810+0000","last_clean":"2024-05-14T10:12:13.850810+0000","last_became_active":"2024-05-14T09:40:45.753839+0000","last_became_peered":"2024-05-14T09:40:45.753839+0000","last_unstale":"2024-05-14T10:12:13.850810+0000","last_undegraded":"2024-05-14T10:12:13.850810+0000","last_fullsized":"2024-05-14T10:12:13.850810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'5","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:34.188111+0000","last_change":"2024-05-14T09:40:43.121744+0000","last_active":"2024-05-14T10:11:34.188111+0000","last_peered":"2024-05-14T10:11:34.188111+0000","last_clean":"2024-05-14T10:11:34.188111+0000","last_became_active":"2024-05-14T09:40:43.121388+0000","last_became_peered":"2024-05-14T09:40:43.121388+0000","last_unstale":"2024-05-14T10:11:34.188111+0000","last_undegraded":"2024-05-14T10:11:34.188111+0000","last_fullsized":"2024-05-14T10:11:34.188111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'76","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.890093+0000","last_change":"2024-05-14T09:40:53.659658+0000","last_active":"2024-05-14T10:11:00.890093+0000","last_peered":"2024-05-14T10:11:00.890093+0000","last_clean":"2024-05-14T10:11:00.890093+0000","last_became_active":"2024-05-14T09:40:53.659191+0000","last_became_peered":"2024-05-14T09:40:53.659191+0000","last_unstale":"2024-05-14T10:11:00.890093+0000","last_undegraded":"2024-05-14T10:11:00.890093+0000","last_fullsized":"2024-05-14T10:11:00.890093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:15:39.587593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":8058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655238+0000","last_change":"2024-05-14T09:40:45.776748+0000","last_active":"2024-05-14T10:12:13.655238+0000","last_peered":"2024-05-14T10:12:13.655238+0000","last_clean":"2024-05-14T10:12:13.655238+0000","last_became_active":"2024-05-14T09:40:45.776451+0000","last_became_peered":"2024-05-14T09:40:45.776451+0000","last_unstale":"2024-05-14T10:12:13.655238+0000","last_undegraded":"2024-05-14T10:12:13.655238+0000","last_fullsized":"2024-05-14T10:12:13.655238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:39.890407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:09.356299+0000","last_change":"2024-05-14T09:40:43.086185+0000","last_active":"2024-05-14T10:12:09.356299+0000","last_peered":"2024-05-14T10:12:09.356299+0000","last_clean":"2024-05-14T10:12:09.356299+0000","last_became_active":"2024-05-14T09:40:43.085320+0000","last_became_peered":"2024-05-14T09:40:43.085320+0000","last_unstale":"2024-05-14T10:12:09.356299+0000","last_undegraded":"2024-05-14T10:12:09.356299+0000","last_fullsized":"2024-05-14T10:12:09.356299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:26:22.301593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'63","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:01.698322+0000","last_change":"2024-05-14T09:40:53.673710+0000","last_active":"2024-05-14T10:11:01.698322+0000","last_peered":"2024-05-14T10:11:01.698322+0000","last_clean":"2024-05-14T10:11:01.698322+0000","last_became_active":"2024-05-14T09:40:53.672089+0000","last_became_peered":"2024-05-14T09:40:53.672089+0000","last_unstale":"2024-05-14T10:11:01.698322+0000","last_undegraded":"2024-05-14T10:11:01.698322+0000","last_fullsized":"2024-05-14T10:11:01.698322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:48:16.697615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":6897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'25","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.484748+0000","last_change":"2024-05-14T09:40:45.767220+0000","last_active":"2024-05-14T10:12:13.484748+0000","last_peered":"2024-05-14T10:12:13.484748+0000","last_clean":"2024-05-14T10:12:13.484748+0000","last_became_active":"2024-05-14T09:40:45.766895+0000","last_became_peered":"2024-05-14T09:40:45.766895+0000","last_unstale":"2024-05-14T10:12:13.484748+0000","last_undegraded":"2024-05-14T10:12:13.484748+0000","last_fullsized":"2024-05-14T10:12:13.484748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'10","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:34.189842+0000","last_change":"2024-05-14T09:40:43.124937+0000","last_active":"2024-05-14T10:11:34.189842+0000","last_peered":"2024-05-14T10:11:34.189842+0000","last_clean":"2024-05-14T10:11:34.189842+0000","last_became_active":"2024-05-14T09:40:43.124129+0000","last_became_peered":"2024-05-14T09:40:43.124129+0000","last_unstale":"2024-05-14T10:11:34.189842+0000","last_undegraded":"2024-05-14T10:11:34.189842+0000","last_fullsized":"2024-05-14T10:11:34.189842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'71","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.445761+0000","last_change":"2024-05-14T09:40:53.664722+0000","last_active":"2024-05-14T10:11:06.445761+0000","last_peered":"2024-05-14T10:11:06.445761+0000","last_clean":"2024-05-14T10:11:06.445761+0000","last_became_active":"2024-05-14T09:40:53.664194+0000","last_became_peered":"2024-05-14T09:40:53.664194+0000","last_unstale":"2024-05-14T10:11:06.445761+0000","last_undegraded":"2024-05-14T10:11:06.445761+0000","last_fullsized":"2024-05-14T10:11:06.445761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:35:57.826557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":7358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'20","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.643712+0000","last_change":"2024-05-14T09:40:45.770662+0000","last_active":"2024-05-14T10:12:13.643712+0000","last_peered":"2024-05-14T10:12:13.643712+0000","last_clean":"2024-05-14T10:12:13.643712+0000","last_became_active":"2024-05-14T09:40:45.768058+0000","last_became_peered":"2024-05-14T09:40:45.768058+0000","last_unstale":"2024-05-14T10:12:13.643712+0000","last_undegraded":"2024-05-14T10:12:13.643712+0000","last_fullsized":"2024-05-14T10:12:13.643712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:13.296625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'824","reported_seq":872,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:56.423487+0000","last_change":"2024-05-14T09:40:43.113989+0000","last_active":"2024-05-14T10:11:56.423487+0000","last_peered":"2024-05-14T10:11:56.423487+0000","last_clean":"2024-05-14T10:11:56.423487+0000","last_became_active":"2024-05-14T09:40:43.113589+0000","last_became_peered":"2024-05-14T09:40:43.113589+0000","last_unstale":"2024-05-14T10:11:56.423487+0000","last_undegraded":"2024-05-14T10:11:56.423487+0000","last_fullsized":"2024-05-14T10:11:56.423487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:42:17.351523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'80","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:04.469761+0000","last_change":"2024-05-14T09:40:53.663887+0000","last_active":"2024-05-14T10:11:04.469761+0000","last_peered":"2024-05-14T10:11:04.469761+0000","last_clean":"2024-05-14T10:11:04.469761+0000","last_became_active":"2024-05-14T09:40:53.663419+0000","last_became_peered":"2024-05-14T09:40:53.663419+0000","last_unstale":"2024-05-14T10:11:04.469761+0000","last_undegraded":"2024-05-14T10:11:04.469761+0000","last_fullsized":"2024-05-14T10:11:04.469761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:18.081035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":12628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"33'24","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.653832+0000","last_change":"2024-05-14T09:40:45.767184+0000","last_active":"2024-05-14T10:12:13.653832+0000","last_peered":"2024-05-14T10:12:13.653832+0000","last_clean":"2024-05-14T10:12:13.653832+0000","last_became_active":"2024-05-14T09:40:45.766784+0000","last_became_peered":"2024-05-14T09:40:45.766784+0000","last_unstale":"2024-05-14T10:12:13.653832+0000","last_undegraded":"2024-05-14T10:12:13.653832+0000","last_fullsized":"2024-05-14T10:12:13.653832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'307","reported_seq":355,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:12.356956+0000","last_change":"2024-05-14T09:40:43.089869+0000","last_active":"2024-05-14T10:12:12.356956+0000","last_peered":"2024-05-14T10:12:12.356956+0000","last_clean":"2024-05-14T10:12:12.356956+0000","last_became_active":"2024-05-14T09:40:43.088906+0000","last_became_peered":"2024-05-14T09:40:43.088906+0000","last_unstale":"2024-05-14T10:12:12.356956+0000","last_undegraded":"2024-05-14T10:12:12.356956+0000","last_fullsized":"2024-05-14T10:12:12.356956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:28.223322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'115","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.819059+0000","last_change":"2024-05-14T09:40:53.667412+0000","last_active":"2024-05-14T10:11:05.819059+0000","last_peered":"2024-05-14T10:11:05.819059+0000","last_clean":"2024-05-14T10:11:05.819059+0000","last_became_active":"2024-05-14T09:40:53.666533+0000","last_became_peered":"2024-05-14T09:40:53.666533+0000","last_unstale":"2024-05-14T10:11:05.819059+0000","last_undegraded":"2024-05-14T10:11:05.819059+0000","last_fullsized":"2024-05-14T10:11:05.819059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:53:41.310701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'25","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.473306+0000","last_change":"2024-05-14T09:41:04.250664+0000","last_active":"2024-05-14T10:12:13.473306+0000","last_peered":"2024-05-14T10:12:13.473306+0000","last_clean":"2024-05-14T10:12:13.473306+0000","last_became_active":"2024-05-14T09:41:04.250043+0000","last_became_peered":"2024-05-14T09:41:04.250043+0000","last_unstale":"2024-05-14T10:12:13.473306+0000","last_undegraded":"2024-05-14T10:12:13.473306+0000","last_fullsized":"2024-05-14T10:12:13.473306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:46:49.138281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:54.436624+0000","last_change":"2024-05-14T09:40:43.116130+0000","last_active":"2024-05-14T10:11:54.436624+0000","last_peered":"2024-05-14T10:11:54.436624+0000","last_clean":"2024-05-14T10:11:54.436624+0000","last_became_active":"2024-05-14T09:40:43.115741+0000","last_became_peered":"2024-05-14T09:40:43.115741+0000","last_unstale":"2024-05-14T10:11:54.436624+0000","last_undegraded":"2024-05-14T10:11:54.436624+0000","last_fullsized":"2024-05-14T10:11:54.436624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:35.083285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'83","reported_seq":117,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.889971+0000","last_change":"2024-05-14T09:40:53.667088+0000","last_active":"2024-05-14T10:11:00.889971+0000","last_peered":"2024-05-14T10:11:00.889971+0000","last_clean":"2024-05-14T10:11:00.889971+0000","last_became_active":"2024-05-14T09:40:53.662581+0000","last_became_peered":"2024-05-14T09:40:53.662581+0000","last_unstale":"2024-05-14T10:11:00.889971+0000","last_undegraded":"2024-05-14T10:11:00.889971+0000","last_fullsized":"2024-05-14T10:11:00.889971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:14:18.824424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.617351+0000","last_change":"2024-05-14T09:40:45.774302+0000","last_active":"2024-05-14T10:12:13.617351+0000","last_peered":"2024-05-14T10:12:13.617351+0000","last_clean":"2024-05-14T10:12:13.617351+0000","last_became_active":"2024-05-14T09:40:45.773879+0000","last_became_peered":"2024-05-14T09:40:45.773879+0000","last_unstale":"2024-05-14T10:12:13.617351+0000","last_undegraded":"2024-05-14T10:12:13.617351+0000","last_fullsized":"2024-05-14T10:12:13.617351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:09.921679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:10.831471+0000","last_change":"2024-05-14T09:40:43.116616+0000","last_active":"2024-05-14T10:12:10.831471+0000","last_peered":"2024-05-14T10:12:10.831471+0000","last_clean":"2024-05-14T10:12:10.831471+0000","last_became_active":"2024-05-14T09:40:43.115166+0000","last_became_peered":"2024-05-14T09:40:43.115166+0000","last_unstale":"2024-05-14T10:12:10.831471+0000","last_undegraded":"2024-05-14T10:12:10.831471+0000","last_fullsized":"2024-05-14T10:12:10.831471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:52.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'85","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:51.094065+0000","last_change":"2024-05-14T09:40:53.668423+0000","last_active":"2024-05-14T10:10:51.094065+0000","last_peered":"2024-05-14T10:10:51.094065+0000","last_clean":"2024-05-14T10:10:51.094065+0000","last_became_active":"2024-05-14T09:40:53.664838+0000","last_became_peered":"2024-05-14T09:40:53.664838+0000","last_unstale":"2024-05-14T10:10:51.094065+0000","last_undegraded":"2024-05-14T10:10:51.094065+0000","last_fullsized":"2024-05-14T10:10:51.094065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:00:35.633754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":10155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'59","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.793458+0000","last_change":"2024-05-14T09:40:53.656095+0000","last_active":"2024-05-14T10:11:00.793458+0000","last_peered":"2024-05-14T10:11:00.793458+0000","last_clean":"2024-05-14T10:11:00.793458+0000","last_became_active":"2024-05-14T09:40:53.655439+0000","last_became_peered":"2024-05-14T09:40:53.655439+0000","last_unstale":"2024-05-14T10:11:00.793458+0000","last_undegraded":"2024-05-14T10:11:00.793458+0000","last_fullsized":"2024-05-14T10:11:00.793458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:44.521319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.501706+0000","last_change":"2024-05-14T09:40:45.744447+0000","last_active":"2024-05-14T10:12:13.501706+0000","last_peered":"2024-05-14T10:12:13.501706+0000","last_clean":"2024-05-14T10:12:13.501706+0000","last_became_active":"2024-05-14T09:40:45.743611+0000","last_became_peered":"2024-05-14T09:40:45.743611+0000","last_unstale":"2024-05-14T10:12:13.501706+0000","last_undegraded":"2024-05-14T10:12:13.501706+0000","last_fullsized":"2024-05-14T10:12:13.501706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:56.519183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'7","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:04.107149+0000","last_change":"2024-05-14T09:40:43.122005+0000","last_active":"2024-05-14T10:12:04.107149+0000","last_peered":"2024-05-14T10:12:04.107149+0000","last_clean":"2024-05-14T10:12:04.107149+0000","last_became_active":"2024-05-14T09:40:43.121629+0000","last_became_peered":"2024-05-14T09:40:43.121629+0000","last_unstale":"2024-05-14T10:12:04.107149+0000","last_undegraded":"2024-05-14T10:12:04.107149+0000","last_fullsized":"2024-05-14T10:12:04.107149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:31:03.016812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'63","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.462172+0000","last_change":"2024-05-14T09:40:53.679415+0000","last_active":"2024-05-14T10:11:03.462172+0000","last_peered":"2024-05-14T10:11:03.462172+0000","last_clean":"2024-05-14T10:11:03.462172+0000","last_became_active":"2024-05-14T09:40:53.678851+0000","last_became_peered":"2024-05-14T09:40:53.678851+0000","last_unstale":"2024-05-14T10:11:03.462172+0000","last_undegraded":"2024-05-14T10:11:03.462172+0000","last_fullsized":"2024-05-14T10:11:03.462172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:48.049763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.537840+0000","last_change":"2024-05-14T09:40:45.743111+0000","last_active":"2024-05-14T10:12:13.537840+0000","last_peered":"2024-05-14T10:12:13.537840+0000","last_clean":"2024-05-14T10:12:13.537840+0000","last_became_active":"2024-05-14T09:40:45.742702+0000","last_became_peered":"2024-05-14T09:40:45.742702+0000","last_unstale":"2024-05-14T10:12:13.537840+0000","last_undegraded":"2024-05-14T10:12:13.537840+0000","last_fullsized":"2024-05-14T10:12:13.537840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:17:39.673477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.984144+0000","last_change":"2024-05-14T09:40:43.116535+0000","last_active":"2024-05-14T10:12:02.984144+0000","last_peered":"2024-05-14T10:12:02.984144+0000","last_clean":"2024-05-14T10:12:02.984144+0000","last_became_active":"2024-05-14T09:40:43.115860+0000","last_became_peered":"2024-05-14T09:40:43.115860+0000","last_unstale":"2024-05-14T10:12:02.984144+0000","last_undegraded":"2024-05-14T10:12:02.984144+0000","last_fullsized":"2024-05-14T10:12:02.984144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'339","reported_seq":386,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.430157+0000","last_change":"2024-05-14T09:40:43.120700+0000","last_active":"2024-05-14T10:11:52.430157+0000","last_peered":"2024-05-14T10:11:52.430157+0000","last_clean":"2024-05-14T10:11:52.430157+0000","last_became_active":"2024-05-14T09:40:43.120353+0000","last_became_peered":"2024-05-14T09:40:43.120353+0000","last_unstale":"2024-05-14T10:11:52.430157+0000","last_undegraded":"2024-05-14T10:11:52.430157+0000","last_fullsized":"2024-05-14T10:11:52.430157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:35.425012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'24","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.485676+0000","last_change":"2024-05-14T09:40:45.758385+0000","last_active":"2024-05-14T10:12:13.485676+0000","last_peered":"2024-05-14T10:12:13.485676+0000","last_clean":"2024-05-14T10:12:13.485676+0000","last_became_active":"2024-05-14T09:40:45.758017+0000","last_became_peered":"2024-05-14T09:40:45.758017+0000","last_unstale":"2024-05-14T10:12:13.485676+0000","last_undegraded":"2024-05-14T10:12:13.485676+0000","last_fullsized":"2024-05-14T10:12:13.485676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'56","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:00.890744+0000","last_change":"2024-05-14T09:40:53.671995+0000","last_active":"2024-05-14T10:11:00.890744+0000","last_peered":"2024-05-14T10:11:00.890744+0000","last_clean":"2024-05-14T10:11:00.890744+0000","last_became_active":"2024-05-14T09:40:53.671145+0000","last_became_peered":"2024-05-14T09:40:53.671145+0000","last_unstale":"2024-05-14T10:11:00.890744+0000","last_undegraded":"2024-05-14T10:11:00.890744+0000","last_fullsized":"2024-05-14T10:11:00.890744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:23:02.991096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'472","reported_seq":519,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.865101+0000","last_change":"2024-05-14T09:40:43.105812+0000","last_active":"2024-05-14T10:11:57.865101+0000","last_peered":"2024-05-14T10:11:57.865101+0000","last_clean":"2024-05-14T10:11:57.865101+0000","last_became_active":"2024-05-14T09:40:43.104821+0000","last_became_peered":"2024-05-14T09:40:43.104821+0000","last_unstale":"2024-05-14T10:11:57.865101+0000","last_undegraded":"2024-05-14T10:11:57.865101+0000","last_fullsized":"2024-05-14T10:11:57.865101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'22","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.640694+0000","last_change":"2024-05-14T09:40:45.746294+0000","last_active":"2024-05-14T10:12:13.640694+0000","last_peered":"2024-05-14T10:12:13.640694+0000","last_clean":"2024-05-14T10:12:13.640694+0000","last_became_active":"2024-05-14T09:40:45.745850+0000","last_became_peered":"2024-05-14T09:40:45.745850+0000","last_unstale":"2024-05-14T10:12:13.640694+0000","last_undegraded":"2024-05-14T10:12:13.640694+0000","last_fullsized":"2024-05-14T10:12:13.640694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:17.774486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'74","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:58.132031+0000","last_change":"2024-05-14T09:40:53.670990+0000","last_active":"2024-05-14T10:10:58.132031+0000","last_peered":"2024-05-14T10:10:58.132031+0000","last_clean":"2024-05-14T10:10:58.132031+0000","last_became_active":"2024-05-14T09:40:53.669094+0000","last_became_peered":"2024-05-14T09:40:53.669094+0000","last_unstale":"2024-05-14T10:10:58.132031+0000","last_undegraded":"2024-05-14T10:10:58.132031+0000","last_fullsized":"2024-05-14T10:10:58.132031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:35:15.483140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":7350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.851152+0000","last_change":"2024-05-14T09:40:45.754615+0000","last_active":"2024-05-14T10:12:13.851152+0000","last_peered":"2024-05-14T10:12:13.851152+0000","last_clean":"2024-05-14T10:12:13.851152+0000","last_became_active":"2024-05-14T09:40:45.754283+0000","last_became_peered":"2024-05-14T09:40:45.754283+0000","last_unstale":"2024-05-14T10:12:13.851152+0000","last_undegraded":"2024-05-14T10:12:13.851152+0000","last_fullsized":"2024-05-14T10:12:13.851152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'26","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.628640+0000","last_change":"2024-05-14T09:40:45.753218+0000","last_active":"2024-05-14T10:12:13.628640+0000","last_peered":"2024-05-14T10:12:13.628640+0000","last_clean":"2024-05-14T10:12:13.628640+0000","last_became_active":"2024-05-14T09:40:45.752599+0000","last_became_peered":"2024-05-14T09:40:45.752599+0000","last_unstale":"2024-05-14T10:12:13.628640+0000","last_undegraded":"2024-05-14T10:12:13.628640+0000","last_fullsized":"2024-05-14T10:12:13.628640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'26","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.615687+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T10:12:13.615687+0000","last_peered":"2024-05-14T10:12:13.615687+0000","last_clean":"2024-05-14T10:12:13.615687+0000","last_became_active":"2024-05-14T09:40:45.750387+0000","last_became_peered":"2024-05-14T09:40:45.750387+0000","last_unstale":"2024-05-14T10:12:13.615687+0000","last_undegraded":"2024-05-14T10:12:13.615687+0000","last_fullsized":"2024-05-14T10:12:13.615687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:54.689111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'18","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.475232+0000","last_change":"2024-05-14T09:41:04.251002+0000","last_active":"2024-05-14T10:12:13.475232+0000","last_peered":"2024-05-14T10:12:13.475232+0000","last_clean":"2024-05-14T10:12:13.475232+0000","last_became_active":"2024-05-14T09:41:04.250037+0000","last_became_peered":"2024-05-14T09:41:04.250037+0000","last_unstale":"2024-05-14T10:12:13.475232+0000","last_undegraded":"2024-05-14T10:12:13.475232+0000","last_fullsized":"2024-05-14T10:12:13.475232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:42:35.669137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'17","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.572074+0000","last_change":"2024-05-14T09:40:45.723956+0000","last_active":"2024-05-14T10:12:13.572074+0000","last_peered":"2024-05-14T10:12:13.572074+0000","last_clean":"2024-05-14T10:12:13.572074+0000","last_became_active":"2024-05-14T09:40:45.723040+0000","last_became_peered":"2024-05-14T09:40:45.723040+0000","last_unstale":"2024-05-14T10:12:13.572074+0000","last_undegraded":"2024-05-14T10:12:13.572074+0000","last_fullsized":"2024-05-14T10:12:13.572074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:45.690725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'18","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.485881+0000","last_change":"2024-05-14T09:40:45.746942+0000","last_active":"2024-05-14T10:12:13.485881+0000","last_peered":"2024-05-14T10:12:13.485881+0000","last_clean":"2024-05-14T10:12:13.485881+0000","last_became_active":"2024-05-14T09:40:45.745393+0000","last_became_peered":"2024-05-14T09:40:45.745393+0000","last_unstale":"2024-05-14T10:12:13.485881+0000","last_undegraded":"2024-05-14T10:12:13.485881+0000","last_fullsized":"2024-05-14T10:12:13.485881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:37.377406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'32","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.860871+0000","last_change":"2024-05-14T09:40:45.772238+0000","last_active":"2024-05-14T10:12:13.860871+0000","last_peered":"2024-05-14T10:12:13.860871+0000","last_clean":"2024-05-14T10:12:13.860871+0000","last_became_active":"2024-05-14T09:40:45.771838+0000","last_became_peered":"2024-05-14T09:40:45.771838+0000","last_unstale":"2024-05-14T10:12:13.860871+0000","last_undegraded":"2024-05-14T10:12:13.860871+0000","last_fullsized":"2024-05-14T10:12:13.860871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"33'17","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.502633+0000","last_change":"2024-05-14T09:40:45.727770+0000","last_active":"2024-05-14T10:12:13.502633+0000","last_peered":"2024-05-14T10:12:13.502633+0000","last_clean":"2024-05-14T10:12:13.502633+0000","last_became_active":"2024-05-14T09:40:45.725283+0000","last_became_peered":"2024-05-14T09:40:45.725283+0000","last_unstale":"2024-05-14T10:12:13.502633+0000","last_undegraded":"2024-05-14T10:12:13.502633+0000","last_fullsized":"2024-05-14T10:12:13.502633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:22.638700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'19","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.624093+0000","last_change":"2024-05-14T09:40:45.749288+0000","last_active":"2024-05-14T10:12:13.624093+0000","last_peered":"2024-05-14T10:12:13.624093+0000","last_clean":"2024-05-14T10:12:13.624093+0000","last_became_active":"2024-05-14T09:40:45.748925+0000","last_became_peered":"2024-05-14T09:40:45.748925+0000","last_unstale":"2024-05-14T10:12:13.624093+0000","last_undegraded":"2024-05-14T10:12:13.624093+0000","last_fullsized":"2024-05-14T10:12:13.624093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:03.576418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'25","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.557987+0000","last_change":"2024-05-14T09:40:45.724197+0000","last_active":"2024-05-14T10:12:13.557987+0000","last_peered":"2024-05-14T10:12:13.557987+0000","last_clean":"2024-05-14T10:12:13.557987+0000","last_became_active":"2024-05-14T09:40:45.723317+0000","last_became_peered":"2024-05-14T09:40:45.723317+0000","last_unstale":"2024-05-14T10:12:13.557987+0000","last_undegraded":"2024-05-14T10:12:13.557987+0000","last_fullsized":"2024-05-14T10:12:13.557987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'24","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.621654+0000","last_change":"2024-05-14T09:40:45.770723+0000","last_active":"2024-05-14T10:12:13.621654+0000","last_peered":"2024-05-14T10:12:13.621654+0000","last_clean":"2024-05-14T10:12:13.621654+0000","last_became_active":"2024-05-14T09:40:45.769772+0000","last_became_peered":"2024-05-14T09:40:45.769772+0000","last_unstale":"2024-05-14T10:12:13.621654+0000","last_undegraded":"2024-05-14T10:12:13.621654+0000","last_fullsized":"2024-05-14T10:12:13.621654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:44.852533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"33'33","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.486834+0000","last_change":"2024-05-14T09:40:45.766217+0000","last_active":"2024-05-14T10:12:13.486834+0000","last_peered":"2024-05-14T10:12:13.486834+0000","last_clean":"2024-05-14T10:12:13.486834+0000","last_became_active":"2024-05-14T09:40:45.765830+0000","last_became_peered":"2024-05-14T09:40:45.765830+0000","last_unstale":"2024-05-14T10:12:13.486834+0000","last_undegraded":"2024-05-14T10:12:13.486834+0000","last_fullsized":"2024-05-14T10:12:13.486834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'27","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.854039+0000","last_change":"2024-05-14T09:40:45.760838+0000","last_active":"2024-05-14T10:12:13.854039+0000","last_peered":"2024-05-14T10:12:13.854039+0000","last_clean":"2024-05-14T10:12:13.854039+0000","last_became_active":"2024-05-14T09:40:45.760535+0000","last_became_peered":"2024-05-14T09:40:45.760535+0000","last_unstale":"2024-05-14T10:12:13.854039+0000","last_undegraded":"2024-05-14T10:12:13.854039+0000","last_fullsized":"2024-05-14T10:12:13.854039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"33'23","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.648019+0000","last_change":"2024-05-14T09:40:45.778218+0000","last_active":"2024-05-14T10:12:13.648019+0000","last_peered":"2024-05-14T10:12:13.648019+0000","last_clean":"2024-05-14T10:12:13.648019+0000","last_became_active":"2024-05-14T09:40:45.775602+0000","last_became_peered":"2024-05-14T09:40:45.775602+0000","last_unstale":"2024-05-14T10:12:13.648019+0000","last_undegraded":"2024-05-14T10:12:13.648019+0000","last_fullsized":"2024-05-14T10:12:13.648019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:40.574917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'33","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.629831+0000","last_change":"2024-05-14T09:40:45.748996+0000","last_active":"2024-05-14T10:12:13.629831+0000","last_peered":"2024-05-14T10:12:13.629831+0000","last_clean":"2024-05-14T10:12:13.629831+0000","last_became_active":"2024-05-14T09:40:45.748266+0000","last_became_peered":"2024-05-14T09:40:45.748266+0000","last_unstale":"2024-05-14T10:12:13.629831+0000","last_undegraded":"2024-05-14T10:12:13.629831+0000","last_fullsized":"2024-05-14T10:12:13.629831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'22","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.621627+0000","last_change":"2024-05-14T09:41:04.613266+0000","last_active":"2024-05-14T10:12:13.621627+0000","last_peered":"2024-05-14T10:12:13.621627+0000","last_clean":"2024-05-14T10:12:13.621627+0000","last_became_active":"2024-05-14T09:41:04.612160+0000","last_became_peered":"2024-05-14T09:41:04.612160+0000","last_unstale":"2024-05-14T10:12:13.621627+0000","last_undegraded":"2024-05-14T10:12:13.621627+0000","last_fullsized":"2024-05-14T10:12:13.621627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'28","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623303+0000","last_change":"2024-05-14T09:40:45.757279+0000","last_active":"2024-05-14T10:12:13.623303+0000","last_peered":"2024-05-14T10:12:13.623303+0000","last_clean":"2024-05-14T10:12:13.623303+0000","last_became_active":"2024-05-14T09:40:45.749692+0000","last_became_peered":"2024-05-14T09:40:45.749692+0000","last_unstale":"2024-05-14T10:12:13.623303+0000","last_undegraded":"2024-05-14T10:12:13.623303+0000","last_fullsized":"2024-05-14T10:12:13.623303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:39:52.486187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'27","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.487188+0000","last_change":"2024-05-14T09:40:45.744802+0000","last_active":"2024-05-14T10:12:13.487188+0000","last_peered":"2024-05-14T10:12:13.487188+0000","last_clean":"2024-05-14T10:12:13.487188+0000","last_became_active":"2024-05-14T09:40:45.744011+0000","last_became_peered":"2024-05-14T09:40:45.744011+0000","last_unstale":"2024-05-14T10:12:13.487188+0000","last_undegraded":"2024-05-14T10:12:13.487188+0000","last_fullsized":"2024-05-14T10:12:13.487188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:56:20.468216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'24","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.486825+0000","last_change":"2024-05-14T09:40:45.757983+0000","last_active":"2024-05-14T10:12:13.486825+0000","last_peered":"2024-05-14T10:12:13.486825+0000","last_clean":"2024-05-14T10:12:13.486825+0000","last_became_active":"2024-05-14T09:40:45.757450+0000","last_became_peered":"2024-05-14T09:40:45.757450+0000","last_unstale":"2024-05-14T10:12:13.486825+0000","last_undegraded":"2024-05-14T10:12:13.486825+0000","last_fullsized":"2024-05-14T10:12:13.486825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:07.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'33","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.565326+0000","last_change":"2024-05-14T09:40:45.745021+0000","last_active":"2024-05-14T10:12:13.565326+0000","last_peered":"2024-05-14T10:12:13.565326+0000","last_clean":"2024-05-14T10:12:13.565326+0000","last_became_active":"2024-05-14T09:40:45.744550+0000","last_became_peered":"2024-05-14T09:40:45.744550+0000","last_unstale":"2024-05-14T10:12:13.565326+0000","last_undegraded":"2024-05-14T10:12:13.565326+0000","last_fullsized":"2024-05-14T10:12:13.565326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'17","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.644582+0000","last_change":"2024-05-14T09:40:45.749109+0000","last_active":"2024-05-14T10:12:13.644582+0000","last_peered":"2024-05-14T10:12:13.644582+0000","last_clean":"2024-05-14T10:12:13.644582+0000","last_became_active":"2024-05-14T09:40:45.748419+0000","last_became_peered":"2024-05-14T09:40:45.748419+0000","last_unstale":"2024-05-14T10:12:13.644582+0000","last_undegraded":"2024-05-14T10:12:13.644582+0000","last_fullsized":"2024-05-14T10:12:13.644582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'23","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.846466+0000","last_change":"2024-05-14T09:40:45.753508+0000","last_active":"2024-05-14T10:12:13.846466+0000","last_peered":"2024-05-14T10:12:13.846466+0000","last_clean":"2024-05-14T10:12:13.846466+0000","last_became_active":"2024-05-14T09:40:45.752982+0000","last_became_peered":"2024-05-14T09:40:45.752982+0000","last_unstale":"2024-05-14T10:12:13.846466+0000","last_undegraded":"2024-05-14T10:12:13.846466+0000","last_fullsized":"2024-05-14T10:12:13.846466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"33'32","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.861693+0000","last_change":"2024-05-14T09:40:45.759266+0000","last_active":"2024-05-14T10:12:13.861693+0000","last_peered":"2024-05-14T10:12:13.861693+0000","last_clean":"2024-05-14T10:12:13.861693+0000","last_became_active":"2024-05-14T09:40:45.758912+0000","last_became_peered":"2024-05-14T09:40:45.758912+0000","last_unstale":"2024-05-14T10:12:13.861693+0000","last_undegraded":"2024-05-14T10:12:13.861693+0000","last_fullsized":"2024-05-14T10:12:13.861693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'28","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655653+0000","last_change":"2024-05-14T09:40:45.780527+0000","last_active":"2024-05-14T10:12:13.655653+0000","last_peered":"2024-05-14T10:12:13.655653+0000","last_clean":"2024-05-14T10:12:13.655653+0000","last_became_active":"2024-05-14T09:40:45.780197+0000","last_became_peered":"2024-05-14T09:40:45.780197+0000","last_unstale":"2024-05-14T10:12:13.655653+0000","last_undegraded":"2024-05-14T10:12:13.655653+0000","last_fullsized":"2024-05-14T10:12:13.655653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:38.220230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'19","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.562504+0000","last_change":"2024-05-14T09:40:45.761049+0000","last_active":"2024-05-14T10:12:13.562504+0000","last_peered":"2024-05-14T10:12:13.562504+0000","last_clean":"2024-05-14T10:12:13.562504+0000","last_became_active":"2024-05-14T09:40:45.760738+0000","last_became_peered":"2024-05-14T09:40:45.760738+0000","last_unstale":"2024-05-14T10:12:13.562504+0000","last_undegraded":"2024-05-14T10:12:13.562504+0000","last_fullsized":"2024-05-14T10:12:13.562504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'17","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.645430+0000","last_change":"2024-05-14T09:40:45.776380+0000","last_active":"2024-05-14T10:12:13.645430+0000","last_peered":"2024-05-14T10:12:13.645430+0000","last_clean":"2024-05-14T10:12:13.645430+0000","last_became_active":"2024-05-14T09:40:45.776005+0000","last_became_peered":"2024-05-14T09:40:45.776005+0000","last_unstale":"2024-05-14T10:12:13.645430+0000","last_undegraded":"2024-05-14T10:12:13.645430+0000","last_fullsized":"2024-05-14T10:12:13.645430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:27.969792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'24","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623089+0000","last_change":"2024-05-14T09:41:04.214552+0000","last_active":"2024-05-14T10:12:13.623089+0000","last_peered":"2024-05-14T10:12:13.623089+0000","last_clean":"2024-05-14T10:12:13.623089+0000","last_became_active":"2024-05-14T09:41:04.213721+0000","last_became_peered":"2024-05-14T09:41:04.213721+0000","last_unstale":"2024-05-14T10:12:13.623089+0000","last_undegraded":"2024-05-14T10:12:13.623089+0000","last_fullsized":"2024-05-14T10:12:13.623089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"33'23","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.650378+0000","last_change":"2024-05-14T09:40:45.776955+0000","last_active":"2024-05-14T10:12:13.650378+0000","last_peered":"2024-05-14T10:12:13.650378+0000","last_clean":"2024-05-14T10:12:13.650378+0000","last_became_active":"2024-05-14T09:40:45.775953+0000","last_became_peered":"2024-05-14T09:40:45.775953+0000","last_unstale":"2024-05-14T10:12:13.650378+0000","last_undegraded":"2024-05-14T10:12:13.650378+0000","last_fullsized":"2024-05-14T10:12:13.650378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:13.534273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.626341+0000","last_change":"2024-05-14T09:40:45.750766+0000","last_active":"2024-05-14T10:12:13.626341+0000","last_peered":"2024-05-14T10:12:13.626341+0000","last_clean":"2024-05-14T10:12:13.626341+0000","last_became_active":"2024-05-14T09:40:45.750416+0000","last_became_peered":"2024-05-14T09:40:45.750416+0000","last_unstale":"2024-05-14T10:12:13.626341+0000","last_undegraded":"2024-05-14T10:12:13.626341+0000","last_fullsized":"2024-05-14T10:12:13.626341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:29:30.022171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"33'25","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.486470+0000","last_change":"2024-05-14T09:40:45.748573+0000","last_active":"2024-05-14T10:12:13.486470+0000","last_peered":"2024-05-14T10:12:13.486470+0000","last_clean":"2024-05-14T10:12:13.486470+0000","last_became_active":"2024-05-14T09:40:45.746640+0000","last_became_peered":"2024-05-14T09:40:45.746640+0000","last_unstale":"2024-05-14T10:12:13.486470+0000","last_undegraded":"2024-05-14T10:12:13.486470+0000","last_fullsized":"2024-05-14T10:12:13.486470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"33'19","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.446564+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T10:12:13.446564+0000","last_peered":"2024-05-14T10:12:13.446564+0000","last_clean":"2024-05-14T10:12:13.446564+0000","last_became_active":"2024-05-14T09:40:45.752589+0000","last_became_peered":"2024-05-14T09:40:45.752589+0000","last_unstale":"2024-05-14T10:12:13.446564+0000","last_undegraded":"2024-05-14T10:12:13.446564+0000","last_fullsized":"2024-05-14T10:12:13.446564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:13:43.043120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.652852+0000","last_change":"2024-05-14T09:40:45.771577+0000","last_active":"2024-05-14T10:12:13.652852+0000","last_peered":"2024-05-14T10:12:13.652852+0000","last_clean":"2024-05-14T10:12:13.652852+0000","last_became_active":"2024-05-14T09:40:45.771228+0000","last_became_peered":"2024-05-14T09:40:45.771228+0000","last_unstale":"2024-05-14T10:12:13.652852+0000","last_undegraded":"2024-05-14T10:12:13.652852+0000","last_fullsized":"2024-05-14T10:12:13.652852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:36.361964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2167,"num_write_kb":250271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2329,"ondisk_log_size":2329,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1480,"ondisk_log_size":1480,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21977357,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":432,"num_read_kb":466,"num_write":6515,"num_write_kb":24638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44105728,"data_stored":43954714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4957,"ondisk_log_size":4957,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719477125,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39728,"kb_used_data":8552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332112,"statfs":{"total":96636764160,"available":96596082688,"internally_reserved":0,"allocated":8757248,"data_stored":8538561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719477127,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52208,"kb_used_data":8552,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319632,"statfs":{"total":96636764160,"available":96583303168,"internally_reserved":0,"allocated":8757248,"data_stored":8537925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":16,"seq":68719477127,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40712,"kb_used_data":9536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331128,"statfs":{"total":96636764160,"available":96595075072,"internally_reserved":0,"allocated":9764864,"data_stored":9539012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719477124,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":267048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477124,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45396,"kb_used_data":5900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326444,"statfs":{"total":96636764160,"available":96590278656,"internally_reserved":0,"allocated":6041600,"data_stored":5817281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509829,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40248,"kb_used_data":13232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331592,"statfs":{"total":96636764160,"available":96595550208,"internally_reserved":0,"allocated":13549568,"data_stored":13323781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542530,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39860,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331980,"statfs":{"total":96636764160,"available":96595947520,"internally_reserved":0,"allocated":372736,"data_stored":149981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542532,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":149547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5095424,"data_stored":5078310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":118445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9412608,"data_stored":9391547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12603392,"data_stored":12584810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T10:12:22.547 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T10:12:22.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.864+0000 7f33eec00640 1 Processor -- start 2024-05-14T10:12:22.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.864+0000 7f33eec00640 1 -- start start 2024-05-14T10:12:22.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.866+0000 7f33eec00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f33e80c66d0 0x7f33e80cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:22.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.866+0000 7f33eec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33e806d550 0x7f33e806d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:22.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.866+0000 7f33eec00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e815ced0 con 0x7f33e8152df0 2024-05-14T10:12:22.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.866+0000 7f33eec00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f33e815d170 con 0x7f33e80c66d0 2024-05-14T10:12:22.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.866+0000 7f33eec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f33e806c790 con 0x7f33e806d550 2024-05-14T10:12:22.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.869+0000 7f33ed800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f33e80c66d0 0x7f33e80cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:22.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.869+0000 7f33ee200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33e806d550 0x7f33e806d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:22.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.870+0000 7f33ed800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f33e80c66d0 0x7f33e80cdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:57738/0 (socket says 172.21.15.135:57738) 2024-05-14T10:12:22.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.870+0000 7f33ed800640 1 -- 172.21.15.135:0/3401907447 learned_addr learned my addr 172.21.15.135:0/3401907447 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:22.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.878+0000 7f33ee200640 1 -- 172.21.15.135:0/3401907447 >> v2:172.21.15.196:3300/0 conn(0x7f33e80c66d0 msgr2=0x7f33e80cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:22.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.878+0000 7f33ee200640 1 --2- 172.21.15.135:0/3401907447 >> v2:172.21.15.196:3300/0 conn(0x7f33e80c66d0 0x7f33e80cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:22.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.878+0000 7f33ee200640 1 -- 172.21.15.135:0/3401907447 >> v1:172.21.15.135:6789/0 conn(0x7f33e8152df0 legacy=0x7f33e80cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:22.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.878+0000 7f33ee200640 1 -- 172.21.15.135:0/3401907447 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e806ca70 con 0x7f33e806d550 2024-05-14T10:12:22.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.884+0000 7f33ee200640 1 --2- 172.21.15.135:0/3401907447 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33e806d550 0x7f33e806d960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009d90 tx=0x7f33e002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49d999be3293fd45 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:22.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:22.896+0000 7f33e7e00640 1 -- 172.21.15.135:0/3401907447 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0007740 con 0x7f33e806d550 2024-05-14T10:12:23.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.029+0000 7f33e7e00640 1 -- 172.21.15.135:0/3401907447 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e00078e0 con 0x7f33e806d550 2024-05-14T10:12:23.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.029+0000 7f33e7e00640 1 -- 172.21.15.135:0/3401907447 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0007cb0 con 0x7f33e806d550 2024-05-14T10:12:23.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.030+0000 7f33eec00640 1 -- 172.21.15.135:0/3401907447 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33e806d550 msgr2=0x7f33e806d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:23.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.030+0000 7f33eec00640 1 --2- 172.21.15.135:0/3401907447 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33e806d550 0x7f33e806d960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009d90 tx=0x7f33e002a6f0 comp rx=0 tx=0).stop 2024-05-14T10:12:23.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.030+0000 7f33eec00640 1 -- 172.21.15.135:0/3401907447 shutdown_connections 2024-05-14T10:12:23.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.030+0000 7f33eec00640 1 --2- 172.21.15.135:0/3401907447 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33e806d550 0x7f33e806d960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:23.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.030+0000 7f33eec00640 1 --2- 172.21.15.135:0/3401907447 >> v2:172.21.15.196:3300/0 conn(0x7f33e80c66d0 0x7f33e80cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:23.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.030+0000 7f33eec00640 1 -- 172.21.15.135:0/3401907447 >> 172.21.15.135:0/3401907447 conn(0x7f33e80ce650 msgr2=0x7f33e80cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:23.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.031+0000 7f33eec00640 1 -- 172.21.15.135:0/3401907447 shutdown_connections 2024-05-14T10:12:23.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.031+0000 7f33eec00640 1 -- 172.21.15.135:0/3401907447 wait complete. 2024-05-14T10:12:23.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.037+0000 7f33eec00640 1 Processor -- start 2024-05-14T10:12:23.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.037+0000 7f33eec00640 1 -- start start 2024-05-14T10:12:23.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.041+0000 7f33eec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33e806d550 0x7f33e80cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:23.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.041+0000 7f33eec00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80c66d0 0x7f33e8150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:23.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.041+0000 7f33eec00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33e8152df0 0x7f33e814df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:23.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.041+0000 7f33eec00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33e806dea0 con 0x7f33e80c66d0 2024-05-14T10:12:23.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.041+0000 7f33eec00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f33e806d030 con 0x7f33e8152df0 2024-05-14T10:12:23.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.041+0000 7f33eec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f33e80cd540 con 0x7f33e806d550 2024-05-14T10:12:23.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.042+0000 7f33ece00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80c66d0 0x7f33e8150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:23.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.043+0000 7f33ece00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80c66d0 0x7f33e8150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44766/0 (socket says 172.21.15.135:44766) 2024-05-14T10:12:23.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.043+0000 7f33ece00640 1 -- 172.21.15.135:0/647041027 learned_addr learned my addr 172.21.15.135:0/647041027 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:23.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.043+0000 7f33ed800640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33e806d550 0x7f33e80cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:23.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.047+0000 7f33ee200640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33e8152df0 0x7f33e814df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:23.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.050+0000 7f33ece00640 1 -- 172.21.15.135:0/647041027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33e806d550 msgr2=0x7f33e80cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:23.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.050+0000 7f33ece00640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33e806d550 0x7f33e80cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:23.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.050+0000 7f33ece00640 1 -- 172.21.15.135:0/647041027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33e8152df0 msgr2=0x7f33e814df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:23.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.050+0000 7f33ece00640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33e8152df0 0x7f33e814df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:23.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.050+0000 7f33ece00640 1 -- 172.21.15.135:0/647041027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e815b500 con 0x7f33e80c66d0 2024-05-14T10:12:23.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.053+0000 7f33ece00640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80c66d0 0x7f33e8150360 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f33d400c3a0 tx=0x7f33d400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.063+0000 7f33e5600640 1 -- 172.21.15.135:0/647041027 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d4017070 con 0x7f33e80c66d0 2024-05-14T10:12:23.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.063+0000 7f33e5600640 1 -- 172.21.15.135:0/647041027 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33d40052d0 con 0x7f33e80c66d0 2024-05-14T10:12:23.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.063+0000 7f33e5600640 1 -- 172.21.15.135:0/647041027 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d4003830 con 0x7f33e80c66d0 2024-05-14T10:12:23.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.063+0000 7f33eec00640 1 -- 172.21.15.135:0/647041027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e80c9980 con 0x7f33e80c66d0 2024-05-14T10:12:23.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.063+0000 7f33eec00640 1 -- 172.21.15.135:0/647041027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e80c9c20 con 0x7f33e80c66d0 2024-05-14T10:12:23.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.065+0000 7f33eec00640 1 -- 172.21.15.135:0/647041027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e8069980 con 0x7f33e80c66d0 2024-05-14T10:12:23.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.423+0000 7f33e5600640 1 -- 172.21.15.135:0/647041027 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f33d401a070 con 0x7f33e80c66d0 2024-05-14T10:12:23.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.425+0000 7f33e5600640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33c8076350 0x7f33c8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:23.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.425+0000 7f33ed800640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33c8076350 0x7f33c8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:23.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.427+0000 7f33ed800640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33c8076350 0x7f33c8078860 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009b30 tx=0x7f33dc009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:23.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.462+0000 7f33e5600640 1 -- 172.21.15.135:0/647041027 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f33d405bfe0 con 0x7f33e80c66d0 2024-05-14T10:12:23.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.463+0000 7f33e5600640 1 -- 172.21.15.135:0/647041027 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f33d4021080 con 0x7f33e80c66d0 2024-05-14T10:12:23.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.685+0000 7f33eec00640 1 -- 172.21.15.135:0/647041027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33e80cd9c0 con 0x7f33e80c66d0 2024-05-14T10:12:23.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.774+0000 7f33e5600640 1 -- 172.21.15.135:0/647041027 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+18997 (secure 0 0 0) 0x7f33d4068390 con 0x7f33e80c66d0 2024-05-14T10:12:23.776 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T10:12:23.777 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":33,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:41:04.087625+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:40:40.770106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:40:43.375791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:40:51.210089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T10:12:23.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.778+0000 7f33eec00640 1 -- 172.21.15.135:0/647041027 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33c8076350 msgr2=0x7f33c8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:23.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.778+0000 7f33eec00640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33c8076350 0x7f33c8078860 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009b30 tx=0x7f33dc009240 comp rx=0 tx=0).stop 2024-05-14T10:12:23.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.778+0000 7f33eec00640 1 -- 172.21.15.135:0/647041027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80c66d0 msgr2=0x7f33e8150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:23.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.778+0000 7f33eec00640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80c66d0 0x7f33e8150360 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f33d400c3a0 tx=0x7f33d400c860 comp rx=0 tx=0).stop 2024-05-14T10:12:23.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.778+0000 7f33eec00640 1 -- 172.21.15.135:0/647041027 shutdown_connections 2024-05-14T10:12:23.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.778+0000 7f33eec00640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33c8076350 0x7f33c8078860 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:23.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.778+0000 7f33eec00640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33e8152df0 0x7f33e814df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:23.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.778+0000 7f33eec00640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33e80c66d0 0x7f33e8150360 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:23.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.778+0000 7f33eec00640 1 --2- 172.21.15.135:0/647041027 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33e806d550 0x7f33e80cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:23.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.778+0000 7f33eec00640 1 -- 172.21.15.135:0/647041027 >> 172.21.15.135:0/647041027 conn(0x7f33e80ce650 msgr2=0x7f33e80d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:23.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.779+0000 7f33eec00640 1 -- 172.21.15.135:0/647041027 shutdown_connections 2024-05-14T10:12:23.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:23.779+0000 7f33eec00640 1 -- 172.21.15.135:0/647041027 wait complete. 2024-05-14T10:12:24.809 INFO:tasks.ceph:Scrubbing osd.0 2024-05-14T10:12:24.809 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:12:25.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.086+0000 7fb316000640 1 Processor -- start 2024-05-14T10:12:25.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.086+0000 7fb316000640 1 -- start start 2024-05-14T10:12:25.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.088+0000 7fb316000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb31015ab20 0x7fb310153f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.088+0000 7fb316000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb310071f70 0x7fb31006d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.088+0000 7fb316000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb310074ce0 con 0x7fb3101544b0 2024-05-14T10:12:25.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.088+0000 7fb316000640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fb31006cde0 con 0x7fb31015ab20 2024-05-14T10:12:25.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.088+0000 7fb316000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb310074a00 con 0x7fb310071f70 2024-05-14T10:12:25.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.089+0000 7fb30f400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb31015ab20 0x7fb310153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.090+0000 7fb30f400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb31015ab20 0x7fb310153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57092/0 (socket says 172.21.15.135:57092) 2024-05-14T10:12:25.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.090+0000 7fb30ea00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fb3101544b0 0x7fb3100c6c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:39746/0 (socket says 172.21.15.135:39746) 2024-05-14T10:12:25.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.090+0000 7fb30f400640 1 -- 172.21.15.135:0/2257736700 learned_addr learned my addr 172.21.15.135:0/2257736700 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:25.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.090+0000 7fb30fe00640 1 --2- 172.21.15.135:0/2257736700 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb310071f70 0x7fb31006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.093+0000 7fb30f400640 1 -- 172.21.15.135:0/2257736700 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb310071f70 msgr2=0x7fb31006d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:25.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.093+0000 7fb30f400640 1 --2- 172.21.15.135:0/2257736700 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb310071f70 0x7fb31006d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:25.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.093+0000 7fb30f400640 1 -- 172.21.15.135:0/2257736700 >> v1:172.21.15.196:6789/0 conn(0x7fb3101544b0 legacy=0x7fb3100c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.093+0000 7fb30f400640 1 -- 172.21.15.135:0/2257736700 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31006c790 con 0x7fb31015ab20 2024-05-14T10:12:25.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.096+0000 7fb30f400640 1 --2- 172.21.15.135:0/2257736700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb31015ab20 0x7fb310153f70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb300009870 tx=0x7fb30002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8afbeadf177874 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:25.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.101+0000 7fb30e000640 1 -- 172.21.15.135:0/2257736700 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300037070 con 0x7fb31015ab20 2024-05-14T10:12:25.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.101+0000 7fb30e000640 1 -- 172.21.15.135:0/2257736700 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb300032440 con 0x7fb31015ab20 2024-05-14T10:12:25.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.101+0000 7fb30e000640 1 -- 172.21.15.135:0/2257736700 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300032810 con 0x7fb31015ab20 2024-05-14T10:12:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.102+0000 7fb316000640 1 -- 172.21.15.135:0/2257736700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb31015ab20 msgr2=0x7fb310153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.102+0000 7fb316000640 1 --2- 172.21.15.135:0/2257736700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb31015ab20 0x7fb310153f70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb300009870 tx=0x7fb30002a270 comp rx=0 tx=0).stop 2024-05-14T10:12:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.102+0000 7fb316000640 1 -- 172.21.15.135:0/2257736700 shutdown_connections 2024-05-14T10:12:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.102+0000 7fb316000640 1 --2- 172.21.15.135:0/2257736700 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb310071f70 0x7fb31006d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.102+0000 7fb316000640 1 --2- 172.21.15.135:0/2257736700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb31015ab20 0x7fb310153f70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.102+0000 7fb316000640 1 -- 172.21.15.135:0/2257736700 >> 172.21.15.135:0/2257736700 conn(0x7fb310073d40 msgr2=0x7fb310074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.103+0000 7fb316000640 1 -- 172.21.15.135:0/2257736700 shutdown_connections 2024-05-14T10:12:25.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.103+0000 7fb316000640 1 -- 172.21.15.135:0/2257736700 wait complete. 2024-05-14T10:12:25.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.105+0000 7fb316000640 1 Processor -- start 2024-05-14T10:12:25.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.106+0000 7fb316000640 1 -- start start 2024-05-14T10:12:25.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.107+0000 7fb316000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb310071f70 0x7fb310152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.107+0000 7fb316000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3101544b0 0x7fb3100c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.107+0000 7fb316000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb31015ab20 0x7fb31014b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.107+0000 7fb316000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3100c7380 con 0x7fb3101544b0 2024-05-14T10:12:25.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.107+0000 7fb316000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb3100c4690 con 0x7fb31015ab20 2024-05-14T10:12:25.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.107+0000 7fb316000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb3100c7500 con 0x7fb310071f70 2024-05-14T10:12:25.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.108+0000 7fb30ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3101544b0 0x7fb3100c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.108+0000 7fb30ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3101544b0 0x7fb3100c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57102/0 (socket says 172.21.15.135:57102) 2024-05-14T10:12:25.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.108+0000 7fb30ea00640 1 -- 172.21.15.135:0/2413428956 learned_addr learned my addr 172.21.15.135:0/2413428956 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:25.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.109+0000 7fb30fe00640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb31015ab20 0x7fb31014b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.109+0000 7fb30f400640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb310071f70 0x7fb310152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.113+0000 7fb30ea00640 1 -- 172.21.15.135:0/2413428956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb310071f70 msgr2=0x7fb310152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.113+0000 7fb30ea00640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb310071f70 0x7fb310152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:25.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.113+0000 7fb30ea00640 1 -- 172.21.15.135:0/2413428956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb31015ab20 msgr2=0x7fb31014b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.113+0000 7fb30ea00640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb31015ab20 0x7fb31014b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:25.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.113+0000 7fb30ea00640 1 -- 172.21.15.135:0/2413428956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31015a6b0 con 0x7fb3101544b0 2024-05-14T10:12:25.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.115+0000 7fb30ea00640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3101544b0 0x7fb3100c6670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c700 tx=0x7fb2fc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:25.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.120+0000 7fb307400640 1 -- 172.21.15.135:0/2413428956 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc018070 con 0x7fb3101544b0 2024-05-14T10:12:25.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.120+0000 7fb307400640 1 -- 172.21.15.135:0/2413428956 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc004d60 con 0x7fb3101544b0 2024-05-14T10:12:25.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.120+0000 7fb307400640 1 -- 172.21.15.135:0/2413428956 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00a800 con 0x7fb3101544b0 2024-05-14T10:12:25.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.120+0000 7fb316000640 1 -- 172.21.15.135:0/2413428956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3101f19d0 con 0x7fb3101544b0 2024-05-14T10:12:25.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.121+0000 7fb316000640 1 -- 172.21.15.135:0/2413428956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3101ee660 con 0x7fb3101544b0 2024-05-14T10:12:25.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.122+0000 7fb316000640 1 -- 172.21.15.135:0/2413428956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb3101f2090 con 0x7fb3101544b0 2024-05-14T10:12:25.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.147+0000 7fb307400640 1 -- 172.21.15.135:0/2413428956 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb2fc01b070 con 0x7fb3101544b0 2024-05-14T10:12:25.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.148+0000 7fb307400640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb2f0076350 0x7fb2f0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.149+0000 7fb30f400640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb2f0076350 0x7fb2f0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.149+0000 7fb307400640 1 -- 172.21.15.135:0/2413428956 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fb2fc05c780 con 0x7fb3101544b0 2024-05-14T10:12:25.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.150+0000 7fb307400640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] conn(0x7fb2f007fe30 0x7fb2f0082320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.150+0000 7fb307400640 1 -- 172.21.15.135:0/2413428956 --> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2f00829f0 con 0x7fb2f007fe30 2024-05-14T10:12:25.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.150+0000 7fb30f400640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb2f0076350 0x7fb2f0078860 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb300034000 tx=0x7fb30002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:25.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.150+0000 7fb30fe00640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] conn(0x7fb2f007fe30 0x7fb2f0082320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.151+0000 7fb30fe00640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] conn(0x7fb2f007fe30 0x7fb2f0082320 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:25.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.152+0000 7fb307400640 1 -- 172.21.15.135:0/2413428956 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb2fc05cb40 con 0x7fb3101544b0 2024-05-14T10:12:25.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.152+0000 7fb307400640 1 -- 172.21.15.135:0/2413428956 <== osd.0 v2:172.21.15.135:6810/2395598420 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb2f00829f0 con 0x7fb2f007fe30 2024-05-14T10:12:25.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.167+0000 7fb316000640 1 -- 172.21.15.135:0/2413428956 --> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb3100c7c50 con 0x7fb2f007fe30 2024-05-14T10:12:25.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.167+0000 7fb307400640 1 -- 172.21.15.135:0/2413428956 <== osd.0 v2:172.21.15.135:6810/2395598420 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb3100c7c50 con 0x7fb2f007fe30 2024-05-14T10:12:25.168 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T10:12:25.168 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:12:25.168 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T10:12:25.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.168+0000 7fb316000640 1 -- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] conn(0x7fb2f007fe30 msgr2=0x7fb2f0082320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.168+0000 7fb316000640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:6810/2395598420,v1:172.21.15.135:6811/2395598420] conn(0x7fb2f007fe30 0x7fb2f0082320 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:25.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.168+0000 7fb316000640 1 -- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb2f0076350 msgr2=0x7fb2f0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.168+0000 7fb316000640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb2f0076350 0x7fb2f0078860 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb300034000 tx=0x7fb30002e000 comp rx=0 tx=0).stop 2024-05-14T10:12:25.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.168+0000 7fb316000640 1 -- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3101544b0 msgr2=0x7fb3100c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.168+0000 7fb316000640 1 --2- 172.21.15.135:0/2413428956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3101544b0 0x7fb3100c6670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c700 tx=0x7fb2fc00cbc0 comp rx=0 tx=0).stop 2024-05-14T10:12:25.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.168+0000 7fb30fe00640 1 -- 172.21.15.135:0/2413428956 reap_dead start 2024-05-14T10:12:25.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.169+0000 7fb316000640 1 -- 172.21.15.135:0/2413428956 shutdown_connections 2024-05-14T10:12:25.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.169+0000 7fb316000640 1 -- 172.21.15.135:0/2413428956 >> 172.21.15.135:0/2413428956 conn(0x7fb310073d40 msgr2=0x7fb310153420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:25.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.169+0000 7fb316000640 1 -- 172.21.15.135:0/2413428956 shutdown_connections 2024-05-14T10:12:25.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.169+0000 7fb316000640 1 -- 172.21.15.135:0/2413428956 wait complete. 2024-05-14T10:12:25.197 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-14T10:12:25.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.468+0000 7f865ec00640 1 Processor -- start 2024-05-14T10:12:25.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.468+0000 7f865ec00640 1 -- start start 2024-05-14T10:12:25.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.470+0000 7f865ec00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8658152ed0 0x7f86581532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.471+0000 7f865ec00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86580c5900 con 0x7f86580c60a0 2024-05-14T10:12:25.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.471+0000 7f865ec00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f865815d290 con 0x7f865815cd20 2024-05-14T10:12:25.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.471+0000 7f865ec00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f865815a510 con 0x7f8658152ed0 2024-05-14T10:12:25.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.472+0000 7f864f400640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f86580c60a0 0x7f865815c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:33838/0 (socket says 172.21.15.135:33838) 2024-05-14T10:12:25.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.472+0000 7f864f400640 1 -- 172.21.15.135:0/4153934784 learned_addr learned my addr 172.21.15.135:0/4153934784 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:25.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.472+0000 7f8657e00640 1 --2- 172.21.15.135:0/4153934784 >> v2:172.21.15.135:3300/0 conn(0x7f8658152ed0 0x7f86581532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.479+0000 7f8657e00640 1 -- 172.21.15.135:0/4153934784 >> v1:172.21.15.196:6789/0 conn(0x7f865815cd20 legacy=0x7f86581639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.479+0000 7f8657e00640 1 -- 172.21.15.135:0/4153934784 >> v1:172.21.15.135:6789/0 conn(0x7f86580c60a0 legacy=0x7f865815c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.479+0000 7f8657e00640 1 -- 172.21.15.135:0/4153934784 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865806c940 con 0x7f8658152ed0 2024-05-14T10:12:25.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.483+0000 7f8657e00640 1 --2- 172.21.15.135:0/4153934784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8658152ed0 0x7f86581532e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f865815d460 tx=0x7f864802c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abaef17a263247b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:25.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.496+0000 7f8657400640 1 -- 172.21.15.135:0/4153934784 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648036020 con 0x7f8658152ed0 2024-05-14T10:12:25.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.496+0000 7f8657400640 1 -- 172.21.15.135:0/4153934784 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8648032870 con 0x7f8658152ed0 2024-05-14T10:12:25.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.496+0000 7f8657400640 1 -- 172.21.15.135:0/4153934784 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648032c40 con 0x7f8658152ed0 2024-05-14T10:12:25.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.497+0000 7f865ec00640 1 -- 172.21.15.135:0/4153934784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8658152ed0 msgr2=0x7f86581532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.497+0000 7f865ec00640 1 --2- 172.21.15.135:0/4153934784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8658152ed0 0x7f86581532e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f865815d460 tx=0x7f864802c9b0 comp rx=0 tx=0).stop 2024-05-14T10:12:25.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.497+0000 7f865ec00640 1 -- 172.21.15.135:0/4153934784 shutdown_connections 2024-05-14T10:12:25.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.497+0000 7f865ec00640 1 --2- 172.21.15.135:0/4153934784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8658152ed0 0x7f86581532e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:25.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.497+0000 7f865ec00640 1 -- 172.21.15.135:0/4153934784 >> 172.21.15.135:0/4153934784 conn(0x7f8658073d40 msgr2=0x7f8658074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:25.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.497+0000 7f865ec00640 1 -- 172.21.15.135:0/4153934784 shutdown_connections 2024-05-14T10:12:25.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.497+0000 7f865ec00640 1 -- 172.21.15.135:0/4153934784 wait complete. 2024-05-14T10:12:25.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.500+0000 7f865ec00640 1 Processor -- start 2024-05-14T10:12:25.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.500+0000 7f865ec00640 1 -- start start 2024-05-14T10:12:25.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.502+0000 7f865ec00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86580c60a0 0x7f8658151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.502+0000 7f865ec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8658152ed0 0x7f86581f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.502+0000 7f865ec00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f865815cd20 0x7f86581485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.502+0000 7f865ec00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f86580c5c10 con 0x7f865815cd20 2024-05-14T10:12:25.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.502+0000 7f865ec00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f865806c6f0 con 0x7f86580c60a0 2024-05-14T10:12:25.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.502+0000 7f865ec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f86580c4a60 con 0x7f8658152ed0 2024-05-14T10:12:25.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.503+0000 7f865cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f865815cd20 0x7f86581485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.503+0000 7f865cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f865815cd20 0x7f86581485c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57118/0 (socket says 172.21.15.135:57118) 2024-05-14T10:12:25.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.504+0000 7f865cc00640 1 -- 172.21.15.135:0/1137773802 learned_addr learned my addr 172.21.15.135:0/1137773802 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:25.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.505+0000 7f864f400640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8658152ed0 0x7f86581f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.505+0000 7f8657e00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86580c60a0 0x7f8658151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.508+0000 7f865cc00640 1 -- 172.21.15.135:0/1137773802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8658152ed0 msgr2=0x7f86581f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.508+0000 7f865cc00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8658152ed0 0x7f86581f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:25.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.508+0000 7f865cc00640 1 -- 172.21.15.135:0/1137773802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86580c60a0 msgr2=0x7f8658151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:25.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.508+0000 7f865cc00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86580c60a0 0x7f8658151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:25.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.508+0000 7f865cc00640 1 -- 172.21.15.135:0/1137773802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865814f2e0 con 0x7f865815cd20 2024-05-14T10:12:25.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.508+0000 7f864f400640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8658152ed0 0x7f86581f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T10:12:25.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.513+0000 7f865cc00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f865815cd20 0x7f86581485c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f865000c3f0 tx=0x7f865000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.620+0000 7f8654c00640 1 -- 172.21.15.135:0/1137773802 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650017070 con 0x7f865815cd20 2024-05-14T10:12:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.620+0000 7f8654c00640 1 -- 172.21.15.135:0/1137773802 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86500052d0 con 0x7f865815cd20 2024-05-14T10:12:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.620+0000 7f8654c00640 1 -- 172.21.15.135:0/1137773802 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650003810 con 0x7f865815cd20 2024-05-14T10:12:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.621+0000 7f865ec00640 1 -- 172.21.15.135:0/1137773802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86581f2c50 con 0x7f865815cd20 2024-05-14T10:12:25.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.621+0000 7f865ec00640 1 -- 172.21.15.135:0/1137773802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86581f6f50 con 0x7f865815cd20 2024-05-14T10:12:25.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.622+0000 7f865ec00640 1 -- 172.21.15.135:0/1137773802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8658069a60 con 0x7f865815cd20 2024-05-14T10:12:25.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.981+0000 7f8654c00640 1 -- 172.21.15.135:0/1137773802 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f865001a070 con 0x7f865815cd20 2024-05-14T10:12:25.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.984+0000 7f8654c00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8634076320 0x7f8634078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:25.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.985+0000 7f8657e00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8634076320 0x7f8634078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:25.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:25.987+0000 7f8657e00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8634076320 0x7f8634078830 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8648037000 tx=0x7f864800d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:26.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.009+0000 7f8654c00640 1 -- 172.21.15.135:0/1137773802 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f865005c330 con 0x7f865815cd20 2024-05-14T10:12:26.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.011+0000 7f8654c00640 1 -- 172.21.15.135:0/1137773802 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8650021020 con 0x7f865815cd20 2024-05-14T10:12:26.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.244+0000 7f865ec00640 1 -- 172.21.15.135:0/1137773802 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f8658073b20 con 0x7f8634076320 2024-05-14T10:12:26.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.246+0000 7f8654c00640 1 -- 172.21.15.135:0/1137773802 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8658073b20 con 0x7f8634076320 2024-05-14T10:12:26.246 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 0 to deep-scrub 2024-05-14T10:12:26.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 -- 172.21.15.135:0/1137773802 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8634076320 msgr2=0x7f8634078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:26.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8634076320 0x7f8634078830 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8648037000 tx=0x7f864800d040 comp rx=0 tx=0).stop 2024-05-14T10:12:26.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 -- 172.21.15.135:0/1137773802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f865815cd20 msgr2=0x7f86581485c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:26.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f865815cd20 0x7f86581485c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f865000c3f0 tx=0x7f865000c8b0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 -- 172.21.15.135:0/1137773802 shutdown_connections 2024-05-14T10:12:26.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8634076320 0x7f8634078830 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f865815cd20 0x7f86581485c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8658152ed0 0x7f86581f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 --2- 172.21.15.135:0/1137773802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86580c60a0 0x7f8658151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 -- 172.21.15.135:0/1137773802 >> 172.21.15.135:0/1137773802 conn(0x7f8658073d40 msgr2=0x7f865814aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:26.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 -- 172.21.15.135:0/1137773802 shutdown_connections 2024-05-14T10:12:26.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.249+0000 7f865ec00640 1 -- 172.21.15.135:0/1137773802 wait complete. 2024-05-14T10:12:26.278 INFO:tasks.ceph:Scrubbing osd.1 2024-05-14T10:12:26.279 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:12:26.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.556+0000 7ffbdce00640 1 Processor -- start 2024-05-14T10:12:26.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.556+0000 7ffbdce00640 1 -- start start 2024-05-14T10:12:26.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.558+0000 7ffbdce00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffbd8158ec0 0x7ffbd81530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:26.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.558+0000 7ffbdce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd80c8680 0x7ffbd80c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:26.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.559+0000 7ffbdce00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd81535f0 con 0x7ffbd8071a70 2024-05-14T10:12:26.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.559+0000 7ffbdce00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ffbd80c8fd0 con 0x7ffbd8158ec0 2024-05-14T10:12:26.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.559+0000 7ffbdce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd8159470 con 0x7ffbd80c8680 2024-05-14T10:12:26.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.561+0000 7ffbd7e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd80c8680 0x7ffbd80c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:26.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.562+0000 7ffbd7400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffbd8158ec0 0x7ffbd81530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:26.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.562+0000 7ffbd6a00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ffbd8071a70 0x7ffbd8070b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:39762/0 (socket says 172.21.15.135:39762) 2024-05-14T10:12:26.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.562+0000 7ffbd6a00640 1 -- 172.21.15.135:0/2444613548 learned_addr learned my addr 172.21.15.135:0/2444613548 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:26.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.569+0000 7ffbd7e00640 1 -- 172.21.15.135:0/2444613548 >> v2:172.21.15.196:3300/0 conn(0x7ffbd8158ec0 msgr2=0x7ffbd81530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.569+0000 7ffbd7e00640 1 --2- 172.21.15.135:0/2444613548 >> v2:172.21.15.196:3300/0 conn(0x7ffbd8158ec0 0x7ffbd81530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.569+0000 7ffbd7e00640 1 -- 172.21.15.135:0/2444613548 >> v1:172.21.15.196:6789/0 conn(0x7ffbd8071a70 legacy=0x7ffbd8070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:26.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.569+0000 7ffbd7e00640 1 -- 172.21.15.135:0/2444613548 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd8159730 con 0x7ffbd80c8680 2024-05-14T10:12:26.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.575+0000 7ffbd7e00640 1 --2- 172.21.15.135:0/2444613548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd80c8680 0x7ffbd80c8a90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009d90 tx=0x7ffbd002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7fb9f0c71222906 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:26.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.586+0000 7ffbd6000640 1 -- 172.21.15.135:0/2444613548 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0007740 con 0x7ffbd80c8680 2024-05-14T10:12:26.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.586+0000 7ffbd6000640 1 -- 172.21.15.135:0/2444613548 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd00078e0 con 0x7ffbd80c8680 2024-05-14T10:12:26.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.586+0000 7ffbd6000640 1 -- 172.21.15.135:0/2444613548 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0007cb0 con 0x7ffbd80c8680 2024-05-14T10:12:26.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.587+0000 7ffbdce00640 1 -- 172.21.15.135:0/2444613548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd80c8680 msgr2=0x7ffbd80c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:26.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.587+0000 7ffbdce00640 1 --2- 172.21.15.135:0/2444613548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd80c8680 0x7ffbd80c8a90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0009d90 tx=0x7ffbd002a6f0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.587+0000 7ffbdce00640 1 -- 172.21.15.135:0/2444613548 shutdown_connections 2024-05-14T10:12:26.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.587+0000 7ffbdce00640 1 --2- 172.21.15.135:0/2444613548 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd80c8680 0x7ffbd80c8a90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.587+0000 7ffbdce00640 1 --2- 172.21.15.135:0/2444613548 >> v2:172.21.15.196:3300/0 conn(0x7ffbd8158ec0 0x7ffbd81530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.587+0000 7ffbdce00640 1 -- 172.21.15.135:0/2444613548 >> 172.21.15.135:0/2444613548 conn(0x7ffbd80ca160 msgr2=0x7ffbd80ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:26.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.587+0000 7ffbdce00640 1 -- 172.21.15.135:0/2444613548 shutdown_connections 2024-05-14T10:12:26.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.587+0000 7ffbdce00640 1 -- 172.21.15.135:0/2444613548 wait complete. 2024-05-14T10:12:26.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.591+0000 7ffbdce00640 1 Processor -- start 2024-05-14T10:12:26.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.591+0000 7ffbdce00640 1 -- start start 2024-05-14T10:12:26.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.593+0000 7ffbdce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd8071a70 0x7ffbd814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:26.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.593+0000 7ffbdce00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbd80c8680 0x7ffbd814b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:26.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.593+0000 7ffbdce00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd8158ec0 0x7ffbd814bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:26.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.593+0000 7ffbdce00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd80c7e80 con 0x7ffbd8071a70 2024-05-14T10:12:26.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.593+0000 7ffbdce00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd8159cf0 con 0x7ffbd80c8680 2024-05-14T10:12:26.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.593+0000 7ffbdce00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd80c8160 con 0x7ffbd8158ec0 2024-05-14T10:12:26.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.594+0000 7ffbd7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd8071a70 0x7ffbd814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:26.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.594+0000 7ffbd7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd8071a70 0x7ffbd814ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57120/0 (socket says 172.21.15.135:57120) 2024-05-14T10:12:26.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.594+0000 7ffbd7400640 1 -- 172.21.15.135:0/3294327432 learned_addr learned my addr 172.21.15.135:0/3294327432 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:26.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.595+0000 7ffbd6a00640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbd80c8680 0x7ffbd814b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:26.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.595+0000 7ffbd7e00640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd8158ec0 0x7ffbd814bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:26.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.599+0000 7ffbd7400640 1 -- 172.21.15.135:0/3294327432 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd8158ec0 msgr2=0x7ffbd814bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:26.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.599+0000 7ffbd7400640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbd8158ec0 0x7ffbd814bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.599+0000 7ffbd7400640 1 -- 172.21.15.135:0/3294327432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbd80c8680 msgr2=0x7ffbd814b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:26.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.599+0000 7ffbd7400640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbd80c8680 0x7ffbd814b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.599+0000 7ffbd7400640 1 -- 172.21.15.135:0/3294327432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd8156350 con 0x7ffbd8071a70 2024-05-14T10:12:26.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.603+0000 7ffbd7400640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd8071a70 0x7ffbd814ad70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800e8a0 tx=0x7ffbc800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:26.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.611+0000 7ffbcf400640 1 -- 172.21.15.135:0/3294327432 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8017070 con 0x7ffbd8071a70 2024-05-14T10:12:26.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.611+0000 7ffbcf400640 1 -- 172.21.15.135:0/3294327432 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc800c940 con 0x7ffbd8071a70 2024-05-14T10:12:26.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.611+0000 7ffbcf400640 1 -- 172.21.15.135:0/3294327432 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800cd30 con 0x7ffbd8071a70 2024-05-14T10:12:26.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.611+0000 7ffbdce00640 1 -- 172.21.15.135:0/3294327432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd81f3190 con 0x7ffbd8071a70 2024-05-14T10:12:26.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.611+0000 7ffbdce00640 1 -- 172.21.15.135:0/3294327432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd80cb700 con 0x7ffbd8071a70 2024-05-14T10:12:26.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.612+0000 7ffbdce00640 1 -- 172.21.15.135:0/3294327432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffbd8069980 con 0x7ffbd8071a70 2024-05-14T10:12:26.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.649+0000 7ffbcf400640 1 -- 172.21.15.135:0/3294327432 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffbc801a070 con 0x7ffbd8071a70 2024-05-14T10:12:26.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.651+0000 7ffbcf400640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffbb8076320 0x7ffbb8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:26.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.652+0000 7ffbd6a00640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffbb8076320 0x7ffbb8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:26.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.653+0000 7ffbd6a00640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffbb8076320 0x7ffbb8078830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80c3580 tx=0x7ffbc4007ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:26.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.688+0000 7ffbcf400640 1 -- 172.21.15.135:0/3294327432 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7ffbc805d180 con 0x7ffbd8071a70 2024-05-14T10:12:26.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.689+0000 7ffbcf400640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] conn(0x7ffbb807fe00 0x7ffbb80822f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:26.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.689+0000 7ffbcf400640 1 -- 172.21.15.135:0/3294327432 --> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffbb80829c0 con 0x7ffbb807fe00 2024-05-14T10:12:26.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.689+0000 7ffbcf400640 1 -- 172.21.15.135:0/3294327432 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ffbc805d540 con 0x7ffbd8071a70 2024-05-14T10:12:26.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.690+0000 7ffbd7e00640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] conn(0x7ffbb807fe00 0x7ffbb80822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:26.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.692+0000 7ffbd7e00640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] conn(0x7ffbb807fe00 0x7ffbb80822f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:26.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.694+0000 7ffbcf400640 1 -- 172.21.15.135:0/3294327432 <== osd.1 v2:172.21.15.135:6818/2447766167 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffbb80829c0 con 0x7ffbb807fe00 2024-05-14T10:12:26.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.712+0000 7ffbdce00640 1 -- 172.21.15.135:0/3294327432 --> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffbd80cb960 con 0x7ffbb807fe00 2024-05-14T10:12:26.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.713+0000 7ffbcf400640 1 -- 172.21.15.135:0/3294327432 <== osd.1 v2:172.21.15.135:6818/2447766167 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffbd80cb960 con 0x7ffbb807fe00 2024-05-14T10:12:26.713 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T10:12:26.714 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:12:26.714 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T10:12:26.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.714+0000 7ffbdce00640 1 -- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] conn(0x7ffbb807fe00 msgr2=0x7ffbb80822f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:26.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.714+0000 7ffbdce00640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:6818/2447766167,v1:172.21.15.135:6819/2447766167] conn(0x7ffbb807fe00 0x7ffbb80822f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.714+0000 7ffbdce00640 1 -- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffbb8076320 msgr2=0x7ffbb8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:26.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.714+0000 7ffbdce00640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ffbb8076320 0x7ffbb8078830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80c3580 tx=0x7ffbc4007ee0 comp rx=0 tx=0).stop 2024-05-14T10:12:26.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.714+0000 7ffbdce00640 1 -- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd8071a70 msgr2=0x7ffbd814ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:26.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.714+0000 7ffbdce00640 1 --2- 172.21.15.135:0/3294327432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffbd8071a70 0x7ffbd814ad70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800e8a0 tx=0x7ffbc800ed60 comp rx=0 tx=0).stop 2024-05-14T10:12:26.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.714+0000 7ffbd7e00640 1 -- 172.21.15.135:0/3294327432 reap_dead start 2024-05-14T10:12:26.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.714+0000 7ffbdce00640 1 -- 172.21.15.135:0/3294327432 shutdown_connections 2024-05-14T10:12:26.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.715+0000 7ffbdce00640 1 -- 172.21.15.135:0/3294327432 >> 172.21.15.135:0/3294327432 conn(0x7ffbd80ca160 msgr2=0x7ffbd806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:26.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.715+0000 7ffbdce00640 1 -- 172.21.15.135:0/3294327432 shutdown_connections 2024-05-14T10:12:26.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:26.715+0000 7ffbdce00640 1 -- 172.21.15.135:0/3294327432 wait complete. 2024-05-14T10:12:26.752 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-14T10:12:27.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.026+0000 7fdfaa800640 1 Processor -- start 2024-05-14T10:12:27.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.026+0000 7fdfaa800640 1 -- start start 2024-05-14T10:12:27.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.029+0000 7fdfaa800640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdfa4071f70 0x7fdfa40c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:27.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.029+0000 7fdfaa800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdfa40c71b0 0x7fdfa406d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:27.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.029+0000 7fdfaa800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa4074ce0 con 0x7fdfa415ab20 2024-05-14T10:12:27.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.029+0000 7fdfaa800640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa406cde0 con 0x7fdfa4071f70 2024-05-14T10:12:27.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.029+0000 7fdfaa800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa4074a00 con 0x7fdfa40c71b0 2024-05-14T10:12:27.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.031+0000 7fdfa3e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdfa40c71b0 0x7fdfa406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:27.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.032+0000 7fdf9be00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdfa4071f70 0x7fdfa40c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:27.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.033+0000 7fdf9be00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdfa4071f70 0x7fdfa40c6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57124/0 (socket says 172.21.15.135:57124) 2024-05-14T10:12:27.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.033+0000 7fdf9be00640 1 -- 172.21.15.135:0/2243130451 learned_addr learned my addr 172.21.15.135:0/2243130451 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.037+0000 7fdf9be00640 1 -- 172.21.15.135:0/2243130451 >> v2:172.21.15.196:3300/0 conn(0x7fdfa40c71b0 msgr2=0x7fdfa406d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.037+0000 7fdf9be00640 1 --2- 172.21.15.135:0/2243130451 >> v2:172.21.15.196:3300/0 conn(0x7fdfa40c71b0 0x7fdfa406d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.037+0000 7fdf9be00640 1 -- 172.21.15.135:0/2243130451 >> v1:172.21.15.196:6789/0 conn(0x7fdfa415ab20 legacy=0x7fdfa4153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.037+0000 7fdf9be00640 1 -- 172.21.15.135:0/2243130451 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa406c790 con 0x7fdfa4071f70 2024-05-14T10:12:27.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.040+0000 7fdf9be00640 1 --2- 172.21.15.135:0/2243130451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa4071f70 0x7fdfa40c6c70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdfa40b9920 tx=0x7fdf8c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fc16806265a252 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:27.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.051+0000 7fdfa2a00640 1 -- 172.21.15.135:0/2243130451 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c037070 con 0x7fdfa4071f70 2024-05-14T10:12:27.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.051+0000 7fdfa2a00640 1 -- 172.21.15.135:0/2243130451 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8c032440 con 0x7fdfa4071f70 2024-05-14T10:12:27.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.051+0000 7fdfa2a00640 1 -- 172.21.15.135:0/2243130451 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c032810 con 0x7fdfa4071f70 2024-05-14T10:12:27.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.052+0000 7fdfaa800640 1 -- 172.21.15.135:0/2243130451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa4071f70 msgr2=0x7fdfa40c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:27.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.052+0000 7fdfaa800640 1 --2- 172.21.15.135:0/2243130451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa4071f70 0x7fdfa40c6c70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdfa40b9920 tx=0x7fdf8c02a1e0 comp rx=0 tx=0).stop 2024-05-14T10:12:27.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.052+0000 7fdfaa800640 1 -- 172.21.15.135:0/2243130451 shutdown_connections 2024-05-14T10:12:27.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.052+0000 7fdfaa800640 1 --2- 172.21.15.135:0/2243130451 >> v2:172.21.15.196:3300/0 conn(0x7fdfa40c71b0 0x7fdfa406d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:27.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.052+0000 7fdfaa800640 1 --2- 172.21.15.135:0/2243130451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa4071f70 0x7fdfa40c6c70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:27.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.052+0000 7fdfaa800640 1 -- 172.21.15.135:0/2243130451 >> 172.21.15.135:0/2243130451 conn(0x7fdfa4073d40 msgr2=0x7fdfa4074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:27.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.052+0000 7fdfaa800640 1 -- 172.21.15.135:0/2243130451 shutdown_connections 2024-05-14T10:12:27.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.052+0000 7fdfaa800640 1 -- 172.21.15.135:0/2243130451 wait complete. 2024-05-14T10:12:27.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.055+0000 7fdfaa800640 1 Processor -- start 2024-05-14T10:12:27.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.055+0000 7fdfaa800640 1 -- start start 2024-05-14T10:12:27.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.057+0000 7fdfaa800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfa4071f70 0x7fdfa41f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:27.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.057+0000 7fdfaa800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdfa40c71b0 0x7fdfa41e5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:27.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.057+0000 7fdfaa800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa415ab20 0x7fdfa4159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:27.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.057+0000 7fdfaa800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa40c4690 con 0x7fdfa415ab20 2024-05-14T10:12:27.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.057+0000 7fdfaa800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa4154680 con 0x7fdfa4071f70 2024-05-14T10:12:27.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.057+0000 7fdfaa800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa406d7b0 con 0x7fdfa40c71b0 2024-05-14T10:12:27.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.059+0000 7fdfa3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfa4071f70 0x7fdfa41f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:27.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.059+0000 7fdf9be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdfa40c71b0 0x7fdfa41e5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:27.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.060+0000 7fdfa3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfa4071f70 0x7fdfa41f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:35916/0 (socket says 172.21.15.135:35916) 2024-05-14T10:12:27.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.060+0000 7fdfa3400640 1 -- 172.21.15.135:0/3430158402 learned_addr learned my addr 172.21.15.135:0/3430158402 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:27.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.063+0000 7fdfa3e00640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa415ab20 0x7fdfa4159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:27.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.071+0000 7fdfa3400640 1 -- 172.21.15.135:0/3430158402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdfa40c71b0 msgr2=0x7fdfa41e5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:27.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.071+0000 7fdfa3400640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdfa40c71b0 0x7fdfa41e5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:27.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.071+0000 7fdfa3400640 1 -- 172.21.15.135:0/3430158402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa415ab20 msgr2=0x7fdfa4159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:27.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.071+0000 7fdfa3400640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa415ab20 0x7fdfa4159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:27.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.071+0000 7fdfa3400640 1 -- 172.21.15.135:0/3430158402 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa41e6310 con 0x7fdfa4071f70 2024-05-14T10:12:27.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.079+0000 7fdfa3400640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfa4071f70 0x7fdfa41f56f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400b420 tx=0x7fdf9400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:27.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.229+0000 7fdf9b400640 1 -- 172.21.15.135:0/3430158402 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94011830 con 0x7fdfa4071f70 2024-05-14T10:12:27.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.229+0000 7fdf9b400640 1 -- 172.21.15.135:0/3430158402 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf94016070 con 0x7fdfa4071f70 2024-05-14T10:12:27.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.229+0000 7fdf9b400640 1 -- 172.21.15.135:0/3430158402 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94011c10 con 0x7fdfa4071f70 2024-05-14T10:12:27.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.230+0000 7fdfaa800640 1 -- 172.21.15.135:0/3430158402 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa415b300 con 0x7fdfa4071f70 2024-05-14T10:12:27.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.230+0000 7fdfaa800640 1 -- 172.21.15.135:0/3430158402 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa415b5a0 con 0x7fdfa4071f70 2024-05-14T10:12:27.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.232+0000 7fdfaa800640 1 -- 172.21.15.135:0/3430158402 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa4069a60 con 0x7fdfa4071f70 2024-05-14T10:12:27.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.614+0000 7fdf9b400640 1 -- 172.21.15.135:0/3430158402 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdf94004020 con 0x7fdfa4071f70 2024-05-14T10:12:27.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.616+0000 7fdf9b400640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fdf80076320 0x7fdf80078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:27.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.617+0000 7fdf9be00640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fdf80076320 0x7fdf80078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:27.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.619+0000 7fdf9be00640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fdf80076320 0x7fdf80078830 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c034000 tx=0x7fdf8c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:27.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.624+0000 7fdf9b400640 1 -- 172.21.15.135:0/3430158402 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fdf94004310 con 0x7fdfa4071f70 2024-05-14T10:12:27.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.656+0000 7fdf9b400640 1 -- 172.21.15.135:0/3430158402 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdfa415b300 con 0x7fdfa4071f70 2024-05-14T10:12:27.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.887+0000 7fdfaa800640 1 -- 172.21.15.135:0/3430158402 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fdfa41e5f80 con 0x7fdf80076320 2024-05-14T10:12:27.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.888+0000 7fdf9b400640 1 -- 172.21.15.135:0/3430158402 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdfa41e5f80 con 0x7fdf80076320 2024-05-14T10:12:27.889 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 1 to deep-scrub 2024-05-14T10:12:27.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.891+0000 7fdfaa800640 1 -- 172.21.15.135:0/3430158402 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fdf80076320 msgr2=0x7fdf80078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:27.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.891+0000 7fdfaa800640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fdf80076320 0x7fdf80078830 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c034000 tx=0x7fdf8c02e000 comp rx=0 tx=0).stop 2024-05-14T10:12:27.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.891+0000 7fdfaa800640 1 -- 172.21.15.135:0/3430158402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfa4071f70 msgr2=0x7fdfa41f56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:27.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.891+0000 7fdfaa800640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfa4071f70 0x7fdfa41f56f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400b420 tx=0x7fdf9400b8e0 comp rx=0 tx=0).stop 2024-05-14T10:12:27.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.891+0000 7fdfaa800640 1 -- 172.21.15.135:0/3430158402 shutdown_connections 2024-05-14T10:12:27.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.891+0000 7fdfaa800640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fdf80076320 0x7fdf80078830 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:27.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.891+0000 7fdfaa800640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfa415ab20 0x7fdfa4159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:27.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.891+0000 7fdfaa800640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdfa40c71b0 0x7fdfa41e5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:27.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.891+0000 7fdfaa800640 1 --2- 172.21.15.135:0/3430158402 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfa4071f70 0x7fdfa41f56f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:27.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.891+0000 7fdfaa800640 1 -- 172.21.15.135:0/3430158402 >> 172.21.15.135:0/3430158402 conn(0x7fdfa4073d40 msgr2=0x7fdfa40cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:27.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.892+0000 7fdfaa800640 1 -- 172.21.15.135:0/3430158402 shutdown_connections 2024-05-14T10:12:27.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:27.892+0000 7fdfaa800640 1 -- 172.21.15.135:0/3430158402 wait complete. 2024-05-14T10:12:27.922 INFO:tasks.ceph:Scrubbing osd.2 2024-05-14T10:12:27.922 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:12:28.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.203+0000 7f2730400640 1 Processor -- start 2024-05-14T10:12:28.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.203+0000 7f2730400640 1 -- start start 2024-05-14T10:12:28.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.205+0000 7f2730400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2728074860 0x7f272815f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.205+0000 7f2730400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2728156780 0x7f272815fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.205+0000 7f2730400640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27280c88c0 con 0x7f27280c8310 2024-05-14T10:12:28.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.205+0000 7f2730400640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f272815c480 con 0x7f2728156780 2024-05-14T10:12:28.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.205+0000 7f2730400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f272815c760 con 0x7f2728074860 2024-05-14T10:12:28.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.206+0000 7f272d000640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f27280c8310 0x7f27280c6e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:33854/0 (socket says 172.21.15.135:33854) 2024-05-14T10:12:28.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.206+0000 7f272d000640 1 -- 172.21.15.135:0/2963559817 learned_addr learned my addr 172.21.15.135:0/2963559817 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:28.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.207+0000 7f272e400640 1 --2- 172.21.15.135:0/2963559817 >> v2:172.21.15.135:3300/0 conn(0x7f2728156780 0x7f272815fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:28.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.211+0000 7f2727e00640 1 -- 172.21.15.135:0/2963559817 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1781499492 0 0) 0x7f27280c88c0 con 0x7f27280c8310 2024-05-14T10:12:28.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.211+0000 7f2727e00640 1 -- 172.21.15.135:0/2963559817 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2710003520 con 0x7f27280c8310 2024-05-14T10:12:28.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.214+0000 7f272e400640 1 -- 172.21.15.135:0/2963559817 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2728074860 msgr2=0x7f272815f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:28.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.214+0000 7f272e400640 1 --2- 172.21.15.135:0/2963559817 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2728074860 0x7f272815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.214+0000 7f272e400640 1 -- 172.21.15.135:0/2963559817 >> v1:172.21.15.135:6789/0 conn(0x7f27280c8310 legacy=0x7f27280c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:28.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.214+0000 7f272e400640 1 -- 172.21.15.135:0/2963559817 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272815ca40 con 0x7f2728156780 2024-05-14T10:12:28.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.217+0000 7f272e400640 1 --2- 172.21.15.135:0/2963559817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2728156780 0x7f272815fea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2720009d90 tx=0x7f272002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38da29679240ac08 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:28.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.225+0000 7f2727e00640 1 -- 172.21.15.135:0/2963559817 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720007740 con 0x7f2728156780 2024-05-14T10:12:28.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.225+0000 7f2727e00640 1 -- 172.21.15.135:0/2963559817 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27200078e0 con 0x7f2728156780 2024-05-14T10:12:28.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.225+0000 7f2727e00640 1 -- 172.21.15.135:0/2963559817 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720007cb0 con 0x7f2728156780 2024-05-14T10:12:28.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.226+0000 7f2730400640 1 -- 172.21.15.135:0/2963559817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2728156780 msgr2=0x7f272815fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:28.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.226+0000 7f2730400640 1 --2- 172.21.15.135:0/2963559817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2728156780 0x7f272815fea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2720009d90 tx=0x7f272002a660 comp rx=0 tx=0).stop 2024-05-14T10:12:28.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.226+0000 7f2730400640 1 -- 172.21.15.135:0/2963559817 shutdown_connections 2024-05-14T10:12:28.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.226+0000 7f2730400640 1 --2- 172.21.15.135:0/2963559817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2728156780 0x7f272815fea0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.226+0000 7f2730400640 1 --2- 172.21.15.135:0/2963559817 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2728074860 0x7f272815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.226+0000 7f2730400640 1 -- 172.21.15.135:0/2963559817 >> 172.21.15.135:0/2963559817 conn(0x7f2728073d40 msgr2=0x7f2728074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:28.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.226+0000 7f2730400640 1 -- 172.21.15.135:0/2963559817 shutdown_connections 2024-05-14T10:12:28.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.226+0000 7f2730400640 1 -- 172.21.15.135:0/2963559817 wait complete. 2024-05-14T10:12:28.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.230+0000 7f2730400640 1 Processor -- start 2024-05-14T10:12:28.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.230+0000 7f2730400640 1 -- start start 2024-05-14T10:12:28.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.233+0000 7f2730400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2728074860 0x7f27281593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.233+0000 7f2730400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27280c8310 0x7f2728157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.233+0000 7f2730400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2728156780 0x7f272814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.233+0000 7f2730400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27280c75a0 con 0x7f2728156780 2024-05-14T10:12:28.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.233+0000 7f2730400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f27280c9150 con 0x7f27280c8310 2024-05-14T10:12:28.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.233+0000 7f2730400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f27280c7720 con 0x7f2728074860 2024-05-14T10:12:28.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.234+0000 7f272e400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2728156780 0x7f272814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:28.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.234+0000 7f272e400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2728156780 0x7f272814ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57154/0 (socket says 172.21.15.135:57154) 2024-05-14T10:12:28.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.234+0000 7f272e400640 1 -- 172.21.15.135:0/2794466452 learned_addr learned my addr 172.21.15.135:0/2794466452 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:28.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.239+0000 7f272e400640 1 -- 172.21.15.135:0/2794466452 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2728074860 msgr2=0x7f27281593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:28.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.239+0000 7f272e400640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2728074860 0x7f27281593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.239+0000 7f272e400640 1 -- 172.21.15.135:0/2794466452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27280c8310 msgr2=0x7f2728157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:28.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.239+0000 7f272e400640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f27280c8310 0x7f2728157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.239+0000 7f272e400640 1 -- 172.21.15.135:0/2794466452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2728159910 con 0x7f2728156780 2024-05-14T10:12:28.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.242+0000 7f272e400640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2728156780 0x7f272814ade0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2720009eb0 tx=0x7f2720004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:28.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.247+0000 7f2725600640 1 -- 172.21.15.135:0/2794466452 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272003f070 con 0x7f2728156780 2024-05-14T10:12:28.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.247+0000 7f2725600640 1 -- 172.21.15.135:0/2794466452 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2720031b40 con 0x7f2728156780 2024-05-14T10:12:28.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.247+0000 7f2725600640 1 -- 172.21.15.135:0/2794466452 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2720043410 con 0x7f2728156780 2024-05-14T10:12:28.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.247+0000 7f2730400640 1 -- 172.21.15.135:0/2794466452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272814e450 con 0x7f2728156780 2024-05-14T10:12:28.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.247+0000 7f2730400640 1 -- 172.21.15.135:0/2794466452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272814e9d0 con 0x7f2728156780 2024-05-14T10:12:28.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.248+0000 7f2730400640 1 -- 172.21.15.135:0/2794466452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2728069a60 con 0x7f2728156780 2024-05-14T10:12:28.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.286+0000 7f2725600640 1 -- 172.21.15.135:0/2794466452 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f272003b410 con 0x7f2728156780 2024-05-14T10:12:28.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.287+0000 7f2725600640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2708076320 0x7f2708078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.288+0000 7f272da00640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2708076320 0x7f2708078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:28.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.289+0000 7f272da00640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2708076320 0x7f2708078830 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2728159f60 tx=0x7f271c006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:28.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.292+0000 7f2725600640 1 -- 172.21.15.135:0/2794466452 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f272007e2c0 con 0x7f2728156780 2024-05-14T10:12:28.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.292+0000 7f2725600640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] conn(0x7f270807fe00 0x7f27080822f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.292+0000 7f2725600640 1 -- 172.21.15.135:0/2794466452 --> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27080829c0 con 0x7f270807fe00 2024-05-14T10:12:28.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.292+0000 7f2725600640 1 -- 172.21.15.135:0/2794466452 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f272007e680 con 0x7f2728156780 2024-05-14T10:12:28.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.293+0000 7f272d000640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] conn(0x7f270807fe00 0x7f27080822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:28.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.294+0000 7f272d000640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] conn(0x7f270807fe00 0x7f27080822f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:28.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.295+0000 7f2725600640 1 -- 172.21.15.135:0/2794466452 <== osd.2 v2:172.21.15.135:6826/3157168741 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27080829c0 con 0x7f270807fe00 2024-05-14T10:12:28.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.311+0000 7f2730400640 1 -- 172.21.15.135:0/2794466452 --> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2728159050 con 0x7f270807fe00 2024-05-14T10:12:28.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.312+0000 7f2725600640 1 -- 172.21.15.135:0/2794466452 <== osd.2 v2:172.21.15.135:6826/3157168741 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2728159050 con 0x7f270807fe00 2024-05-14T10:12:28.312 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T10:12:28.312 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:12:28.312 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T10:12:28.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.312+0000 7f2730400640 1 -- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] conn(0x7f270807fe00 msgr2=0x7f27080822f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:28.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.312+0000 7f2730400640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:6826/3157168741,v1:172.21.15.135:6827/3157168741] conn(0x7f270807fe00 0x7f27080822f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.313+0000 7f2730400640 1 -- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2708076320 msgr2=0x7f2708078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:28.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.313+0000 7f2730400640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2708076320 0x7f2708078830 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2728159f60 tx=0x7f271c006bf0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.313+0000 7f2730400640 1 -- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2728156780 msgr2=0x7f272814ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:28.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.313+0000 7f2730400640 1 --2- 172.21.15.135:0/2794466452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2728156780 0x7f272814ade0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2720009eb0 tx=0x7f2720004a40 comp rx=0 tx=0).stop 2024-05-14T10:12:28.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.313+0000 7f272e400640 1 -- 172.21.15.135:0/2794466452 reap_dead start 2024-05-14T10:12:28.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.313+0000 7f2730400640 1 -- 172.21.15.135:0/2794466452 shutdown_connections 2024-05-14T10:12:28.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.313+0000 7f2730400640 1 -- 172.21.15.135:0/2794466452 >> 172.21.15.135:0/2794466452 conn(0x7f2728073d40 msgr2=0x7f272814c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:28.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.313+0000 7f2730400640 1 -- 172.21.15.135:0/2794466452 shutdown_connections 2024-05-14T10:12:28.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.313+0000 7f2730400640 1 -- 172.21.15.135:0/2794466452 wait complete. 2024-05-14T10:12:28.347 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-14T10:12:28.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.615+0000 7f22c2c00640 1 Processor -- start 2024-05-14T10:12:28.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.616+0000 7f22c2c00640 1 -- start start 2024-05-14T10:12:28.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.618+0000 7f22c2c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22bc150b20 0x7f22bc06c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.618+0000 7f22c2c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f22bc0c6b90 0x7f22bc0c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.618+0000 7f22c2c00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22bc06cfe0 con 0x7f22bc15aa90 2024-05-14T10:12:28.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.618+0000 7f22c2c00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f22bc071ab0 con 0x7f22bc0c6b90 2024-05-14T10:12:28.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.618+0000 7f22c2c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc06cdc0 con 0x7f22bc150b20 2024-05-14T10:12:28.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.619+0000 7f22c2200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f22bc0c6b90 0x7f22bc0c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:28.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.619+0000 7f22c2200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f22bc0c6b90 0x7f22bc0c6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57158/0 (socket says 172.21.15.135:57158) 2024-05-14T10:12:28.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.619+0000 7f22c2200640 1 -- 172.21.15.135:0/3490047579 learned_addr learned my addr 172.21.15.135:0/3490047579 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:28.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.620+0000 7f22c1800640 1 --2- 172.21.15.135:0/3490047579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22bc150b20 0x7f22bc06c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.623+0000 7f22c2200640 1 -- 172.21.15.135:0/3490047579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22bc150b20 msgr2=0x7f22bc06c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.623+0000 7f22c2200640 1 --2- 172.21.15.135:0/3490047579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22bc150b20 0x7f22bc06c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.623+0000 7f22c2200640 1 -- 172.21.15.135:0/3490047579 >> v1:172.21.15.135:6789/0 conn(0x7f22bc15aa90 legacy=0x7f22bc0c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.623+0000 7f22c2200640 1 -- 172.21.15.135:0/3490047579 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc070cf0 con 0x7f22bc0c6b90 2024-05-14T10:12:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.627+0000 7f22c2200640 1 --2- 172.21.15.135:0/3490047579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc0c6b90 0x7f22bc0c6fa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009870 tx=0x7f22ac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233b322479c5d37d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:28.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.632+0000 7f22bbe00640 1 -- 172.21.15.135:0/3490047579 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac037070 con 0x7f22bc0c6b90 2024-05-14T10:12:28.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.632+0000 7f22bbe00640 1 -- 172.21.15.135:0/3490047579 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ac02ae50 con 0x7f22bc0c6b90 2024-05-14T10:12:28.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.632+0000 7f22bbe00640 1 -- 172.21.15.135:0/3490047579 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac032860 con 0x7f22bc0c6b90 2024-05-14T10:12:28.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.633+0000 7f22c2c00640 1 -- 172.21.15.135:0/3490047579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc0c6b90 msgr2=0x7f22bc0c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:28.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.633+0000 7f22c2c00640 1 --2- 172.21.15.135:0/3490047579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc0c6b90 0x7f22bc0c6fa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009870 tx=0x7f22ac02a300 comp rx=0 tx=0).stop 2024-05-14T10:12:28.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.633+0000 7f22c2c00640 1 -- 172.21.15.135:0/3490047579 shutdown_connections 2024-05-14T10:12:28.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.633+0000 7f22c2c00640 1 --2- 172.21.15.135:0/3490047579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc0c6b90 0x7f22bc0c6fa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.633+0000 7f22c2c00640 1 --2- 172.21.15.135:0/3490047579 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22bc150b20 0x7f22bc06c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.633+0000 7f22c2c00640 1 -- 172.21.15.135:0/3490047579 >> 172.21.15.135:0/3490047579 conn(0x7f22bc0ca160 msgr2=0x7f22bc0ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:28.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.633+0000 7f22c2c00640 1 -- 172.21.15.135:0/3490047579 shutdown_connections 2024-05-14T10:12:28.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.634+0000 7f22c2c00640 1 -- 172.21.15.135:0/3490047579 wait complete. 2024-05-14T10:12:28.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.637+0000 7f22c2c00640 1 Processor -- start 2024-05-14T10:12:28.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.637+0000 7f22c2c00640 1 -- start start 2024-05-14T10:12:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.638+0000 7f22c2c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc0c6b90 0x7f22bc15e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.638+0000 7f22c2c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc150b20 0x7f22bc1eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.638+0000 7f22c2c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22bc15aa90 0x7f22bc1f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.638+0000 7f22c2c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc071620 con 0x7f22bc150b20 2024-05-14T10:12:28.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.638+0000 7f22c2c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc150f30 con 0x7f22bc0c6b90 2024-05-14T10:12:28.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.638+0000 7f22c2c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc0712b0 con 0x7f22bc15aa90 2024-05-14T10:12:28.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.639+0000 7f22c0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc150b20 0x7f22bc1eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:28.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.640+0000 7f22c0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc150b20 0x7f22bc1eee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57170/0 (socket says 172.21.15.135:57170) 2024-05-14T10:12:28.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.640+0000 7f22c0e00640 1 -- 172.21.15.135:0/234829177 learned_addr learned my addr 172.21.15.135:0/234829177 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:28.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.640+0000 7f22c1800640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc0c6b90 0x7f22bc15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:28.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.644+0000 7f22c2200640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22bc15aa90 0x7f22bc1f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:28.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.644+0000 7f22c0e00640 1 -- 172.21.15.135:0/234829177 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22bc15aa90 msgr2=0x7f22bc1f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:28.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.644+0000 7f22c0e00640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22bc15aa90 0x7f22bc1f2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.644+0000 7f22c0e00640 1 -- 172.21.15.135:0/234829177 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc0c6b90 msgr2=0x7f22bc15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:28.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.644+0000 7f22c0e00640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc0c6b90 0x7f22bc15e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:28.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.644+0000 7f22c0e00640 1 -- 172.21.15.135:0/234829177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc1f2690 con 0x7f22bc150b20 2024-05-14T10:12:28.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.652+0000 7f22c0e00640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc150b20 0x7f22bc1eee00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c730 tx=0x7f22a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:28.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.659+0000 7f22b9600640 1 -- 172.21.15.135:0/234829177 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8003b70 con 0x7f22bc150b20 2024-05-14T10:12:28.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.659+0000 7f22b9600640 1 -- 172.21.15.135:0/234829177 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a8003d10 con 0x7f22bc150b20 2024-05-14T10:12:28.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.659+0000 7f22b9600640 1 -- 172.21.15.135:0/234829177 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a800a9f0 con 0x7f22bc150b20 2024-05-14T10:12:28.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.659+0000 7f22c2c00640 1 -- 172.21.15.135:0/234829177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc153430 con 0x7f22bc150b20 2024-05-14T10:12:28.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.659+0000 7f22c2c00640 1 -- 172.21.15.135:0/234829177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc1ee600 con 0x7f22bc150b20 2024-05-14T10:12:28.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.661+0000 7f22c2c00640 1 -- 172.21.15.135:0/234829177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22bc069980 con 0x7f22bc150b20 2024-05-14T10:12:28.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.983+0000 7f22b9600640 1 -- 172.21.15.135:0/234829177 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f22a800ab90 con 0x7f22bc150b20 2024-05-14T10:12:28.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.985+0000 7f22b9600640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f229c076350 0x7f229c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:28.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.986+0000 7f22c1800640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f229c076350 0x7f229c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:28.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.988+0000 7f22c1800640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f229c076350 0x7f229c078860 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f22bc154900 tx=0x7f22b4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.997+0000 7f22b9600640 1 -- 172.21.15.135:0/234829177 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f22a805d300 con 0x7f22bc150b20 2024-05-14T10:12:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:28.998+0000 7f22b9600640 1 -- 172.21.15.135:0/234829177 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f22bc1f2690 con 0x7f22bc150b20 2024-05-14T10:12:29.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.223+0000 7f22c2c00640 1 -- 172.21.15.135:0/234829177 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f22bc06d3e0 con 0x7f229c076350 2024-05-14T10:12:29.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.224+0000 7f22b9600640 1 -- 172.21.15.135:0/234829177 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f22bc06d3e0 con 0x7f229c076350 2024-05-14T10:12:29.224 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 2 to deep-scrub 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 -- 172.21.15.135:0/234829177 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f229c076350 msgr2=0x7f229c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f229c076350 0x7f229c078860 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f22bc154900 tx=0x7f22b4009190 comp rx=0 tx=0).stop 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 -- 172.21.15.135:0/234829177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc150b20 msgr2=0x7f22bc1eee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc150b20 0x7f22bc1eee00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c730 tx=0x7f22a800cbf0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 -- 172.21.15.135:0/234829177 shutdown_connections 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f229c076350 0x7f229c078860 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22bc15aa90 0x7f22bc1f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22bc150b20 0x7f22bc1eee00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 --2- 172.21.15.135:0/234829177 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22bc0c6b90 0x7f22bc15e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 -- 172.21.15.135:0/234829177 >> 172.21.15.135:0/234829177 conn(0x7f22bc0ca160 msgr2=0x7f22bc149d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 -- 172.21.15.135:0/234829177 shutdown_connections 2024-05-14T10:12:29.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.227+0000 7f22c2c00640 1 -- 172.21.15.135:0/234829177 wait complete. 2024-05-14T10:12:29.255 INFO:tasks.ceph:Scrubbing osd.3 2024-05-14T10:12:29.256 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:12:29.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.538+0000 7fe17f000640 1 Processor -- start 2024-05-14T10:12:29.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.539+0000 7fe17f000640 1 -- start start 2024-05-14T10:12:29.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.541+0000 7fe17f000640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe1780ca660 0x7fe1780caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:29.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.541+0000 7fe17f000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe17815bc10 0x7fe17815c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:29.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.541+0000 7fe17f000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1780ca240 con 0x7fe1780c7af0 2024-05-14T10:12:29.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.541+0000 7fe17f000640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe1780c8ce0 con 0x7fe1780ca660 2024-05-14T10:12:29.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.541+0000 7fe17f000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fe1780c9970 con 0x7fe17815bc10 2024-05-14T10:12:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.587+0000 7fe17dc00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe1780c7af0 0x7fe1780c85d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:33872/0 (socket says 172.21.15.135:33872) 2024-05-14T10:12:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.587+0000 7fe17dc00640 1 -- 172.21.15.135:0/634191665 learned_addr learned my addr 172.21.15.135:0/634191665 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.587+0000 7fe17d200640 1 --2- 172.21.15.135:0/634191665 >> v2:172.21.15.135:3300/0 conn(0x7fe1780ca660 0x7fe1780caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:29.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.603+0000 7fe17d200640 1 -- 172.21.15.135:0/634191665 >> v2:172.21.15.196:3300/0 conn(0x7fe17815bc10 msgr2=0x7fe17815c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:29.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.603+0000 7fe17d200640 1 --2- 172.21.15.135:0/634191665 >> v2:172.21.15.196:3300/0 conn(0x7fe17815bc10 0x7fe17815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.603+0000 7fe17d200640 1 -- 172.21.15.135:0/634191665 >> v1:172.21.15.135:6789/0 conn(0x7fe1780c7af0 legacy=0x7fe1780c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:29.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.603+0000 7fe17d200640 1 -- 172.21.15.135:0/634191665 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1780c9bc0 con 0x7fe1780ca660 2024-05-14T10:12:29.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.611+0000 7fe17d200640 1 --2- 172.21.15.135:0/634191665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1780ca660 0x7fe1780caa70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe17815cc60 tx=0x7fe16402c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c29df551163adc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:29.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.636+0000 7fe177e00640 1 -- 172.21.15.135:0/634191665 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe164039070 con 0x7fe1780ca660 2024-05-14T10:12:29.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.637+0000 7fe177e00640 1 -- 172.21.15.135:0/634191665 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe164034440 con 0x7fe1780ca660 2024-05-14T10:12:29.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.637+0000 7fe177e00640 1 -- 172.21.15.135:0/634191665 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1640347f0 con 0x7fe1780ca660 2024-05-14T10:12:29.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.638+0000 7fe17f000640 1 -- 172.21.15.135:0/634191665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1780ca660 msgr2=0x7fe1780caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:29.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.638+0000 7fe17f000640 1 --2- 172.21.15.135:0/634191665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1780ca660 0x7fe1780caa70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe17815cc60 tx=0x7fe16402c290 comp rx=0 tx=0).stop 2024-05-14T10:12:29.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.638+0000 7fe17f000640 1 -- 172.21.15.135:0/634191665 shutdown_connections 2024-05-14T10:12:29.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.638+0000 7fe17f000640 1 --2- 172.21.15.135:0/634191665 >> v2:172.21.15.196:3300/0 conn(0x7fe17815bc10 0x7fe17815c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.638+0000 7fe17f000640 1 --2- 172.21.15.135:0/634191665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1780ca660 0x7fe1780caa70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.638+0000 7fe17f000640 1 -- 172.21.15.135:0/634191665 >> 172.21.15.135:0/634191665 conn(0x7fe178073ec0 msgr2=0x7fe1780742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:29.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.639+0000 7fe17f000640 1 -- 172.21.15.135:0/634191665 shutdown_connections 2024-05-14T10:12:29.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.639+0000 7fe17f000640 1 -- 172.21.15.135:0/634191665 wait complete. 2024-05-14T10:12:29.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.646+0000 7fe17f000640 1 Processor -- start 2024-05-14T10:12:29.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.646+0000 7fe17f000640 1 -- start start 2024-05-14T10:12:29.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.649+0000 7fe17f000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1780c7af0 0x7fe178144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:29.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.649+0000 7fe17f000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1780ca660 0x7fe1780cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:29.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.649+0000 7fe17f000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe17815bc10 0x7fe1780ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:29.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.649+0000 7fe17f000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe1780c32d0 con 0x7fe17815bc10 2024-05-14T10:12:29.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.649+0000 7fe17f000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe1780c9ea0 con 0x7fe1780c7af0 2024-05-14T10:12:29.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.649+0000 7fe17f000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe17815c560 con 0x7fe1780ca660 2024-05-14T10:12:29.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.651+0000 7fe17dc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1780c7af0 0x7fe178144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:29.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.652+0000 7fe17d200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1780ca660 0x7fe1780cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:29.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.652+0000 7fe17dc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1780c7af0 0x7fe178144100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:35948/0 (socket says 172.21.15.135:35948) 2024-05-14T10:12:29.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.652+0000 7fe17dc00640 1 -- 172.21.15.135:0/3886250387 learned_addr learned my addr 172.21.15.135:0/3886250387 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:29.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.664+0000 7fe17d200640 1 -- 172.21.15.135:0/3886250387 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1780c7af0 msgr2=0x7fe178144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:29.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.664+0000 7fe17d200640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1780c7af0 0x7fe178144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.664+0000 7fe17d200640 1 -- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe17815bc10 msgr2=0x7fe1780ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:29.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.664+0000 7fe17d200640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe17815bc10 0x7fe1780ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.664+0000 7fe17d200640 1 -- 172.21.15.135:0/3886250387 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17814f520 con 0x7fe1780ca660 2024-05-14T10:12:29.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.672+0000 7fe17d200640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1780ca660 0x7fe1780cca20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe164033000 tx=0x7fe1640046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:29.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.683+0000 7fe175600640 1 -- 172.21.15.135:0/3886250387 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe164042020 con 0x7fe1780ca660 2024-05-14T10:12:29.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.683+0000 7fe175600640 1 -- 172.21.15.135:0/3886250387 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16403a040 con 0x7fe1780ca660 2024-05-14T10:12:29.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.683+0000 7fe175600640 1 -- 172.21.15.135:0/3886250387 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe164039070 con 0x7fe1780ca660 2024-05-14T10:12:29.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.683+0000 7fe17f000640 1 -- 172.21.15.135:0/3886250387 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1780c5fa0 con 0x7fe1780ca660 2024-05-14T10:12:29.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.683+0000 7fe17f000640 1 -- 172.21.15.135:0/3886250387 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1781ee810 con 0x7fe1780ca660 2024-05-14T10:12:29.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.685+0000 7fe17f000640 1 -- 172.21.15.135:0/3886250387 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe178150290 con 0x7fe1780ca660 2024-05-14T10:12:29.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.766+0000 7fe175600640 1 -- 172.21.15.135:0/3886250387 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe164045020 con 0x7fe1780ca660 2024-05-14T10:12:29.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.768+0000 7fe175600640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe158076320 0x7fe158078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:29.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.769+0000 7fe17dc00640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe158076320 0x7fe158078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:29.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.770+0000 7fe17dc00640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe158076320 0x7fe158078830 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0012e0 tx=0x7fe16c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:29.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.776+0000 7fe175600640 1 -- 172.21.15.135:0/3886250387 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fe16407f570 con 0x7fe1780ca660 2024-05-14T10:12:29.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.777+0000 7fe175600640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] conn(0x7fe15807fd80 0x7fe158082270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:29.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.777+0000 7fe175600640 1 -- 172.21.15.135:0/3886250387 --> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe158082940 con 0x7fe15807fd80 2024-05-14T10:12:29.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.777+0000 7fe17e600640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] conn(0x7fe15807fd80 0x7fe158082270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:29.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.779+0000 7fe17e600640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] conn(0x7fe15807fd80 0x7fe158082270 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.781+0000 7fe175600640 1 -- 172.21.15.135:0/3886250387 <== osd.3 v2:172.21.15.135:6802/3064760126 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe158082940 con 0x7fe15807fd80 2024-05-14T10:12:29.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.804+0000 7fe17f000640 1 -- 172.21.15.135:0/3886250387 --> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe178076290 con 0x7fe15807fd80 2024-05-14T10:12:29.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.804+0000 7fe175600640 1 -- 172.21.15.135:0/3886250387 <== osd.3 v2:172.21.15.135:6802/3064760126 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe178076290 con 0x7fe15807fd80 2024-05-14T10:12:29.805 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T10:12:29.805 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:12:29.805 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T10:12:29.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.805+0000 7fe17f000640 1 -- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] conn(0x7fe15807fd80 msgr2=0x7fe158082270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:29.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.805+0000 7fe17f000640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:6802/3064760126,v1:172.21.15.135:6803/3064760126] conn(0x7fe15807fd80 0x7fe158082270 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.805+0000 7fe17f000640 1 -- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe158076320 msgr2=0x7fe158078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:29.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.805+0000 7fe17f000640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe158076320 0x7fe158078830 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0012e0 tx=0x7fe16c009040 comp rx=0 tx=0).stop 2024-05-14T10:12:29.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.805+0000 7fe17f000640 1 -- 172.21.15.135:0/3886250387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1780ca660 msgr2=0x7fe1780cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:29.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.805+0000 7fe17f000640 1 --2- 172.21.15.135:0/3886250387 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe1780ca660 0x7fe1780cca20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe164033000 tx=0x7fe1640046c0 comp rx=0 tx=0).stop 2024-05-14T10:12:29.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.805+0000 7fe17e600640 1 -- 172.21.15.135:0/3886250387 reap_dead start 2024-05-14T10:12:29.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.806+0000 7fe17f000640 1 -- 172.21.15.135:0/3886250387 shutdown_connections 2024-05-14T10:12:29.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.806+0000 7fe17f000640 1 -- 172.21.15.135:0/3886250387 >> 172.21.15.135:0/3886250387 conn(0x7fe178073ec0 msgr2=0x7fe17814c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:29.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.806+0000 7fe17f000640 1 -- 172.21.15.135:0/3886250387 shutdown_connections 2024-05-14T10:12:29.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:29.806+0000 7fe17f000640 1 -- 172.21.15.135:0/3886250387 wait complete. 2024-05-14T10:12:29.845 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-14T10:12:30.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.117+0000 7f3413c00640 1 Processor -- start 2024-05-14T10:12:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.117+0000 7f3413c00640 1 -- start start 2024-05-14T10:12:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.119+0000 7f3413c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c15ab20 0x7f340c153f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.119+0000 7f3413c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f340c071f70 0x7f340c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.119+0000 7f3413c00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340c074ce0 con 0x7f340c1544b0 2024-05-14T10:12:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.120+0000 7f3413c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f340c06cde0 con 0x7f340c071f70 2024-05-14T10:12:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.120+0000 7f3413c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f340c074a00 con 0x7f340c15ab20 2024-05-14T10:12:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.120+0000 7f3403e00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f340c1544b0 0x7f340c0c6c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:33880/0 (socket says 172.21.15.135:33880) 2024-05-14T10:12:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.120+0000 7f3403e00640 1 -- 172.21.15.135:0/4185654534 learned_addr learned my addr 172.21.15.135:0/4185654534 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.122+0000 7f3411c00640 1 --2- 172.21.15.135:0/4185654534 >> v2:172.21.15.196:3300/0 conn(0x7f340c071f70 0x7f340c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:30.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.122+0000 7f3411200640 1 --2- 172.21.15.135:0/4185654534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c15ab20 0x7f340c153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.124+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3744351802 0 0) 0x7f340c074ce0 con 0x7f340c1544b0 2024-05-14T10:12:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.124+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33f0003520 con 0x7f340c1544b0 2024-05-14T10:12:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3347493776 0 0) 0x7f33f0003520 con 0x7f340c1544b0 2024-05-14T10:12:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c15ab20 msgr2=0x7f340c153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 --2- 172.21.15.135:0/4185654534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c15ab20 0x7f340c153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 >> v2:172.21.15.196:3300/0 conn(0x7f340c071f70 msgr2=0x7f340c06d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 --2- 172.21.15.135:0/4185654534 >> v2:172.21.15.196:3300/0 conn(0x7f340c071f70 0x7f340c06d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c06c790 con 0x7f340c1544b0 2024-05-14T10:12:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f33f40016f0 con 0x7f340c1544b0 2024-05-14T10:12:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 >> v1:172.21.15.135:6789/0 conn(0x7f340c1544b0 legacy=0x7f340c0c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 --2- 172.21.15.135:0/4185654534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c15ab20 0x7f33f0003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:30.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 --2- 172.21.15.135:0/4185654534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f0004020 0x7f33f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 --2- 172.21.15.135:0/4185654534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0004d40 0x7f33f0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f340c06cde0 con 0x7f33f0004d40 2024-05-14T10:12:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f340c074a00 con 0x7f33f0004020 2024-05-14T10:12:30.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.129+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f33f000bb20 con 0x7f340c15ab20 2024-05-14T10:12:30.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.132+0000 7f3411c00640 1 --2- 172.21.15.135:0/4185654534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0004d40 0x7f33f0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:30.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.135+0000 7f3411c00640 1 -- 172.21.15.135:0/4185654534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c15ab20 msgr2=0x7f33f0003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:30.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.135+0000 7f3411c00640 1 --2- 172.21.15.135:0/4185654534 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c15ab20 0x7f33f0003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:30.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.135+0000 7f3411c00640 1 -- 172.21.15.135:0/4185654534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f0004020 msgr2=0x7f33f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:30.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.135+0000 7f3411c00640 1 --2- 172.21.15.135:0/4185654534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f0004020 0x7f33f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:30.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.135+0000 7f3411c00640 1 -- 172.21.15.135:0/4185654534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f0003520 con 0x7f33f0004d40 2024-05-14T10:12:30.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.138+0000 7f3411c00640 1 --2- 172.21.15.135:0/4185654534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0004d40 0x7f33f0005150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f340c0c80c0 tx=0x7f33f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7aa8fa5bed1ef83 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:30.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.142+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404009c10 con 0x7f33f0004d40 2024-05-14T10:12:30.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.143+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3404036070 con 0x7f33f0004d40 2024-05-14T10:12:30.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.143+0000 7f340be00640 1 -- 172.21.15.135:0/4185654534 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404031850 con 0x7f33f0004d40 2024-05-14T10:12:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.144+0000 7f3413c00640 1 -- 172.21.15.135:0/4185654534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0004d40 msgr2=0x7f33f0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.144+0000 7f3413c00640 1 --2- 172.21.15.135:0/4185654534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0004d40 0x7f33f0005150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f340c0c80c0 tx=0x7f33f0005830 comp rx=0 tx=0).stop 2024-05-14T10:12:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.144+0000 7f3411c00640 1 -- 172.21.15.135:0/4185654534 reap_dead start 2024-05-14T10:12:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.144+0000 7f3413c00640 1 -- 172.21.15.135:0/4185654534 shutdown_connections 2024-05-14T10:12:30.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.144+0000 7f3413c00640 1 -- 172.21.15.135:0/4185654534 >> 172.21.15.135:0/4185654534 conn(0x7f340c073d40 msgr2=0x7f340c074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.144+0000 7f3413c00640 1 -- 172.21.15.135:0/4185654534 shutdown_connections 2024-05-14T10:12:30.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.144+0000 7f3413c00640 1 -- 172.21.15.135:0/4185654534 wait complete. 2024-05-14T10:12:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.147+0000 7f3413c00640 1 Processor -- start 2024-05-14T10:12:30.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.147+0000 7f3413c00640 1 -- start start 2024-05-14T10:12:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.149+0000 7f3413c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f0004d40 0x7f340c155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.149+0000 7f3413c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c158df0 0x7f340c1f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.149+0000 7f3413c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c14ec80 0x7f340c150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.149+0000 7f3413c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f340c0c7380 con 0x7f340c14ec80 2024-05-14T10:12:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.149+0000 7f3413c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f340c0c4690 con 0x7f33f0004d40 2024-05-14T10:12:30.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.149+0000 7f3413c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f340c0c7500 con 0x7f340c158df0 2024-05-14T10:12:30.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.150+0000 7f3411c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c14ec80 0x7f340c150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:30.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.150+0000 7f3411c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c14ec80 0x7f340c150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57206/0 (socket says 172.21.15.135:57206) 2024-05-14T10:12:30.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.150+0000 7f3411c00640 1 -- 172.21.15.135:0/3158807595 learned_addr learned my addr 172.21.15.135:0/3158807595 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:30.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.150+0000 7f3403e00640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c158df0 0x7f340c1f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:30.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.151+0000 7f3411200640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f0004d40 0x7f340c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:30.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.156+0000 7f3411c00640 1 -- 172.21.15.135:0/3158807595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c158df0 msgr2=0x7f340c1f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:30.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.156+0000 7f3411c00640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c158df0 0x7f340c1f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:30.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.156+0000 7f3411c00640 1 -- 172.21.15.135:0/3158807595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f0004d40 msgr2=0x7f340c155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:30.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.156+0000 7f3411c00640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f0004d40 0x7f340c155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:30.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.156+0000 7f3411c00640 1 -- 172.21.15.135:0/3158807595 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c1f2910 con 0x7f340c14ec80 2024-05-14T10:12:30.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.159+0000 7f3411c00640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c14ec80 0x7f340c150ca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3404033040 tx=0x7f3404009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:30.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.163+0000 7f3409600640 1 -- 172.21.15.135:0/3158807595 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404009c10 con 0x7f340c14ec80 2024-05-14T10:12:30.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.163+0000 7f3409600640 1 -- 172.21.15.135:0/3158807595 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3404003990 con 0x7f340c14ec80 2024-05-14T10:12:30.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.163+0000 7f3409600640 1 -- 172.21.15.135:0/3158807595 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404003d80 con 0x7f340c14ec80 2024-05-14T10:12:30.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.164+0000 7f3413c00640 1 -- 172.21.15.135:0/3158807595 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340c158b80 con 0x7f340c14ec80 2024-05-14T10:12:30.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.164+0000 7f3413c00640 1 -- 172.21.15.135:0/3158807595 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340c1f5c00 con 0x7f340c14ec80 2024-05-14T10:12:30.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.165+0000 7f3413c00640 1 -- 172.21.15.135:0/3158807595 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f340c069a60 con 0x7f340c14ec80 2024-05-14T10:12:30.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.193+0000 7f3409600640 1 -- 172.21.15.135:0/3158807595 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3404005d10 con 0x7f340c14ec80 2024-05-14T10:12:30.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.194+0000 7f3409600640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33e8076350 0x7f33e8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:30.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.195+0000 7f3411200640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33e8076350 0x7f33e8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:30.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.196+0000 7f3411200640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33e8076350 0x7f33e8078860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f33fc004770 tx=0x7f33fc006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:30.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.507+0000 7f3409600640 1 -- 172.21.15.135:0/3158807595 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f340407e4f0 con 0x7f340c14ec80 2024-05-14T10:12:30.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.508+0000 7f3409600640 1 -- 172.21.15.135:0/3158807595 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3404053080 con 0x7f340c14ec80 2024-05-14T10:12:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.722+0000 7f3413c00640 1 -- 172.21.15.135:0/3158807595 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f340c0ccc00 con 0x7f33e8076350 2024-05-14T10:12:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.723+0000 7f3409600640 1 -- 172.21.15.135:0/3158807595 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f340c0ccc00 con 0x7f33e8076350 2024-05-14T10:12:30.724 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 3 to deep-scrub 2024-05-14T10:12:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.726+0000 7f3413c00640 1 -- 172.21.15.135:0/3158807595 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33e8076350 msgr2=0x7f33e8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.726+0000 7f3413c00640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33e8076350 0x7f33e8078860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f33fc004770 tx=0x7f33fc006a20 comp rx=0 tx=0).stop 2024-05-14T10:12:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.726+0000 7f3413c00640 1 -- 172.21.15.135:0/3158807595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c14ec80 msgr2=0x7f340c150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.726+0000 7f3413c00640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c14ec80 0x7f340c150ca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3404033040 tx=0x7f3404009750 comp rx=0 tx=0).stop 2024-05-14T10:12:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.727+0000 7f3413c00640 1 -- 172.21.15.135:0/3158807595 shutdown_connections 2024-05-14T10:12:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.727+0000 7f3413c00640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f33e8076350 0x7f33e8078860 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.727+0000 7f3413c00640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f340c14ec80 0x7f340c150ca0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:30.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.727+0000 7f3413c00640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f340c158df0 0x7f340c1f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:30.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.727+0000 7f3413c00640 1 --2- 172.21.15.135:0/3158807595 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33f0004d40 0x7f340c155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:30.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.727+0000 7f3413c00640 1 -- 172.21.15.135:0/3158807595 >> 172.21.15.135:0/3158807595 conn(0x7f340c073d40 msgr2=0x7f340c0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:30.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.727+0000 7f3413c00640 1 -- 172.21.15.135:0/3158807595 shutdown_connections 2024-05-14T10:12:30.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:30.727+0000 7f3413c00640 1 -- 172.21.15.135:0/3158807595 wait complete. 2024-05-14T10:12:30.753 INFO:tasks.ceph:Scrubbing osd.4 2024-05-14T10:12:30.753 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:12:31.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.021+0000 7fc801400640 1 Processor -- start 2024-05-14T10:12:31.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.021+0000 7fc801400640 1 -- start start 2024-05-14T10:12:31.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.023+0000 7fc801400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7fc15ab20 0x7fc7fc153f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.023+0000 7fc801400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc7fc071f70 0x7fc7fc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.023+0000 7fc801400640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7fc074ce0 con 0x7fc7fc1544b0 2024-05-14T10:12:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.023+0000 7fc801400640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fc7fc06cde0 con 0x7fc7fc071f70 2024-05-14T10:12:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.023+0000 7fc801400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc7fc074a00 con 0x7fc7fc15ab20 2024-05-14T10:12:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.024+0000 7fc7fb200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc7fc071f70 0x7fc7fc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.025+0000 7fc7fb200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc7fc071f70 0x7fc7fc06d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57212/0 (socket says 172.21.15.135:57212) 2024-05-14T10:12:31.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.025+0000 7fc7fb200640 1 -- 172.21.15.135:0/3346272961 learned_addr learned my addr 172.21.15.135:0/3346272961 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:31.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.025+0000 7fc7fa800640 1 --2- 172.21.15.135:0/3346272961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7fc15ab20 0x7fc7fc153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.028+0000 7fc7fb200640 1 -- 172.21.15.135:0/3346272961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7fc15ab20 msgr2=0x7fc7fc153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.028+0000 7fc7fb200640 1 --2- 172.21.15.135:0/3346272961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7fc15ab20 0x7fc7fc153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.028+0000 7fc7fb200640 1 -- 172.21.15.135:0/3346272961 >> v1:172.21.15.135:6789/0 conn(0x7fc7fc1544b0 legacy=0x7fc7fc0c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.028+0000 7fc7fb200640 1 -- 172.21.15.135:0/3346272961 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7fc06c790 con 0x7fc7fc071f70 2024-05-14T10:12:31.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.033+0000 7fc7fb200640 1 --2- 172.21.15.135:0/3346272961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7fc071f70 0x7fc7fc06d270 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009870 tx=0x7fc7f402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cf6f90f21133db server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:31.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.037+0000 7fc7f9400640 1 -- 172.21.15.135:0/3346272961 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4037070 con 0x7fc7fc071f70 2024-05-14T10:12:31.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.037+0000 7fc7f9400640 1 -- 172.21.15.135:0/3346272961 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f4032440 con 0x7fc7fc071f70 2024-05-14T10:12:31.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.037+0000 7fc7f9400640 1 -- 172.21.15.135:0/3346272961 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4032810 con 0x7fc7fc071f70 2024-05-14T10:12:31.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.038+0000 7fc801400640 1 -- 172.21.15.135:0/3346272961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7fc071f70 msgr2=0x7fc7fc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:31.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.038+0000 7fc801400640 1 --2- 172.21.15.135:0/3346272961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7fc071f70 0x7fc7fc06d270 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009870 tx=0x7fc7f402a1c0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.039+0000 7fc801400640 1 -- 172.21.15.135:0/3346272961 shutdown_connections 2024-05-14T10:12:31.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.039+0000 7fc801400640 1 --2- 172.21.15.135:0/3346272961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7fc071f70 0x7fc7fc06d270 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.039+0000 7fc801400640 1 --2- 172.21.15.135:0/3346272961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7fc15ab20 0x7fc7fc153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.039+0000 7fc801400640 1 -- 172.21.15.135:0/3346272961 >> 172.21.15.135:0/3346272961 conn(0x7fc7fc073d40 msgr2=0x7fc7fc074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:31.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.039+0000 7fc801400640 1 -- 172.21.15.135:0/3346272961 shutdown_connections 2024-05-14T10:12:31.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.039+0000 7fc801400640 1 -- 172.21.15.135:0/3346272961 wait complete. 2024-05-14T10:12:31.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.042+0000 7fc801400640 1 Processor -- start 2024-05-14T10:12:31.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.043+0000 7fc801400640 1 -- start start 2024-05-14T10:12:31.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.045+0000 7fc801400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7fc071f70 0x7fc7fc1f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.045+0000 7fc801400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7fc1544b0 0x7fc7fc158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.045+0000 7fc801400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7fc15ab20 0x7fc7fc148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.045+0000 7fc801400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc0c7380 con 0x7fc7fc15ab20 2024-05-14T10:12:31.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.045+0000 7fc801400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc0c4690 con 0x7fc7fc071f70 2024-05-14T10:12:31.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.045+0000 7fc801400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc7fc0c7500 con 0x7fc7fc1544b0 2024-05-14T10:12:31.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.046+0000 7fc7fb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7fc15ab20 0x7fc7fc148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.046+0000 7fc7fb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7fc15ab20 0x7fc7fc148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57226/0 (socket says 172.21.15.135:57226) 2024-05-14T10:12:31.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.046+0000 7fc7fb200640 1 -- 172.21.15.135:0/3874254384 learned_addr learned my addr 172.21.15.135:0/3874254384 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:31.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.047+0000 7fc7fa800640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7fc071f70 0x7fc7fc1f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.047+0000 7fc7f9e00640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7fc1544b0 0x7fc7fc158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.050+0000 7fc7fb200640 1 -- 172.21.15.135:0/3874254384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7fc1544b0 msgr2=0x7fc7fc158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:31.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.050+0000 7fc7fb200640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7fc1544b0 0x7fc7fc158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.050+0000 7fc7fb200640 1 -- 172.21.15.135:0/3874254384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7fc071f70 msgr2=0x7fc7fc1f00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:31.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.050+0000 7fc7fb200640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7fc071f70 0x7fc7fc1f00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.050+0000 7fc7fb200640 1 -- 172.21.15.135:0/3874254384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7fc1f0600 con 0x7fc7fc15ab20 2024-05-14T10:12:31.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.053+0000 7fc7fb200640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7fc15ab20 0x7fc7fc148900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009990 tx=0x7fc7f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:31.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.058+0000 7fc7f2a00640 1 -- 172.21.15.135:0/3874254384 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4037040 con 0x7fc7fc15ab20 2024-05-14T10:12:31.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.058+0000 7fc7f2a00640 1 -- 172.21.15.135:0/3874254384 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f4042070 con 0x7fc7fc15ab20 2024-05-14T10:12:31.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.058+0000 7fc801400640 1 -- 172.21.15.135:0/3874254384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7fc1f35b0 con 0x7fc7fc15ab20 2024-05-14T10:12:31.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.058+0000 7fc7f2a00640 1 -- 172.21.15.135:0/3874254384 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f403b8f0 con 0x7fc7fc15ab20 2024-05-14T10:12:31.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.058+0000 7fc801400640 1 -- 172.21.15.135:0/3874254384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7fc1f3b70 con 0x7fc7fc15ab20 2024-05-14T10:12:31.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.059+0000 7fc801400640 1 -- 172.21.15.135:0/3874254384 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7fc0cbf60 con 0x7fc7fc15ab20 2024-05-14T10:12:31.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.089+0000 7fc7f2a00640 1 -- 172.21.15.135:0/3874254384 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc7f402ad10 con 0x7fc7fc15ab20 2024-05-14T10:12:31.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.090+0000 7fc7f2a00640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc7dc076320 0x7fc7dc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.091+0000 7fc7fa800640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc7dc076320 0x7fc7dc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.092+0000 7fc7f2a00640 1 -- 172.21.15.135:0/3874254384 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fc7f407dc40 con 0x7fc7fc15ab20 2024-05-14T10:12:31.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.092+0000 7fc7fa800640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc7dc076320 0x7fc7dc078830 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009aa0 tx=0x7fc7ec009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:31.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.093+0000 7fc7f2a00640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] conn(0x7fc7dc07fe00 0x7fc7dc0822f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.093+0000 7fc7f2a00640 1 -- 172.21.15.135:0/3874254384 --> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7f4001d30 con 0x7fc7dc07fe00 2024-05-14T10:12:31.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.093+0000 7fc7f9e00640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] conn(0x7fc7dc07fe00 0x7fc7dc0822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.095+0000 7fc7f2a00640 1 -- 172.21.15.135:0/3874254384 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc7f407e000 con 0x7fc7fc15ab20 2024-05-14T10:12:31.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.095+0000 7fc7f9e00640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] conn(0x7fc7dc07fe00 0x7fc7dc0822f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:31.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.097+0000 7fc7f2a00640 1 -- 172.21.15.135:0/3874254384 <== osd.4 v2:172.21.15.196:6813/710239496 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc7f4001d30 con 0x7fc7dc07fe00 2024-05-14T10:12:31.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.113+0000 7fc801400640 1 -- 172.21.15.135:0/3874254384 --> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc7fc069a60 con 0x7fc7dc07fe00 2024-05-14T10:12:31.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.115+0000 7fc7f2a00640 1 -- 172.21.15.135:0/3874254384 <== osd.4 v2:172.21.15.196:6813/710239496 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc7fc069a60 con 0x7fc7dc07fe00 2024-05-14T10:12:31.115 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T10:12:31.115 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:12:31.115 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T10:12:31.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.115+0000 7fc801400640 1 -- 172.21.15.135:0/3874254384 >> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] conn(0x7fc7dc07fe00 msgr2=0x7fc7dc0822f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:31.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.115+0000 7fc801400640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.196:6813/710239496,v1:172.21.15.196:6816/710239496] conn(0x7fc7dc07fe00 0x7fc7dc0822f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.116+0000 7fc801400640 1 -- 172.21.15.135:0/3874254384 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc7dc076320 msgr2=0x7fc7dc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:31.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.116+0000 7fc801400640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc7dc076320 0x7fc7dc078830 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009aa0 tx=0x7fc7ec009190 comp rx=0 tx=0).stop 2024-05-14T10:12:31.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.116+0000 7fc801400640 1 -- 172.21.15.135:0/3874254384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7fc15ab20 msgr2=0x7fc7fc148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:31.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.116+0000 7fc801400640 1 --2- 172.21.15.135:0/3874254384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7fc15ab20 0x7fc7fc148900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009990 tx=0x7fc7f40046c0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.116+0000 7fc7fb200640 1 -- 172.21.15.135:0/3874254384 reap_dead start 2024-05-14T10:12:31.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.116+0000 7fc801400640 1 -- 172.21.15.135:0/3874254384 shutdown_connections 2024-05-14T10:12:31.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.116+0000 7fc801400640 1 -- 172.21.15.135:0/3874254384 >> 172.21.15.135:0/3874254384 conn(0x7fc7fc073d40 msgr2=0x7fc7fc0c3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:31.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.116+0000 7fc801400640 1 -- 172.21.15.135:0/3874254384 shutdown_connections 2024-05-14T10:12:31.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.116+0000 7fc801400640 1 -- 172.21.15.135:0/3874254384 wait complete. 2024-05-14T10:12:31.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-14T10:12:31.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.405+0000 7f8632c00640 1 Processor -- start 2024-05-14T10:12:31.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.405+0000 7f8632c00640 1 -- start start 2024-05-14T10:12:31.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.407+0000 7f8632c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f862c15ab20 0x7f862c153f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.407+0000 7f8632c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f862c1544b0 0x7f862c0c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.407+0000 7f8632c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f862c074ce0 con 0x7f862c071f70 2024-05-14T10:12:31.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.407+0000 7f8632c00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f862c06cde0 con 0x7f862c1544b0 2024-05-14T10:12:31.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.407+0000 7f8632c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f862c074a00 con 0x7f862c15ab20 2024-05-14T10:12:31.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.409+0000 7f8630c00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f862c071f70 0x7f862c06d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:39774/0 (socket says 172.21.15.135:39774) 2024-05-14T10:12:31.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.409+0000 7f8630c00640 1 -- 172.21.15.135:0/1384600629 learned_addr learned my addr 172.21.15.135:0/1384600629 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:31.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.410+0000 7f862be00640 1 --2- 172.21.15.135:0/1384600629 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f862c15ab20 0x7f862c153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.417+0000 7f862b400640 1 -- 172.21.15.135:0/1384600629 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564976230 0 0) 0x7f862c074ce0 con 0x7f862c071f70 2024-05-14T10:12:31.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.417+0000 7f862b400640 1 -- 172.21.15.135:0/1384600629 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8610003520 con 0x7f862c071f70 2024-05-14T10:12:31.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.418+0000 7f862be00640 1 -- 172.21.15.135:0/1384600629 >> v2:172.21.15.135:3300/0 conn(0x7f862c1544b0 msgr2=0x7f862c0c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:31.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.418+0000 7f862be00640 1 --2- 172.21.15.135:0/1384600629 >> v2:172.21.15.135:3300/0 conn(0x7f862c1544b0 0x7f862c0c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.418+0000 7f862be00640 1 -- 172.21.15.135:0/1384600629 >> v1:172.21.15.196:6789/0 conn(0x7f862c071f70 legacy=0x7f862c06d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:31.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.418+0000 7f862be00640 1 -- 172.21.15.135:0/1384600629 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f862c06c790 con 0x7f862c15ab20 2024-05-14T10:12:31.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.424+0000 7f862be00640 1 --2- 172.21.15.135:0/1384600629 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f862c15ab20 0x7f862c153f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f861c009d90 tx=0x7f861c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d61f51686bb96dd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:31.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.437+0000 7f862b400640 1 -- 172.21.15.135:0/1384600629 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c007740 con 0x7f862c15ab20 2024-05-14T10:12:31.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.437+0000 7f862b400640 1 -- 172.21.15.135:0/1384600629 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f861c0078e0 con 0x7f862c15ab20 2024-05-14T10:12:31.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.437+0000 7f862b400640 1 -- 172.21.15.135:0/1384600629 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c007cb0 con 0x7f862c15ab20 2024-05-14T10:12:31.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.438+0000 7f8632c00640 1 -- 172.21.15.135:0/1384600629 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f862c15ab20 msgr2=0x7f862c153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:31.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.438+0000 7f8632c00640 1 --2- 172.21.15.135:0/1384600629 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f862c15ab20 0x7f862c153f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f861c009d90 tx=0x7f861c02a660 comp rx=0 tx=0).stop 2024-05-14T10:12:31.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.438+0000 7f8632c00640 1 -- 172.21.15.135:0/1384600629 shutdown_connections 2024-05-14T10:12:31.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.438+0000 7f8632c00640 1 --2- 172.21.15.135:0/1384600629 >> v2:172.21.15.135:3300/0 conn(0x7f862c1544b0 0x7f862c0c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.438+0000 7f8632c00640 1 --2- 172.21.15.135:0/1384600629 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f862c15ab20 0x7f862c153f70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.438+0000 7f8632c00640 1 -- 172.21.15.135:0/1384600629 >> 172.21.15.135:0/1384600629 conn(0x7f862c073d40 msgr2=0x7f862c074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:31.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.438+0000 7f8632c00640 1 -- 172.21.15.135:0/1384600629 shutdown_connections 2024-05-14T10:12:31.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.438+0000 7f8632c00640 1 -- 172.21.15.135:0/1384600629 wait complete. 2024-05-14T10:12:31.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.441+0000 7f8632c00640 1 Processor -- start 2024-05-14T10:12:31.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.441+0000 7f8632c00640 1 -- start start 2024-05-14T10:12:31.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.442+0000 7f8632c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f862c071f70 0x7f862c14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.442+0000 7f8632c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862c1544b0 0x7f862c147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.442+0000 7f8632c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f862c15ab20 0x7f862c148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.442+0000 7f8632c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f862c06d980 con 0x7f862c1544b0 2024-05-14T10:12:31.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.442+0000 7f8632c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f862c0c4690 con 0x7f862c071f70 2024-05-14T10:12:31.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.442+0000 7f8632c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f862c06db00 con 0x7f862c15ab20 2024-05-14T10:12:31.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.443+0000 7f8623400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862c1544b0 0x7f862c147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.443+0000 7f8623400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862c1544b0 0x7f862c147b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57246/0 (socket says 172.21.15.135:57246) 2024-05-14T10:12:31.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.443+0000 7f8623400640 1 -- 172.21.15.135:0/258073210 learned_addr learned my addr 172.21.15.135:0/258073210 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:31.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.444+0000 7f862be00640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f862c071f70 0x7f862c14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.444+0000 7f8630c00640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f862c15ab20 0x7f862c148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.448+0000 7f8623400640 1 -- 172.21.15.135:0/258073210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f862c15ab20 msgr2=0x7f862c148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:31.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.448+0000 7f8623400640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f862c15ab20 0x7f862c148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.448+0000 7f8623400640 1 -- 172.21.15.135:0/258073210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f862c071f70 msgr2=0x7f862c14d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:31.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.448+0000 7f8623400640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f862c071f70 0x7f862c14d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:31.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.448+0000 7f8623400640 1 -- 172.21.15.135:0/258073210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f862c14c4c0 con 0x7f862c1544b0 2024-05-14T10:12:31.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.451+0000 7f8623400640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862c1544b0 0x7f862c147b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f861400b410 tx=0x7f861400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:31.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.455+0000 7f8628c00640 1 -- 172.21.15.135:0/258073210 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614015020 con 0x7f862c1544b0 2024-05-14T10:12:31.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.456+0000 7f8628c00640 1 -- 172.21.15.135:0/258073210 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8614011850 con 0x7f862c1544b0 2024-05-14T10:12:31.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.456+0000 7f8628c00640 1 -- 172.21.15.135:0/258073210 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614011c40 con 0x7f862c1544b0 2024-05-14T10:12:31.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.456+0000 7f8632c00640 1 -- 172.21.15.135:0/258073210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f862c14c780 con 0x7f862c1544b0 2024-05-14T10:12:31.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.456+0000 7f8632c00640 1 -- 172.21.15.135:0/258073210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f862c14dd60 con 0x7f862c1544b0 2024-05-14T10:12:31.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.457+0000 7f8632c00640 1 -- 172.21.15.135:0/258073210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f862c157a40 con 0x7f862c1544b0 2024-05-14T10:12:31.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.500+0000 7f8628c00640 1 -- 172.21.15.135:0/258073210 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8614018020 con 0x7f862c1544b0 2024-05-14T10:12:31.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.503+0000 7f8628c00640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8608076350 0x7f8608078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:31.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.504+0000 7f862be00640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8608076350 0x7f8608078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:31.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.505+0000 7f862be00640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8608076350 0x7f8608078860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f861c034000 tx=0x7f861c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:31.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.832+0000 7f8628c00640 1 -- 172.21.15.135:0/258073210 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f8614011de0 con 0x7f862c1544b0 2024-05-14T10:12:31.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:31.833+0000 7f8628c00640 1 -- 172.21.15.135:0/258073210 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f861401f020 con 0x7f862c1544b0 2024-05-14T10:12:32.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.125+0000 7f8632c00640 1 -- 172.21.15.135:0/258073210 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f862c069a60 con 0x7f8608076350 2024-05-14T10:12:32.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.126+0000 7f8628c00640 1 -- 172.21.15.135:0/258073210 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f862c069a60 con 0x7f8608076350 2024-05-14T10:12:32.127 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 4 to deep-scrub 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 -- 172.21.15.135:0/258073210 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8608076350 msgr2=0x7f8608078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8608076350 0x7f8608078860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f861c034000 tx=0x7f861c02f000 comp rx=0 tx=0).stop 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 -- 172.21.15.135:0/258073210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862c1544b0 msgr2=0x7f862c147b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862c1544b0 0x7f862c147b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f861400b410 tx=0x7f861400b8d0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 -- 172.21.15.135:0/258073210 shutdown_connections 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8608076350 0x7f8608078860 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f862c15ab20 0x7f862c148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f862c1544b0 0x7f862c147b20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 --2- 172.21.15.135:0/258073210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f862c071f70 0x7f862c14d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 -- 172.21.15.135:0/258073210 >> 172.21.15.135:0/258073210 conn(0x7f862c073d40 msgr2=0x7f862c1533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 -- 172.21.15.135:0/258073210 shutdown_connections 2024-05-14T10:12:32.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.129+0000 7f8632c00640 1 -- 172.21.15.135:0/258073210 wait complete. 2024-05-14T10:12:32.158 INFO:tasks.ceph:Scrubbing osd.5 2024-05-14T10:12:32.158 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:12:32.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.434+0000 7f35f0200640 1 Processor -- start 2024-05-14T10:12:32.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.434+0000 7f35f0200640 1 -- start start 2024-05-14T10:12:32.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.436+0000 7f35f0200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f35e8074860 0x7f35e815f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.436+0000 7f35f0200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f35e80c8310 0x7f35e815fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.436+0000 7f35f0200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35e8156780 0x7f35e80c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.436+0000 7f35f0200640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f35e80c88c0 con 0x7f35e8074860 2024-05-14T10:12:32.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.436+0000 7f35f0200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f35e815c480 con 0x7f35e80c8310 2024-05-14T10:12:32.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.436+0000 7f35f0200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f35e815c760 con 0x7f35e8156780 2024-05-14T10:12:32.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.438+0000 7f35ece00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f35e80c8310 0x7f35e815fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:32.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.439+0000 7f35ee200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35e8156780 0x7f35e80c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:32.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.439+0000 7f35ece00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f35e80c8310 0x7f35e815fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:36014/0 (socket says 172.21.15.135:36014) 2024-05-14T10:12:32.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.439+0000 7f35ece00640 1 -- 172.21.15.135:0/951292036 learned_addr learned my addr 172.21.15.135:0/951292036 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:32.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.447+0000 7f35ece00640 1 -- 172.21.15.135:0/951292036 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35e8156780 msgr2=0x7f35e80c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:32.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.447+0000 7f35ece00640 1 --2- 172.21.15.135:0/951292036 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35e8156780 0x7f35e80c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.447+0000 7f35ece00640 1 -- 172.21.15.135:0/951292036 >> v2:172.21.15.135:3300/0 conn(0x7f35e8074860 msgr2=0x7f35e815f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:32.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.447+0000 7f35ece00640 1 --2- 172.21.15.135:0/951292036 >> v2:172.21.15.135:3300/0 conn(0x7f35e8074860 0x7f35e815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.447+0000 7f35ece00640 1 -- 172.21.15.135:0/951292036 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e815ca40 con 0x7f35e80c8310 2024-05-14T10:12:32.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.453+0000 7f35ece00640 1 --2- 172.21.15.135:0/951292036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35e80c8310 0x7f35e815fea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35e80c48b0 tx=0x7f35d402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f586889950cdd6db server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:32.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.466+0000 7f35e7e00640 1 -- 172.21.15.135:0/951292036 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4037070 con 0x7f35e80c8310 2024-05-14T10:12:32.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.466+0000 7f35e7e00640 1 -- 172.21.15.135:0/951292036 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d4032440 con 0x7f35e80c8310 2024-05-14T10:12:32.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.466+0000 7f35e7e00640 1 -- 172.21.15.135:0/951292036 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4032810 con 0x7f35e80c8310 2024-05-14T10:12:32.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.467+0000 7f35f0200640 1 -- 172.21.15.135:0/951292036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35e80c8310 msgr2=0x7f35e815fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:32.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.467+0000 7f35f0200640 1 --2- 172.21.15.135:0/951292036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35e80c8310 0x7f35e815fea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35e80c48b0 tx=0x7f35d402a1e0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.467+0000 7f35f0200640 1 -- 172.21.15.135:0/951292036 shutdown_connections 2024-05-14T10:12:32.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.467+0000 7f35f0200640 1 --2- 172.21.15.135:0/951292036 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35e8156780 0x7f35e80c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.467+0000 7f35f0200640 1 --2- 172.21.15.135:0/951292036 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35e80c8310 0x7f35e815fea0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.467+0000 7f35f0200640 1 --2- 172.21.15.135:0/951292036 >> v2:172.21.15.135:3300/0 conn(0x7f35e8074860 0x7f35e815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.467+0000 7f35f0200640 1 -- 172.21.15.135:0/951292036 >> 172.21.15.135:0/951292036 conn(0x7f35e8073d40 msgr2=0x7f35e8074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:32.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.467+0000 7f35f0200640 1 -- 172.21.15.135:0/951292036 shutdown_connections 2024-05-14T10:12:32.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.467+0000 7f35f0200640 1 -- 172.21.15.135:0/951292036 wait complete. 2024-05-14T10:12:32.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.470+0000 7f35f0200640 1 Processor -- start 2024-05-14T10:12:32.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.471+0000 7f35f0200640 1 -- start start 2024-05-14T10:12:32.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.473+0000 7f35f0200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35e8074860 0x7f35e81586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.473+0000 7f35f0200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e80c8310 0x7f35e806d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.473+0000 7f35f0200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35e8156780 0x7f35e81594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.473+0000 7f35f0200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35e80c73d0 con 0x7f35e80c8310 2024-05-14T10:12:32.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.473+0000 7f35f0200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f35e80c9150 con 0x7f35e8074860 2024-05-14T10:12:32.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.473+0000 7f35f0200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f35e80c7550 con 0x7f35e8156780 2024-05-14T10:12:32.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.473+0000 7f35ece00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e80c8310 0x7f35e806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:32.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.474+0000 7f35ece00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e80c8310 0x7f35e806d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57266/0 (socket says 172.21.15.135:57266) 2024-05-14T10:12:32.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.474+0000 7f35ece00640 1 -- 172.21.15.135:0/3292471476 learned_addr learned my addr 172.21.15.135:0/3292471476 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.475+0000 7f35ed800640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35e8074860 0x7f35e81586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:32.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.475+0000 7f35ee200640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35e8156780 0x7f35e81594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:32.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.479+0000 7f35ece00640 1 -- 172.21.15.135:0/3292471476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35e8156780 msgr2=0x7f35e81594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:32.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.479+0000 7f35ece00640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f35e8156780 0x7f35e81594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.479+0000 7f35ece00640 1 -- 172.21.15.135:0/3292471476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35e8074860 msgr2=0x7f35e81586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:32.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.479+0000 7f35ece00640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f35e8074860 0x7f35e81586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.479+0000 7f35ece00640 1 -- 172.21.15.135:0/3292471476 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e8155930 con 0x7f35e80c8310 2024-05-14T10:12:32.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.482+0000 7f35ece00640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e80c8310 0x7f35e806d090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009960 tx=0x7f35d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:32.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.487+0000 7f35e5600640 1 -- 172.21.15.135:0/3292471476 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4037040 con 0x7f35e80c8310 2024-05-14T10:12:32.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.487+0000 7f35e5600640 1 -- 172.21.15.135:0/3292471476 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d4042070 con 0x7f35e80c8310 2024-05-14T10:12:32.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.487+0000 7f35e5600640 1 -- 172.21.15.135:0/3292471476 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4030960 con 0x7f35e80c8310 2024-05-14T10:12:32.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.487+0000 7f35f0200640 1 -- 172.21.15.135:0/3292471476 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e8157620 con 0x7f35e80c8310 2024-05-14T10:12:32.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.487+0000 7f35f0200640 1 -- 172.21.15.135:0/3292471476 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e8157be0 con 0x7f35e80c8310 2024-05-14T10:12:32.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.488+0000 7f35f0200640 1 -- 172.21.15.135:0/3292471476 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f35e8069a60 con 0x7f35e80c8310 2024-05-14T10:12:32.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.517+0000 7f35e5600640 1 -- 172.21.15.135:0/3292471476 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35d4030b00 con 0x7f35e80c8310 2024-05-14T10:12:32.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.518+0000 7f35e5600640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f35c8076320 0x7f35c8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.519+0000 7f35ed800640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f35c8076320 0x7f35c8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:32.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.521+0000 7f35ed800640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f35c8076320 0x7f35c8078830 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f35e8159f60 tx=0x7f35dc009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:32.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.522+0000 7f35e5600640 1 -- 172.21.15.135:0/3292471476 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f35d4030df0 con 0x7f35e80c8310 2024-05-14T10:12:32.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.522+0000 7f35e5600640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] conn(0x7f35c807fd80 0x7f35c8082270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.522+0000 7f35e5600640 1 -- 172.21.15.135:0/3292471476 --> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35d4001d30 con 0x7f35c807fd80 2024-05-14T10:12:32.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.523+0000 7f35ee200640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] conn(0x7f35c807fd80 0x7f35c8082270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:32.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.524+0000 7f35ee200640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] conn(0x7f35c807fd80 0x7f35c8082270 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:32.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.525+0000 7f35e5600640 1 -- 172.21.15.135:0/3292471476 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f35d407e240 con 0x7f35e80c8310 2024-05-14T10:12:32.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.526+0000 7f35e5600640 1 -- 172.21.15.135:0/3292471476 <== osd.5 v2:172.21.15.196:6808/1160661510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f35d4001d30 con 0x7f35c807fd80 2024-05-14T10:12:32.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.542+0000 7f35f0200640 1 -- 172.21.15.135:0/3292471476 --> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f35e80c6990 con 0x7f35c807fd80 2024-05-14T10:12:32.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.543+0000 7f35e5600640 1 -- 172.21.15.135:0/3292471476 <== osd.5 v2:172.21.15.196:6808/1160661510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f35e80c6990 con 0x7f35c807fd80 2024-05-14T10:12:32.544 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T10:12:32.544 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:12:32.544 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T10:12:32.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.544+0000 7f35f0200640 1 -- 172.21.15.135:0/3292471476 >> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] conn(0x7f35c807fd80 msgr2=0x7f35c8082270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:32.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.544+0000 7f35f0200640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.196:6808/1160661510,v1:172.21.15.196:6809/1160661510] conn(0x7f35c807fd80 0x7f35c8082270 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.544+0000 7f35f0200640 1 -- 172.21.15.135:0/3292471476 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f35c8076320 msgr2=0x7f35c8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:32.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.544+0000 7f35f0200640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f35c8076320 0x7f35c8078830 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f35e8159f60 tx=0x7f35dc009060 comp rx=0 tx=0).stop 2024-05-14T10:12:32.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.544+0000 7f35f0200640 1 -- 172.21.15.135:0/3292471476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e80c8310 msgr2=0x7f35e806d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:32.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.544+0000 7f35f0200640 1 --2- 172.21.15.135:0/3292471476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e80c8310 0x7f35e806d090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009960 tx=0x7f35d40046c0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.544+0000 7f35ee200640 1 -- 172.21.15.135:0/3292471476 reap_dead start 2024-05-14T10:12:32.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.544+0000 7f35f0200640 1 -- 172.21.15.135:0/3292471476 shutdown_connections 2024-05-14T10:12:32.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.544+0000 7f35f0200640 1 -- 172.21.15.135:0/3292471476 >> 172.21.15.135:0/3292471476 conn(0x7f35e8073d40 msgr2=0x7f35e80c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:32.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.544+0000 7f35f0200640 1 -- 172.21.15.135:0/3292471476 shutdown_connections 2024-05-14T10:12:32.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.544+0000 7f35f0200640 1 -- 172.21.15.135:0/3292471476 wait complete. 2024-05-14T10:12:32.577 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-14T10:12:32.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.848+0000 7f1043c00640 1 Processor -- start 2024-05-14T10:12:32.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.849+0000 7f1043c00640 1 -- start start 2024-05-14T10:12:32.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.851+0000 7f1043c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f103c06c6f0 0x7f103c0c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.851+0000 7f1043c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f103c0c6910 0x7f103c166e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.851+0000 7f1043c00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f103c0b5c80 con 0x7f103c0cdf50 2024-05-14T10:12:32.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.851+0000 7f1043c00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f103c0c74a0 con 0x7f103c0c6910 2024-05-14T10:12:32.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.851+0000 7f1043c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f103c0c7780 con 0x7f103c06c6f0 2024-05-14T10:12:32.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.853+0000 7f1041200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f103c06c6f0 0x7f103c0c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:32.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.853+0000 7f1041200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f103c06c6f0 0x7f103c0c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:36024/0 (socket says 172.21.15.135:36024) 2024-05-14T10:12:32.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.853+0000 7f1041200640 1 -- 172.21.15.135:0/1389684072 learned_addr learned my addr 172.21.15.135:0/1389684072 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:32.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.861+0000 7f1041200640 1 -- 172.21.15.135:0/1389684072 >> v2:172.21.15.135:3300/0 conn(0x7f103c0c6910 msgr2=0x7f103c166e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:32.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.861+0000 7f1041200640 1 --2- 172.21.15.135:0/1389684072 >> v2:172.21.15.135:3300/0 conn(0x7f103c0c6910 0x7f103c166e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.861+0000 7f1041200640 1 -- 172.21.15.135:0/1389684072 >> v1:172.21.15.135:6789/0 conn(0x7f103c0cdf50 legacy=0x7f103c0cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:32.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.861+0000 7f1041200640 1 -- 172.21.15.135:0/1389684072 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c0c7a60 con 0x7f103c06c6f0 2024-05-14T10:12:32.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.866+0000 7f1041200640 1 --2- 172.21.15.135:0/1389684072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f103c06c6f0 0x7f103c0c8540 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f103c06fbf0 tx=0x7f103002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82073025c3b96c42 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:32.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.879+0000 7f103b400640 1 -- 172.21.15.135:0/1389684072 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1030037070 con 0x7f103c06c6f0 2024-05-14T10:12:32.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.879+0000 7f103b400640 1 -- 172.21.15.135:0/1389684072 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1030032440 con 0x7f103c06c6f0 2024-05-14T10:12:32.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.879+0000 7f103b400640 1 -- 172.21.15.135:0/1389684072 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1030032810 con 0x7f103c06c6f0 2024-05-14T10:12:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.880+0000 7f1043c00640 1 -- 172.21.15.135:0/1389684072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f103c06c6f0 msgr2=0x7f103c0c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.880+0000 7f1043c00640 1 --2- 172.21.15.135:0/1389684072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f103c06c6f0 0x7f103c0c8540 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f103c06fbf0 tx=0x7f103002a1c0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.880+0000 7f1043c00640 1 -- 172.21.15.135:0/1389684072 shutdown_connections 2024-05-14T10:12:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.880+0000 7f1043c00640 1 --2- 172.21.15.135:0/1389684072 >> v2:172.21.15.135:3300/0 conn(0x7f103c0c6910 0x7f103c166e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.880+0000 7f1043c00640 1 --2- 172.21.15.135:0/1389684072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f103c06c6f0 0x7f103c0c8540 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.880+0000 7f1043c00640 1 -- 172.21.15.135:0/1389684072 >> 172.21.15.135:0/1389684072 conn(0x7f103c0ce3f0 msgr2=0x7f103c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.881+0000 7f1043c00640 1 -- 172.21.15.135:0/1389684072 shutdown_connections 2024-05-14T10:12:32.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.881+0000 7f1043c00640 1 -- 172.21.15.135:0/1389684072 wait complete. 2024-05-14T10:12:32.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.883+0000 7f1043c00640 1 Processor -- start 2024-05-14T10:12:32.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.883+0000 7f1043c00640 1 -- start start 2024-05-14T10:12:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.885+0000 7f1043c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f103c06c6f0 0x7f103c14f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.885+0000 7f1043c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f103c0c6910 0x7f103c1f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.885+0000 7f1043c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f103c0cdf50 0x7f103c150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.885+0000 7f1043c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f103c0c8a80 con 0x7f103c0cdf50 2024-05-14T10:12:32.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.885+0000 7f1043c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f103c0c8020 con 0x7f103c0c6910 2024-05-14T10:12:32.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.885+0000 7f1043c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f103c0cd870 con 0x7f103c06c6f0 2024-05-14T10:12:32.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.888+0000 7f1041c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f103c0cdf50 0x7f103c150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:32.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.889+0000 7f1041c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f103c0cdf50 0x7f103c150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57272/0 (socket says 172.21.15.135:57272) 2024-05-14T10:12:32.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.889+0000 7f1041c00640 1 -- 172.21.15.135:0/2994432401 learned_addr learned my addr 172.21.15.135:0/2994432401 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.892+0000 7f1041200640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f103c06c6f0 0x7f103c14f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:32.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.894+0000 7f1041c00640 1 -- 172.21.15.135:0/2994432401 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f103c06c6f0 msgr2=0x7f103c14f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:32.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.894+0000 7f1041c00640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f103c06c6f0 0x7f103c14f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.894+0000 7f1041c00640 1 -- 172.21.15.135:0/2994432401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f103c0c6910 msgr2=0x7f103c1f56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:32.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.894+0000 7f1041c00640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f103c0c6910 0x7f103c1f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:32.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.894+0000 7f1041c00640 1 -- 172.21.15.135:0/2994432401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c14ff30 con 0x7f103c0cdf50 2024-05-14T10:12:32.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.897+0000 7f1041c00640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f103c0cdf50 0x7f103c150c70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f103400ba10 tx=0x7f103400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.901+0000 7f1038c00640 1 -- 172.21.15.135:0/2994432401 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034019070 con 0x7f103c0cdf50 2024-05-14T10:12:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.901+0000 7f1043c00640 1 -- 172.21.15.135:0/2994432401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103c1f5c10 con 0x7f103c0cdf50 2024-05-14T10:12:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.901+0000 7f1043c00640 1 -- 172.21.15.135:0/2994432401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103c1f3430 con 0x7f103c0cdf50 2024-05-14T10:12:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:32.902+0000 7f1043c00640 1 -- 172.21.15.135:0/2994432401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f103c069a60 con 0x7f103c0cdf50 2024-05-14T10:12:32.989 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:12:32.997 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:12:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.213+0000 7f1038c00640 1 -- 172.21.15.135:0/2994432401 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103400cb40 con 0x7f103c0cdf50 2024-05-14T10:12:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.213+0000 7f1038c00640 1 -- 172.21.15.135:0/2994432401 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034023060 con 0x7f103c0cdf50 2024-05-14T10:12:33.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.216+0000 7f1038c00640 1 -- 172.21.15.135:0/2994432401 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f103401c070 con 0x7f103c0cdf50 2024-05-14T10:12:33.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.217+0000 7f1038c00640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f101c0762d0 0x7f101c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:33.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.218+0000 7f1041200640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f101c0762d0 0x7f101c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:33.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.219+0000 7f1041200640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f101c0762d0 0x7f101c0787e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1030034000 tx=0x7f103002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:33.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.260+0000 7f1038c00640 1 -- 172.21.15.135:0/2994432401 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f1034096170 con 0x7f103c0cdf50 2024-05-14T10:12:33.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.261+0000 7f1038c00640 1 -- 172.21.15.135:0/2994432401 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1034060db0 con 0x7f103c0cdf50 2024-05-14T10:12:33.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.504+0000 7f1043c00640 1 -- 172.21.15.135:0/2994432401 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f103c06cfa0 con 0x7f101c0762d0 2024-05-14T10:12:33.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.505+0000 7f1038c00640 1 -- 172.21.15.135:0/2994432401 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f103c06cfa0 con 0x7f101c0762d0 2024-05-14T10:12:33.505 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 5 to deep-scrub 2024-05-14T10:12:33.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.507+0000 7f1043c00640 1 -- 172.21.15.135:0/2994432401 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f101c0762d0 msgr2=0x7f101c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:33.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.507+0000 7f1043c00640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f101c0762d0 0x7f101c0787e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1030034000 tx=0x7f103002e000 comp rx=0 tx=0).stop 2024-05-14T10:12:33.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.507+0000 7f1043c00640 1 -- 172.21.15.135:0/2994432401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f103c0cdf50 msgr2=0x7f103c150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:33.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.507+0000 7f1043c00640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f103c0cdf50 0x7f103c150c70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f103400ba10 tx=0x7f103400bed0 comp rx=0 tx=0).stop 2024-05-14T10:12:33.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.508+0000 7f1043c00640 1 -- 172.21.15.135:0/2994432401 shutdown_connections 2024-05-14T10:12:33.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.508+0000 7f1043c00640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f101c0762d0 0x7f101c0787e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:33.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.508+0000 7f1043c00640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f103c0c6910 0x7f103c1f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:33.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.508+0000 7f1043c00640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f103c0cdf50 0x7f103c150c70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:33.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.508+0000 7f1043c00640 1 --2- 172.21.15.135:0/2994432401 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f103c06c6f0 0x7f103c14f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:33.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.508+0000 7f1043c00640 1 -- 172.21.15.135:0/2994432401 >> 172.21.15.135:0/2994432401 conn(0x7f103c0ce3f0 msgr2=0x7f103c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:33.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.508+0000 7f1043c00640 1 -- 172.21.15.135:0/2994432401 shutdown_connections 2024-05-14T10:12:33.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.508+0000 7f1043c00640 1 -- 172.21.15.135:0/2994432401 wait complete. 2024-05-14T10:12:33.535 INFO:tasks.ceph:Scrubbing osd.6 2024-05-14T10:12:33.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:12:33.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.803+0000 7f3e7d200640 1 Processor -- start 2024-05-14T10:12:33.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.804+0000 7f3e7d200640 1 -- start start 2024-05-14T10:12:33.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.806+0000 7f3e7d200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e78150b20 0x7f3e7806c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:33.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.806+0000 7f3e7d200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e7815aa90 0x7f3e780c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:33.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.806+0000 7f3e7d200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7806cfe0 con 0x7f3e780c8640 2024-05-14T10:12:33.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.806+0000 7f3e7d200640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f3e78071ab0 con 0x7f3e78150b20 2024-05-14T10:12:33.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.806+0000 7f3e7d200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7806cdc0 con 0x7f3e7815aa90 2024-05-14T10:12:33.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.807+0000 7f3e77400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e78150b20 0x7f3e7806c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:33.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.807+0000 7f3e77400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3e78150b20 0x7f3e7806c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57288/0 (socket says 172.21.15.135:57288) 2024-05-14T10:12:33.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.807+0000 7f3e77400640 1 -- 172.21.15.135:0/966294149 learned_addr learned my addr 172.21.15.135:0/966294149 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:33.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.808+0000 7f3e6fe00640 1 --2- 172.21.15.135:0/966294149 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e7815aa90 0x7f3e780c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:33.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.811+0000 7f3e77400640 1 -- 172.21.15.135:0/966294149 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e7815aa90 msgr2=0x7f3e780c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:33.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.811+0000 7f3e77400640 1 --2- 172.21.15.135:0/966294149 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e7815aa90 0x7f3e780c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:33.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.811+0000 7f3e77400640 1 -- 172.21.15.135:0/966294149 >> v1:172.21.15.196:6789/0 conn(0x7f3e780c8640 legacy=0x7f3e780c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:33.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.811+0000 7f3e77400640 1 -- 172.21.15.135:0/966294149 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e78070cf0 con 0x7f3e78150b20 2024-05-14T10:12:33.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.813+0000 7f3e77400640 1 --2- 172.21.15.135:0/966294149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e78150b20 0x7f3e7806c880 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009870 tx=0x7f3e6802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85539429cefc64cc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:33.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.815+0000 7f3e76a00640 1 -- 172.21.15.135:0/966294149 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68037070 con 0x7f3e78150b20 2024-05-14T10:12:33.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.817+0000 7f3e76a00640 1 -- 172.21.15.135:0/966294149 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6802ae50 con 0x7f3e78150b20 2024-05-14T10:12:33.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.817+0000 7f3e76a00640 1 -- 172.21.15.135:0/966294149 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68032860 con 0x7f3e78150b20 2024-05-14T10:12:33.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.819+0000 7f3e7d200640 1 -- 172.21.15.135:0/966294149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e78150b20 msgr2=0x7f3e7806c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:33.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.819+0000 7f3e7d200640 1 --2- 172.21.15.135:0/966294149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e78150b20 0x7f3e7806c880 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009870 tx=0x7f3e6802a300 comp rx=0 tx=0).stop 2024-05-14T10:12:33.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.819+0000 7f3e7d200640 1 -- 172.21.15.135:0/966294149 shutdown_connections 2024-05-14T10:12:33.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.819+0000 7f3e7d200640 1 --2- 172.21.15.135:0/966294149 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e7815aa90 0x7f3e780c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:33.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.819+0000 7f3e7d200640 1 --2- 172.21.15.135:0/966294149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e78150b20 0x7f3e7806c880 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:33.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.819+0000 7f3e7d200640 1 -- 172.21.15.135:0/966294149 >> 172.21.15.135:0/966294149 conn(0x7f3e780ca160 msgr2=0x7f3e780ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:33.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.819+0000 7f3e7d200640 1 -- 172.21.15.135:0/966294149 shutdown_connections 2024-05-14T10:12:33.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.819+0000 7f3e7d200640 1 -- 172.21.15.135:0/966294149 wait complete. 2024-05-14T10:12:33.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.823+0000 7f3e7d200640 1 Processor -- start 2024-05-14T10:12:33.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.823+0000 7f3e7d200640 1 -- start start 2024-05-14T10:12:33.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.825+0000 7f3e7d200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e780c8640 0x7f3e7815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:33.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.825+0000 7f3e7d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e78150b20 0x7f3e78158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:33.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.826+0000 7f3e7d200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e7815aa90 0x7f3e780cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:33.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.826+0000 7f3e7d200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e78071620 con 0x7f3e78150b20 2024-05-14T10:12:33.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.826+0000 7f3e7d200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3e78150f30 con 0x7f3e7815aa90 2024-05-14T10:12:33.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.826+0000 7f3e7d200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f3e780712b0 con 0x7f3e780c8640 2024-05-14T10:12:33.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.826+0000 7f3e6fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e78150b20 0x7f3e78158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:33.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.827+0000 7f3e6fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e78150b20 0x7f3e78158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35604/0 (socket says 172.21.15.135:35604) 2024-05-14T10:12:33.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.827+0000 7f3e6fe00640 1 -- 172.21.15.135:0/599383737 learned_addr learned my addr 172.21.15.135:0/599383737 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:33.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.828+0000 7f3e77e00640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e7815aa90 0x7f3e780cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:33.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.832+0000 7f3e6fe00640 1 -- 172.21.15.135:0/599383737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e780c8640 msgr2=0x7f3e7815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:33.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.832+0000 7f3e6fe00640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3e780c8640 0x7f3e7815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:33.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.832+0000 7f3e6fe00640 1 -- 172.21.15.135:0/599383737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e7815aa90 msgr2=0x7f3e780cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:33.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.832+0000 7f3e6fe00640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3e7815aa90 0x7f3e780cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:33.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.832+0000 7f3e6fe00640 1 -- 172.21.15.135:0/599383737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7815b740 con 0x7f3e78150b20 2024-05-14T10:12:33.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.838+0000 7f3e6fe00640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e78150b20 0x7f3e78158f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000e870 tx=0x7f3e6000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:33.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.846+0000 7f3e6f400640 1 -- 172.21.15.135:0/599383737 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60017070 con 0x7f3e78150b20 2024-05-14T10:12:33.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.846+0000 7f3e6f400640 1 -- 172.21.15.135:0/599383737 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6000c940 con 0x7f3e78150b20 2024-05-14T10:12:33.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.846+0000 7f3e6f400640 1 -- 172.21.15.135:0/599383737 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000cd30 con 0x7f3e78150b20 2024-05-14T10:12:33.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.846+0000 7f3e7d200640 1 -- 172.21.15.135:0/599383737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e781599f0 con 0x7f3e78150b20 2024-05-14T10:12:33.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.847+0000 7f3e7d200640 1 -- 172.21.15.135:0/599383737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e780c66a0 con 0x7f3e78150b20 2024-05-14T10:12:33.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.848+0000 7f3e7d200640 1 -- 172.21.15.135:0/599383737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e78069980 con 0x7f3e78150b20 2024-05-14T10:12:33.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.873+0000 7f3e6f400640 1 -- 172.21.15.135:0/599383737 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3e6001a070 con 0x7f3e78150b20 2024-05-14T10:12:33.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.875+0000 7f3e6f400640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3e54076320 0x7f3e54078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:33.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.875+0000 7f3e77400640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3e54076320 0x7f3e54078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:33.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.876+0000 7f3e77400640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3e54076320 0x7f3e54078830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3e68034000 tx=0x7f3e6802c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:33.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.880+0000 7f3e6f400640 1 -- 172.21.15.135:0/599383737 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f3e6005cd70 con 0x7f3e78150b20 2024-05-14T10:12:33.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.880+0000 7f3e6f400640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] conn(0x7f3e5407fe00 0x7f3e540822f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:33.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.880+0000 7f3e6f400640 1 -- 172.21.15.135:0/599383737 --> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e60016ec0 con 0x7f3e5407fe00 2024-05-14T10:12:33.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.880+0000 7f3e6f400640 1 -- 172.21.15.135:0/599383737 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3e6005d130 con 0x7f3e78150b20 2024-05-14T10:12:33.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.881+0000 7f3e77e00640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] conn(0x7f3e5407fe00 0x7f3e540822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:33.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.882+0000 7f3e77e00640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] conn(0x7f3e5407fe00 0x7f3e540822f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:33.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.884+0000 7f3e6f400640 1 -- 172.21.15.135:0/599383737 <== osd.6 v2:172.21.15.196:6819/2170854383 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e60016ec0 con 0x7f3e5407fe00 2024-05-14T10:12:33.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.902+0000 7f3e7d200640 1 -- 172.21.15.135:0/599383737 --> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3e780c6450 con 0x7f3e5407fe00 2024-05-14T10:12:33.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.903+0000 7f3e6f400640 1 -- 172.21.15.135:0/599383737 <== osd.6 v2:172.21.15.196:6819/2170854383 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3e780c6450 con 0x7f3e5407fe00 2024-05-14T10:12:33.903 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T10:12:33.903 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:12:33.903 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T10:12:33.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.903+0000 7f3e7d200640 1 -- 172.21.15.135:0/599383737 >> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] conn(0x7f3e5407fe00 msgr2=0x7f3e540822f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:33.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.903+0000 7f3e7d200640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.196:6819/2170854383,v1:172.21.15.196:6820/2170854383] conn(0x7f3e5407fe00 0x7f3e540822f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:33.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.904+0000 7f3e7d200640 1 -- 172.21.15.135:0/599383737 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3e54076320 msgr2=0x7f3e54078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:33.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.904+0000 7f3e7d200640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f3e54076320 0x7f3e54078830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3e68034000 tx=0x7f3e6802c000 comp rx=0 tx=0).stop 2024-05-14T10:12:33.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.904+0000 7f3e7d200640 1 -- 172.21.15.135:0/599383737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e78150b20 msgr2=0x7f3e78158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:33.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.904+0000 7f3e7d200640 1 --2- 172.21.15.135:0/599383737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e78150b20 0x7f3e78158f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000e870 tx=0x7f3e6000ed30 comp rx=0 tx=0).stop 2024-05-14T10:12:33.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.904+0000 7f3e77e00640 1 -- 172.21.15.135:0/599383737 reap_dead start 2024-05-14T10:12:33.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.904+0000 7f3e7d200640 1 -- 172.21.15.135:0/599383737 shutdown_connections 2024-05-14T10:12:33.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.904+0000 7f3e7d200640 1 -- 172.21.15.135:0/599383737 >> 172.21.15.135:0/599383737 conn(0x7f3e780ca160 msgr2=0x7f3e780c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:33.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.904+0000 7f3e7d200640 1 -- 172.21.15.135:0/599383737 shutdown_connections 2024-05-14T10:12:33.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:33.904+0000 7f3e7d200640 1 -- 172.21.15.135:0/599383737 wait complete. 2024-05-14T10:12:33.937 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-14T10:12:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.195+0000 7fbecc600640 1 Processor -- start 2024-05-14T10:12:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.195+0000 7fbecc600640 1 -- start start 2024-05-14T10:12:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.197+0000 7fbecc600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbec4074860 0x7fbec415f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.197+0000 7fbecc600640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbec40c8310 0x7fbec415fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:34.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.197+0000 7fbecc600640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec40c88c0 con 0x7fbec4156780 2024-05-14T10:12:34.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.197+0000 7fbecc600640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fbec415c480 con 0x7fbec40c8310 2024-05-14T10:12:34.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.197+0000 7fbecc600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fbec415c760 con 0x7fbec4074860 2024-05-14T10:12:34.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.198+0000 7fbec9200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbec40c8310 0x7fbec415fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:34.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.199+0000 7fbeca600640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fbec4156780 0x7fbec40c6e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:46858/0 (socket says 172.21.15.135:46858) 2024-05-14T10:12:34.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.199+0000 7fbeca600640 1 -- 172.21.15.135:0/2077332340 learned_addr learned my addr 172.21.15.135:0/2077332340 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:34.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.199+0000 7fbec9c00640 1 --2- 172.21.15.135:0/2077332340 >> v2:172.21.15.196:3300/0 conn(0x7fbec4074860 0x7fbec415f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.203+0000 7fbec9200640 1 -- 172.21.15.135:0/2077332340 >> v2:172.21.15.196:3300/0 conn(0x7fbec4074860 msgr2=0x7fbec415f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.203+0000 7fbec9200640 1 --2- 172.21.15.135:0/2077332340 >> v2:172.21.15.196:3300/0 conn(0x7fbec4074860 0x7fbec415f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.203+0000 7fbec9200640 1 -- 172.21.15.135:0/2077332340 >> v1:172.21.15.135:6789/0 conn(0x7fbec4156780 legacy=0x7fbec40c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:34.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.203+0000 7fbec9200640 1 -- 172.21.15.135:0/2077332340 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec415ca40 con 0x7fbec40c8310 2024-05-14T10:12:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.209+0000 7fbec9200640 1 --2- 172.21.15.135:0/2077332340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec40c8310 0x7fbec415fea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbec4072de0 tx=0x7fbeb002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7518388f40a8f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:34.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.215+0000 7fbec3e00640 1 -- 172.21.15.135:0/2077332340 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0037070 con 0x7fbec40c8310 2024-05-14T10:12:34.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.215+0000 7fbec3e00640 1 -- 172.21.15.135:0/2077332340 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb0032440 con 0x7fbec40c8310 2024-05-14T10:12:34.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.215+0000 7fbec3e00640 1 -- 172.21.15.135:0/2077332340 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0032810 con 0x7fbec40c8310 2024-05-14T10:12:34.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.216+0000 7fbecc600640 1 -- 172.21.15.135:0/2077332340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec40c8310 msgr2=0x7fbec415fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:34.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.216+0000 7fbecc600640 1 --2- 172.21.15.135:0/2077332340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec40c8310 0x7fbec415fea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbec4072de0 tx=0x7fbeb002a1a0 comp rx=0 tx=0).stop 2024-05-14T10:12:34.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.216+0000 7fbecc600640 1 -- 172.21.15.135:0/2077332340 shutdown_connections 2024-05-14T10:12:34.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.216+0000 7fbecc600640 1 --2- 172.21.15.135:0/2077332340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec40c8310 0x7fbec415fea0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:34.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.216+0000 7fbecc600640 1 --2- 172.21.15.135:0/2077332340 >> v2:172.21.15.196:3300/0 conn(0x7fbec4074860 0x7fbec415f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:34.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.216+0000 7fbecc600640 1 -- 172.21.15.135:0/2077332340 >> 172.21.15.135:0/2077332340 conn(0x7fbec4073d40 msgr2=0x7fbec4074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:34.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.216+0000 7fbecc600640 1 -- 172.21.15.135:0/2077332340 shutdown_connections 2024-05-14T10:12:34.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.216+0000 7fbecc600640 1 -- 172.21.15.135:0/2077332340 wait complete. 2024-05-14T10:12:34.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.220+0000 7fbecc600640 1 Processor -- start 2024-05-14T10:12:34.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.221+0000 7fbecc600640 1 -- start start 2024-05-14T10:12:34.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.222+0000 7fbecc600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec4074860 0x7fbec41f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:34.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.222+0000 7fbecc600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec40c8310 0x7fbec414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:34.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.222+0000 7fbecc600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbec4156780 0x7fbec41497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:34.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.222+0000 7fbecc600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbec40c75a0 con 0x7fbec4074860 2024-05-14T10:12:34.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.222+0000 7fbecc600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbec40c9150 con 0x7fbec4156780 2024-05-14T10:12:34.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.222+0000 7fbecc600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fbec40c7720 con 0x7fbec40c8310 2024-05-14T10:12:34.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.224+0000 7fbec9c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec4074860 0x7fbec41f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:34.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.224+0000 7fbec9c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec4074860 0x7fbec41f3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35634/0 (socket says 172.21.15.135:35634) 2024-05-14T10:12:34.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.224+0000 7fbec9c00640 1 -- 172.21.15.135:0/2239359324 learned_addr learned my addr 172.21.15.135:0/2239359324 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:34.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.225+0000 7fbeca600640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbec4156780 0x7fbec41497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:34.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.225+0000 7fbec9200640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec40c8310 0x7fbec414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:34.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.229+0000 7fbec9c00640 1 -- 172.21.15.135:0/2239359324 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec40c8310 msgr2=0x7fbec414c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:34.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.229+0000 7fbec9c00640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec40c8310 0x7fbec414c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:34.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.229+0000 7fbec9c00640 1 -- 172.21.15.135:0/2239359324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbec4156780 msgr2=0x7fbec41497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:34.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.229+0000 7fbec9c00640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbec4156780 0x7fbec41497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:34.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.229+0000 7fbec9c00640 1 -- 172.21.15.135:0/2239359324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec41f40a0 con 0x7fbec4074860 2024-05-14T10:12:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.231+0000 7fbec9c00640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec4074860 0x7fbec41f3b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800e870 tx=0x7fbeb800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.236+0000 7fbec1600640 1 -- 172.21.15.135:0/2239359324 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8017070 con 0x7fbec4074860 2024-05-14T10:12:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.236+0000 7fbec1600640 1 -- 172.21.15.135:0/2239359324 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb800c940 con 0x7fbec4074860 2024-05-14T10:12:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.236+0000 7fbec1600640 1 -- 172.21.15.135:0/2239359324 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb800cd10 con 0x7fbec4074860 2024-05-14T10:12:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.236+0000 7fbecc600640 1 -- 172.21.15.135:0/2239359324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec4154f40 con 0x7fbec4074860 2024-05-14T10:12:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.236+0000 7fbecc600640 1 -- 172.21.15.135:0/2239359324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec4155500 con 0x7fbec4074860 2024-05-14T10:12:34.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.238+0000 7fbecc600640 1 -- 172.21.15.135:0/2239359324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec4153ec0 con 0x7fbec4074860 2024-05-14T10:12:34.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.528+0000 7fbec1600640 1 -- 172.21.15.135:0/2239359324 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbeb801a070 con 0x7fbec4074860 2024-05-14T10:12:34.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.529+0000 7fbec1600640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbea4076320 0x7fbea4078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:34.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.530+0000 7fbec9200640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbea4076320 0x7fbea4078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:34.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.532+0000 7fbec9200640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbea4076320 0x7fbea4078830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0034000 tx=0x7fbeb002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:34.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.547+0000 7fbec1600640 1 -- 172.21.15.135:0/2239359324 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fbeb805d160 con 0x7fbec4074860 2024-05-14T10:12:34.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.547+0000 7fbec1600640 1 -- 172.21.15.135:0/2239359324 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbec4153ec0 con 0x7fbec4074860 2024-05-14T10:12:34.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.785+0000 7fbecc600640 1 -- 172.21.15.135:0/2239359324 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fbec4155b50 con 0x7fbea4076320 2024-05-14T10:12:34.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.786+0000 7fbec1600640 1 -- 172.21.15.135:0/2239359324 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbec4155b50 con 0x7fbea4076320 2024-05-14T10:12:34.786 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 6 to deep-scrub 2024-05-14T10:12:34.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 -- 172.21.15.135:0/2239359324 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbea4076320 msgr2=0x7fbea4078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:34.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbea4076320 0x7fbea4078830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0034000 tx=0x7fbeb002e000 comp rx=0 tx=0).stop 2024-05-14T10:12:34.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 -- 172.21.15.135:0/2239359324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec4074860 msgr2=0x7fbec41f3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:34.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec4074860 0x7fbec41f3b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800e870 tx=0x7fbeb800ed30 comp rx=0 tx=0).stop 2024-05-14T10:12:34.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 -- 172.21.15.135:0/2239359324 shutdown_connections 2024-05-14T10:12:34.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fbea4076320 0x7fbea4078830 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:34.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbec4156780 0x7fbec41497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:34.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec40c8310 0x7fbec414c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:34.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 --2- 172.21.15.135:0/2239359324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec4074860 0x7fbec41f3b60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:34.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 -- 172.21.15.135:0/2239359324 >> 172.21.15.135:0/2239359324 conn(0x7fbec4073d40 msgr2=0x7fbec40cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:34.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 -- 172.21.15.135:0/2239359324 shutdown_connections 2024-05-14T10:12:34.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:34.789+0000 7fbecc600640 1 -- 172.21.15.135:0/2239359324 wait complete. 2024-05-14T10:12:34.813 INFO:tasks.ceph:Scrubbing osd.7 2024-05-14T10:12:34.813 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-14T10:12:35.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.073+0000 7f66a7c00640 1 Processor -- start 2024-05-14T10:12:35.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.073+0000 7f66a7c00640 1 -- start start 2024-05-14T10:12:35.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.075+0000 7f66a7c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f66a00c4810 0x7f66a01566c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.075+0000 7f66a7c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66a006d670 0x7f66a00c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.075+0000 7f66a7c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a006f9f0 con 0x7f66a00c95d0 2024-05-14T10:12:35.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.075+0000 7f66a7c00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f66a015d450 con 0x7f66a006d670 2024-05-14T10:12:35.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.075+0000 7f66a7c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f66a006e040 con 0x7f66a00c4810 2024-05-14T10:12:35.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.076+0000 7f669fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66a006d670 0x7f66a00c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:35.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.076+0000 7f669fe00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f66a006d670 0x7f66a00c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35636/0 (socket says 172.21.15.135:35636) 2024-05-14T10:12:35.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.076+0000 7f669fe00640 1 -- 172.21.15.135:0/4116992342 learned_addr learned my addr 172.21.15.135:0/4116992342 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:35.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.079+0000 7f669fe00640 1 -- 172.21.15.135:0/4116992342 >> v2:172.21.15.196:3300/0 conn(0x7f66a00c4810 msgr2=0x7f66a01566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:35.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.079+0000 7f669fe00640 1 --2- 172.21.15.135:0/4116992342 >> v2:172.21.15.196:3300/0 conn(0x7f66a00c4810 0x7f66a01566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.079+0000 7f669fe00640 1 -- 172.21.15.135:0/4116992342 >> v1:172.21.15.196:6789/0 conn(0x7f66a00c95d0 legacy=0x7f66a00c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:35.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.079+0000 7f669fe00640 1 -- 172.21.15.135:0/4116992342 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a015c690 con 0x7f66a006d670 2024-05-14T10:12:35.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.084+0000 7f669fe00640 1 --2- 172.21.15.135:0/4116992342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a006d670 0x7f66a00c9090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f66a0071d20 tx=0x7f668c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4776b8926cd371 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:35.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.088+0000 7f669f400640 1 -- 172.21.15.135:0/4116992342 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c037070 con 0x7f66a006d670 2024-05-14T10:12:35.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.088+0000 7f669f400640 1 -- 172.21.15.135:0/4116992342 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668c032440 con 0x7f66a006d670 2024-05-14T10:12:35.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.088+0000 7f669f400640 1 -- 172.21.15.135:0/4116992342 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c032810 con 0x7f66a006d670 2024-05-14T10:12:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.089+0000 7f66a7c00640 1 -- 172.21.15.135:0/4116992342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a006d670 msgr2=0x7f66a00c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.089+0000 7f66a7c00640 1 --2- 172.21.15.135:0/4116992342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a006d670 0x7f66a00c9090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f66a0071d20 tx=0x7f668c02a140 comp rx=0 tx=0).stop 2024-05-14T10:12:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.089+0000 7f66a7c00640 1 -- 172.21.15.135:0/4116992342 shutdown_connections 2024-05-14T10:12:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.089+0000 7f66a7c00640 1 --2- 172.21.15.135:0/4116992342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a006d670 0x7f66a00c9090 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.089+0000 7f66a7c00640 1 --2- 172.21.15.135:0/4116992342 >> v2:172.21.15.196:3300/0 conn(0x7f66a00c4810 0x7f66a01566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.089+0000 7f66a7c00640 1 -- 172.21.15.135:0/4116992342 >> 172.21.15.135:0/4116992342 conn(0x7f66a00cb190 msgr2=0x7f66a00cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.089+0000 7f66a7c00640 1 -- 172.21.15.135:0/4116992342 shutdown_connections 2024-05-14T10:12:35.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.089+0000 7f66a7c00640 1 -- 172.21.15.135:0/4116992342 wait complete. 2024-05-14T10:12:35.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.092+0000 7f66a7c00640 1 Processor -- start 2024-05-14T10:12:35.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.092+0000 7f66a7c00640 1 -- start start 2024-05-14T10:12:35.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.093+0000 7f66a7c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f66a006d670 0x7f66a0149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.093+0000 7f66a7c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a00c4810 0x7f66a01f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.093+0000 7f66a7c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a00c95d0 0x7f66a00c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.093+0000 7f66a7c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f66a015cf30 con 0x7f66a00c4810 2024-05-14T10:12:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.093+0000 7f66a7c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f66a015cc50 con 0x7f66a00c95d0 2024-05-14T10:12:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.093+0000 7f66a7c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f66a00c54b0 con 0x7f66a006d670 2024-05-14T10:12:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.094+0000 7f669fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a00c4810 0x7f66a01f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:35.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.095+0000 7f669fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a00c4810 0x7f66a01f2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35646/0 (socket says 172.21.15.135:35646) 2024-05-14T10:12:35.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.095+0000 7f669fe00640 1 -- 172.21.15.135:0/1588570717 learned_addr learned my addr 172.21.15.135:0/1588570717 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:35.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.099+0000 7f669fe00640 1 -- 172.21.15.135:0/1588570717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f66a006d670 msgr2=0x7f66a0149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:35.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.099+0000 7f669fe00640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f66a006d670 0x7f66a0149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.099+0000 7f669fe00640 1 -- 172.21.15.135:0/1588570717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a00c95d0 msgr2=0x7f66a00c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:35.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.099+0000 7f669fe00640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f66a00c95d0 0x7f66a00c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.099+0000 7f669fe00640 1 -- 172.21.15.135:0/1588570717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a00c7f20 con 0x7f66a00c4810 2024-05-14T10:12:35.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.102+0000 7f669fe00640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a00c4810 0x7f66a01f2860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f668c000c00 tx=0x7f668c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:35.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.107+0000 7f669cc00640 1 -- 172.21.15.135:0/1588570717 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c041070 con 0x7f66a00c4810 2024-05-14T10:12:35.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.107+0000 7f669cc00640 1 -- 172.21.15.135:0/1588570717 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668c03c870 con 0x7f66a00c4810 2024-05-14T10:12:35.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.107+0000 7f669cc00640 1 -- 172.21.15.135:0/1588570717 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c037040 con 0x7f66a00c4810 2024-05-14T10:12:35.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.107+0000 7f66a7c00640 1 -- 172.21.15.135:0/1588570717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a01f3240 con 0x7f66a00c4810 2024-05-14T10:12:35.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.107+0000 7f66a7c00640 1 -- 172.21.15.135:0/1588570717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a00c71e0 con 0x7f66a00c4810 2024-05-14T10:12:35.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.108+0000 7f66a7c00640 1 -- 172.21.15.135:0/1588570717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66a0076290 con 0x7f66a00c4810 2024-05-14T10:12:35.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.135+0000 7f669cc00640 1 -- 172.21.15.135:0/1588570717 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f668c044070 con 0x7f66a00c4810 2024-05-14T10:12:35.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.137+0000 7f669cc00640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6680076320 0x7f6680078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.137+0000 7f66a5200640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6680076320 0x7f6680078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:35.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.138+0000 7f66a5200640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6680076320 0x7f6680078830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6694009670 tx=0x7f6694006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:35.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.140+0000 7f669cc00640 1 -- 172.21.15.135:0/1588570717 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f668c07de40 con 0x7f66a00c4810 2024-05-14T10:12:35.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.140+0000 7f669cc00640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] conn(0x7f668007fe00 0x7f66800822f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.140+0000 7f669cc00640 1 -- 172.21.15.135:0/1588570717 --> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f668c048e50 con 0x7f668007fe00 2024-05-14T10:12:35.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.140+0000 7f669cc00640 1 -- 172.21.15.135:0/1588570717 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f668c07e200 con 0x7f66a00c4810 2024-05-14T10:12:35.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.141+0000 7f66a5c00640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] conn(0x7f668007fe00 0x7f66800822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:35.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.142+0000 7f66a5c00640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] conn(0x7f668007fe00 0x7f66800822f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:35.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.144+0000 7f669cc00640 1 -- 172.21.15.135:0/1588570717 <== osd.7 v2:172.21.15.196:6800/3759821371 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f668c048e50 con 0x7f668007fe00 2024-05-14T10:12:35.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.160+0000 7f66a7c00640 1 -- 172.21.15.135:0/1588570717 --> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f66a01f2ff0 con 0x7f668007fe00 2024-05-14T10:12:35.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.161+0000 7f669cc00640 1 -- 172.21.15.135:0/1588570717 <== osd.7 v2:172.21.15.196:6800/3759821371 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f66a01f2ff0 con 0x7f668007fe00 2024-05-14T10:12:35.162 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-14T10:12:35.162 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-14T10:12:35.162 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-14T10:12:35.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.161+0000 7f66a7c00640 1 -- 172.21.15.135:0/1588570717 >> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] conn(0x7f668007fe00 msgr2=0x7f66800822f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:35.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.161+0000 7f66a7c00640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.196:6800/3759821371,v1:172.21.15.196:6801/3759821371] conn(0x7f668007fe00 0x7f66800822f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.162+0000 7f66a7c00640 1 -- 172.21.15.135:0/1588570717 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6680076320 msgr2=0x7f6680078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:35.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.162+0000 7f66a7c00640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f6680076320 0x7f6680078830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6694009670 tx=0x7f6694006bf0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.162+0000 7f66a7c00640 1 -- 172.21.15.135:0/1588570717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a00c4810 msgr2=0x7f66a01f2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:35.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.162+0000 7f66a7c00640 1 --2- 172.21.15.135:0/1588570717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66a00c4810 0x7f66a01f2860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f668c000c00 tx=0x7f668c0046c0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.162+0000 7f66a5c00640 1 -- 172.21.15.135:0/1588570717 reap_dead start 2024-05-14T10:12:35.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.162+0000 7f66a7c00640 1 -- 172.21.15.135:0/1588570717 shutdown_connections 2024-05-14T10:12:35.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.162+0000 7f66a7c00640 1 -- 172.21.15.135:0/1588570717 >> 172.21.15.135:0/1588570717 conn(0x7f66a00cb190 msgr2=0x7f66a00cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:35.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.162+0000 7f66a7c00640 1 -- 172.21.15.135:0/1588570717 shutdown_connections 2024-05-14T10:12:35.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.162+0000 7f66a7c00640 1 -- 172.21.15.135:0/1588570717 wait complete. 2024-05-14T10:12:35.190 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-14T10:12:35.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.450+0000 7fc952400640 1 Processor -- start 2024-05-14T10:12:35.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.450+0000 7fc952400640 1 -- start start 2024-05-14T10:12:35.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.452+0000 7fc952400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc94c152ed0 0x7fc94c1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.453+0000 7fc952400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc94c15cd20 0x7fc94c0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.453+0000 7fc952400640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc94c0c5900 con 0x7fc94c0c60a0 2024-05-14T10:12:35.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.453+0000 7fc952400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fc94c15a510 con 0x7fc94c152ed0 2024-05-14T10:12:35.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.453+0000 7fc952400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc94c06c6f0 con 0x7fc94c15cd20 2024-05-14T10:12:35.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.454+0000 7fc94aa00640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fc94c0c60a0 0x7fc94c15c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:46860/0 (socket says 172.21.15.135:46860) 2024-05-14T10:12:35.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.454+0000 7fc94aa00640 1 -- 172.21.15.135:0/3160847651 learned_addr learned my addr 172.21.15.135:0/3160847651 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:35.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.455+0000 7fc94b400640 1 --2- 172.21.15.135:0/3160847651 >> v2:172.21.15.196:3300/0 conn(0x7fc94c152ed0 0x7fc94c1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:35.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.455+0000 7fc94be00640 1 --2- 172.21.15.135:0/3160847651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc94c15cd20 0x7fc94c0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:35.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.457+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177878568 0 0) 0x7fc938001110 con 0x7fc94c0c60a0 2024-05-14T10:12:35.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.457+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc930003520 con 0x7fc94c0c60a0 2024-05-14T10:12:35.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4044213887 0 0) 0x7fc930003520 con 0x7fc94c0c60a0 2024-05-14T10:12:35.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc94c15cd20 msgr2=0x7fc94c0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:35.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 --2- 172.21.15.135:0/3160847651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc94c15cd20 0x7fc94c0c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 >> v2:172.21.15.196:3300/0 conn(0x7fc94c152ed0 msgr2=0x7fc94c1532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:35.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 --2- 172.21.15.135:0/3160847651 >> v2:172.21.15.196:3300/0 conn(0x7fc94c152ed0 0x7fc94c1532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94c15d290 con 0x7fc94c0c60a0 2024-05-14T10:12:35.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7fc9380018c0 con 0x7fc94c0c60a0 2024-05-14T10:12:35.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 >> v1:172.21.15.135:6789/0 conn(0x7fc94c0c60a0 legacy=0x7fc94c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:35.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 --2- 172.21.15.135:0/3160847651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 0x7fc930003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 --2- 172.21.15.135:0/3160847651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc930004800 0x7fc930004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 --2- 172.21.15.135:0/3160847651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc94c15cd20 0x7fc930005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.461+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c06c6f0 con 0x7fc930003a50 2024-05-14T10:12:35.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.462+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc93000dd10 con 0x7fc930004800 2024-05-14T10:12:35.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.462+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc93000dec0 con 0x7fc94c15cd20 2024-05-14T10:12:35.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.466+0000 7fc94b400640 1 --2- 172.21.15.135:0/3160847651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 0x7fc930003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:35.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.469+0000 7fc94b400640 1 -- 172.21.15.135:0/3160847651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc94c15cd20 msgr2=0x7fc930005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:35.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.469+0000 7fc94b400640 1 --2- 172.21.15.135:0/3160847651 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc94c15cd20 0x7fc930005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.469+0000 7fc94b400640 1 -- 172.21.15.135:0/3160847651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc930004800 msgr2=0x7fc930004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:35.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.469+0000 7fc94b400640 1 --2- 172.21.15.135:0/3160847651 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc930004800 0x7fc930004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.469+0000 7fc94b400640 1 -- 172.21.15.135:0/3160847651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc930003520 con 0x7fc930003a50 2024-05-14T10:12:35.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.473+0000 7fc94b400640 1 --2- 172.21.15.135:0/3160847651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 0x7fc930003ec0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009fc0 tx=0x7fc930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d49b88e30c0a463 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:35.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.483+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c009c10 con 0x7fc930003a50 2024-05-14T10:12:35.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.483+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c036070 con 0x7fc930003a50 2024-05-14T10:12:35.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.483+0000 7fc94a000640 1 -- 172.21.15.135:0/3160847651 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c02d070 con 0x7fc930003a50 2024-05-14T10:12:35.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.484+0000 7fc952400640 1 -- 172.21.15.135:0/3160847651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 msgr2=0x7fc930003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:35.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.484+0000 7fc952400640 1 --2- 172.21.15.135:0/3160847651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 0x7fc930003ec0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009fc0 tx=0x7fc930005830 comp rx=0 tx=0).stop 2024-05-14T10:12:35.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.484+0000 7fc94be00640 1 -- 172.21.15.135:0/3160847651 reap_dead start 2024-05-14T10:12:35.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.485+0000 7fc952400640 1 -- 172.21.15.135:0/3160847651 shutdown_connections 2024-05-14T10:12:35.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.485+0000 7fc952400640 1 -- 172.21.15.135:0/3160847651 >> 172.21.15.135:0/3160847651 conn(0x7fc94c073d40 msgr2=0x7fc94c074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:35.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.485+0000 7fc952400640 1 -- 172.21.15.135:0/3160847651 shutdown_connections 2024-05-14T10:12:35.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.485+0000 7fc952400640 1 -- 172.21.15.135:0/3160847651 wait complete. 2024-05-14T10:12:35.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.488+0000 7fc952400640 1 Processor -- start 2024-05-14T10:12:35.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.488+0000 7fc952400640 1 -- start start 2024-05-14T10:12:35.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.489+0000 7fc952400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 0x7fc94c1f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.489+0000 7fc952400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc94c158df0 0x7fc94c0c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.489+0000 7fc952400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc94c14c820 0x7fc94c14cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.489+0000 7fc952400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c06cc20 con 0x7fc930003a50 2024-05-14T10:12:35.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.489+0000 7fc952400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c0c5c10 con 0x7fc94c158df0 2024-05-14T10:12:35.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.489+0000 7fc952400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fc94c0c4a60 con 0x7fc94c14c820 2024-05-14T10:12:35.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.490+0000 7fc94b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 0x7fc94c1f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:35.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.491+0000 7fc94b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 0x7fc94c1f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35652/0 (socket says 172.21.15.135:35652) 2024-05-14T10:12:35.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.491+0000 7fc94b400640 1 -- 172.21.15.135:0/2501376995 learned_addr learned my addr 172.21.15.135:0/2501376995 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:35.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.495+0000 7fc94b400640 1 -- 172.21.15.135:0/2501376995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc94c14c820 msgr2=0x7fc94c14cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:35.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.495+0000 7fc94b400640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc94c14c820 0x7fc94c14cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.495+0000 7fc94b400640 1 -- 172.21.15.135:0/2501376995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc94c158df0 msgr2=0x7fc94c0c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:35.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.495+0000 7fc94b400640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc94c158df0 0x7fc94c0c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:35.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.495+0000 7fc94b400640 1 -- 172.21.15.135:0/2501376995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94c1f28c0 con 0x7fc930003a50 2024-05-14T10:12:35.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.498+0000 7fc94b400640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 0x7fc94c1f2380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00e230 tx=0x7fc93c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:35.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.505+0000 7fc943400640 1 -- 172.21.15.135:0/2501376995 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c009c10 con 0x7fc930003a50 2024-05-14T10:12:35.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.505+0000 7fc943400640 1 -- 172.21.15.135:0/2501376995 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c003bb0 con 0x7fc930003a50 2024-05-14T10:12:35.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.505+0000 7fc943400640 1 -- 172.21.15.135:0/2501376995 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c031e10 con 0x7fc930003a50 2024-05-14T10:12:35.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.506+0000 7fc952400640 1 -- 172.21.15.135:0/2501376995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc94c1e4dd0 con 0x7fc930003a50 2024-05-14T10:12:35.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.506+0000 7fc952400640 1 -- 172.21.15.135:0/2501376995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc94c159be0 con 0x7fc930003a50 2024-05-14T10:12:35.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.507+0000 7fc952400640 1 -- 172.21.15.135:0/2501376995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc94c1596f0 con 0x7fc930003a50 2024-05-14T10:12:35.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.826+0000 7fc943400640 1 -- 172.21.15.135:0/2501376995 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc93c005d10 con 0x7fc930003a50 2024-05-14T10:12:35.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.827+0000 7fc943400640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc92c076350 0x7fc92c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:35.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.828+0000 7fc94aa00640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc92c076350 0x7fc92c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:35.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.830+0000 7fc94aa00640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc92c076350 0x7fc92c078860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0c3af0 tx=0x7fc938001e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:35.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.865+0000 7fc943400640 1 -- 172.21.15.135:0/2501376995 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fc93c07e350 con 0x7fc930003a50 2024-05-14T10:12:35.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:35.888+0000 7fc943400640 1 -- 172.21.15.135:0/2501376995 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc93c0827c0 con 0x7fc930003a50 2024-05-14T10:12:36.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.104+0000 7fc952400640 1 -- 172.21.15.135:0/2501376995 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fc94c069a60 con 0x7fc92c076350 2024-05-14T10:12:36.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.105+0000 7fc943400640 1 -- 172.21.15.135:0/2501376995 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc94c069a60 con 0x7fc92c076350 2024-05-14T10:12:36.105 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 7 to deep-scrub 2024-05-14T10:12:36.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 -- 172.21.15.135:0/2501376995 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc92c076350 msgr2=0x7fc92c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:36.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc92c076350 0x7fc92c078860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0c3af0 tx=0x7fc938001e20 comp rx=0 tx=0).stop 2024-05-14T10:12:36.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 -- 172.21.15.135:0/2501376995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 msgr2=0x7fc94c1f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:36.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 0x7fc94c1f2380 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00e230 tx=0x7fc93c009750 comp rx=0 tx=0).stop 2024-05-14T10:12:36.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 -- 172.21.15.135:0/2501376995 shutdown_connections 2024-05-14T10:12:36.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fc92c076350 0x7fc92c078860 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:36.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc94c158df0 0x7fc94c0c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:36.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc94c14c820 0x7fc94c14cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:36.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 --2- 172.21.15.135:0/2501376995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930003a50 0x7fc94c1f2380 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:36.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 -- 172.21.15.135:0/2501376995 >> 172.21.15.135:0/2501376995 conn(0x7fc94c073d40 msgr2=0x7fc94c074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:36.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 -- 172.21.15.135:0/2501376995 shutdown_connections 2024-05-14T10:12:36.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.108+0000 7fc952400640 1 -- 172.21.15.135:0/2501376995 wait complete. 2024-05-14T10:12:36.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T10:12:36.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.395+0000 7fb175e00640 1 Processor -- start 2024-05-14T10:12:36.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.395+0000 7fb175e00640 1 -- start start 2024-05-14T10:12:36.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.397+0000 7fb175e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb1700cdbc0 0x7fb170156800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:36.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.397+0000 7fb175e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb17006c6f0 0x7fb1700c8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:36.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.397+0000 7fb175e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1701608d0 con 0x7fb1700c6740 2024-05-14T10:12:36.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.397+0000 7fb175e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7fb1700c8790 con 0x7fb1700cdbc0 2024-05-14T10:12:36.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.397+0000 7fb175e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb1700c6ef0 con 0x7fb17006c6f0 2024-05-14T10:12:36.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.403+0000 7fb16f400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fb1700c6740 0x7fb17015fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:44612/0 (socket says 172.21.15.135:44612) 2024-05-14T10:12:36.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.403+0000 7fb16f400640 1 -- 172.21.15.135:0/3500310707 learned_addr learned my addr 172.21.15.135:0/3500310707 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:36.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.404+0000 7fb16ea00640 1 --2- 172.21.15.135:0/3500310707 >> v2:172.21.15.196:3300/0 conn(0x7fb1700cdbc0 0x7fb170156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:36.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.409+0000 7fb167e00640 1 --2- 172.21.15.135:0/3500310707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb17006c6f0 0x7fb1700c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:36.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.413+0000 7fb16ea00640 1 -- 172.21.15.135:0/3500310707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb17006c6f0 msgr2=0x7fb1700c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:36.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.413+0000 7fb16ea00640 1 --2- 172.21.15.135:0/3500310707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb17006c6f0 0x7fb1700c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:36.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.413+0000 7fb16ea00640 1 -- 172.21.15.135:0/3500310707 >> v1:172.21.15.196:6789/0 conn(0x7fb1700c6740 legacy=0x7fb17015fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:36.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.413+0000 7fb16ea00640 1 -- 172.21.15.135:0/3500310707 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1700c71d0 con 0x7fb1700cdbc0 2024-05-14T10:12:36.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.422+0000 7fb16ea00640 1 --2- 172.21.15.135:0/3500310707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1700cdbc0 0x7fb170156800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1600097a0 tx=0x7fb16002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81b528ad3230580 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:36.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.437+0000 7fb16e000640 1 -- 172.21.15.135:0/3500310707 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160037070 con 0x7fb1700cdbc0 2024-05-14T10:12:36.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.437+0000 7fb16e000640 1 -- 172.21.15.135:0/3500310707 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16002ae50 con 0x7fb1700cdbc0 2024-05-14T10:12:36.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.437+0000 7fb16e000640 1 -- 172.21.15.135:0/3500310707 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160032660 con 0x7fb1700cdbc0 2024-05-14T10:12:36.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.439+0000 7fb175e00640 1 -- 172.21.15.135:0/3500310707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1700cdbc0 msgr2=0x7fb170156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:36.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.439+0000 7fb175e00640 1 --2- 172.21.15.135:0/3500310707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1700cdbc0 0x7fb170156800 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1600097a0 tx=0x7fb16002a100 comp rx=0 tx=0).stop 2024-05-14T10:12:36.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.439+0000 7fb175e00640 1 -- 172.21.15.135:0/3500310707 shutdown_connections 2024-05-14T10:12:36.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.439+0000 7fb175e00640 1 --2- 172.21.15.135:0/3500310707 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb17006c6f0 0x7fb1700c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:36.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.439+0000 7fb175e00640 1 --2- 172.21.15.135:0/3500310707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1700cdbc0 0x7fb170156800 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:36.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.439+0000 7fb175e00640 1 -- 172.21.15.135:0/3500310707 >> 172.21.15.135:0/3500310707 conn(0x7fb17008e2f0 msgr2=0x7fb1700d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:36.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.439+0000 7fb175e00640 1 -- 172.21.15.135:0/3500310707 shutdown_connections 2024-05-14T10:12:36.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.439+0000 7fb175e00640 1 -- 172.21.15.135:0/3500310707 wait complete. 2024-05-14T10:12:36.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.443+0000 7fb175e00640 1 Processor -- start 2024-05-14T10:12:36.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.443+0000 7fb175e00640 1 -- start start 2024-05-14T10:12:36.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.446+0000 7fb175e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb17006c6f0 0x7fb1701f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:36.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.446+0000 7fb175e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1700c6740 0x7fb1701585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:36.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.446+0000 7fb175e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700cdbc0 0x7fb1700cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:36.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.446+0000 7fb175e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700c7d30 con 0x7fb1700cdbc0 2024-05-14T10:12:36.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.446+0000 7fb175e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700c7a50 con 0x7fb1700c6740 2024-05-14T10:12:36.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.446+0000 7fb175e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fb170160160 con 0x7fb17006c6f0 2024-05-14T10:12:36.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.448+0000 7fb167e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1700c6740 0x7fb1701585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:36.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.448+0000 7fb16f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700cdbc0 0x7fb1700cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:36.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.448+0000 7fb16ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb17006c6f0 0x7fb1701f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:36.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.448+0000 7fb16f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700cdbc0 0x7fb1700cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35664/0 (socket says 172.21.15.135:35664) 2024-05-14T10:12:36.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.448+0000 7fb16f400640 1 -- 172.21.15.135:0/2697716835 learned_addr learned my addr 172.21.15.135:0/2697716835 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:36.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.453+0000 7fb16f400640 1 -- 172.21.15.135:0/2697716835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb17006c6f0 msgr2=0x7fb1701f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:36.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.453+0000 7fb16f400640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb17006c6f0 0x7fb1701f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:36.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.453+0000 7fb16f400640 1 -- 172.21.15.135:0/2697716835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1700c6740 msgr2=0x7fb1701585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:36.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.453+0000 7fb16f400640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1700c6740 0x7fb1701585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:36.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.453+0000 7fb16f400640 1 -- 172.21.15.135:0/2697716835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1701f2dd0 con 0x7fb1700cdbc0 2024-05-14T10:12:36.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.456+0000 7fb16f400640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700cdbc0 0x7fb1700cf940 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb16800caa0 tx=0x7fb16800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:36.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.462+0000 7fb167400640 1 -- 172.21.15.135:0/2697716835 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168017070 con 0x7fb1700cdbc0 2024-05-14T10:12:36.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.462+0000 7fb167400640 1 -- 172.21.15.135:0/2697716835 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16800ac00 con 0x7fb1700cdbc0 2024-05-14T10:12:36.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.462+0000 7fb167400640 1 -- 172.21.15.135:0/2697716835 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168012400 con 0x7fb1700cdbc0 2024-05-14T10:12:36.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.462+0000 7fb175e00640 1 -- 172.21.15.135:0/2697716835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb170159280 con 0x7fb1700cdbc0 2024-05-14T10:12:36.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.462+0000 7fb175e00640 1 -- 172.21.15.135:0/2697716835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb170159840 con 0x7fb1700cdbc0 2024-05-14T10:12:36.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.464+0000 7fb175e00640 1 -- 172.21.15.135:0/2697716835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17006df50 con 0x7fb1700cdbc0 2024-05-14T10:12:36.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.803+0000 7fb167400640 1 -- 172.21.15.135:0/2697716835 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb16801a070 con 0x7fb1700cdbc0 2024-05-14T10:12:36.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.805+0000 7fb167400640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb14c076320 0x7fb14c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:36.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.806+0000 7fb16ea00640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb14c076320 0x7fb14c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:36.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.807+0000 7fb16ea00640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb14c076320 0x7fb14c078830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb160034000 tx=0x7fb16002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:36.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.832+0000 7fb167400640 1 -- 172.21.15.135:0/2697716835 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fb16805cbd0 con 0x7fb1700cdbc0 2024-05-14T10:12:36.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:36.833+0000 7fb167400640 1 -- 172.21.15.135:0/2697716835 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb17006df50 con 0x7fb1700cdbc0 2024-05-14T10:12:37.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.047+0000 7fb175e00640 1 -- 172.21.15.135:0/2697716835 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb170159010 con 0x7fb14c076320 2024-05-14T10:12:37.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.077+0000 7fb167400640 1 -- 172.21.15.135:0/2697716835 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+331598 (secure 0 0 0) 0x7fb170159010 con 0x7fb14c076320 2024-05-14T10:12:37.082 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T10:12:37.084 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-14T10:12:37.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.085+0000 7fb175e00640 1 -- 172.21.15.135:0/2697716835 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb14c076320 msgr2=0x7fb14c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:37.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.085+0000 7fb175e00640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb14c076320 0x7fb14c078830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb160034000 tx=0x7fb16002e000 comp rx=0 tx=0).stop 2024-05-14T10:12:37.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.085+0000 7fb175e00640 1 -- 172.21.15.135:0/2697716835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700cdbc0 msgr2=0x7fb1700cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:37.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.085+0000 7fb175e00640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700cdbc0 0x7fb1700cf940 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb16800caa0 tx=0x7fb16800cf60 comp rx=0 tx=0).stop 2024-05-14T10:12:37.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.085+0000 7fb175e00640 1 -- 172.21.15.135:0/2697716835 shutdown_connections 2024-05-14T10:12:37.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.085+0000 7fb175e00640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fb14c076320 0x7fb14c078830 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:37.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.085+0000 7fb175e00640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb1700c6740 0x7fb1701585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:37.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.085+0000 7fb175e00640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1700cdbc0 0x7fb1700cf940 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:37.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.085+0000 7fb175e00640 1 --2- 172.21.15.135:0/2697716835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb17006c6f0 0x7fb1701f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:37.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.085+0000 7fb175e00640 1 -- 172.21.15.135:0/2697716835 >> 172.21.15.135:0/2697716835 conn(0x7fb17008e2f0 msgr2=0x7fb17006d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:37.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.086+0000 7fb175e00640 1 -- 172.21.15.135:0/2697716835 shutdown_connections 2024-05-14T10:12:37.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:37.086+0000 7fb175e00640 1 -- 172.21.15.135:0/2697716835 wait complete. 2024-05-14T10:12:37.120 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":999,"stamp":"2024-05-14T10:12:35.384993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22567725,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":498,"num_read_kb":521,"num_write":8783,"num_write_kb":276537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8860,"ondisk_log_size":8860,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329672,"kb_used_data":46984,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754645048,"statfs":{"total":773094113280,"available":772756529152,"internally_reserved":0,"allocated":48111616,"data_stored":46324274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":289394226},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006557"},"pg_stats":[{"pgid":"2.1f","version":"33'579","reported_seq":638,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:27.738449+0000","last_change":"2024-05-14T10:12:27.738541+0000","last_active":"2024-05-14T10:12:27.738449+0000","last_peered":"2024-05-14T10:12:27.738449+0000","last_clean":"2024-05-14T10:12:27.738449+0000","last_became_active":"2024-05-14T09:40:43.105731+0000","last_became_peered":"2024-05-14T09:40:43.105731+0000","last_unstale":"2024-05-14T10:12:27.738449+0000","last_undegraded":"2024-05-14T10:12:27.738449+0000","last_fullsized":"2024-05-14T10:12:27.738449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'579","last_scrub_stamp":"2024-05-14T10:12:27.738245+0000","last_deep_scrub":"33'579","last_deep_scrub_stamp":"2024-05-14T10:12:27.738245+0000","last_clean_scrub_stamp":"2024-05-14T10:12:27.738245+0000","objects_scrubbed":5,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:33:48.610209+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573,"num_write_kb":4404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'15","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.558281+0000","last_change":"2024-05-14T09:40:45.750103+0000","last_active":"2024-05-14T10:12:13.558281+0000","last_peered":"2024-05-14T10:12:13.558281+0000","last_clean":"2024-05-14T10:12:13.558281+0000","last_became_active":"2024-05-14T09:40:45.747865+0000","last_became_peered":"2024-05-14T09:40:45.747865+0000","last_unstale":"2024-05-14T10:12:13.558281+0000","last_undegraded":"2024-05-14T10:12:13.558281+0000","last_fullsized":"2024-05-14T10:12:13.558281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'61","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:26.725195+0000","last_change":"2024-05-14T09:40:53.664918+0000","last_active":"2024-05-14T10:12:26.725195+0000","last_peered":"2024-05-14T10:12:26.725195+0000","last_clean":"2024-05-14T10:12:26.725195+0000","last_became_active":"2024-05-14T09:40:53.664366+0000","last_became_peered":"2024-05-14T09:40:53.664366+0000","last_unstale":"2024-05-14T10:12:26.725195+0000","last_undegraded":"2024-05-14T10:12:26.725195+0000","last_fullsized":"2024-05-14T10:12:26.725195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'88","reported_seq":139,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:16.477857+0000","last_change":"2024-05-14T09:40:43.101185+0000","last_active":"2024-05-14T10:12:16.477857+0000","last_peered":"2024-05-14T10:12:16.477857+0000","last_clean":"2024-05-14T10:12:16.477857+0000","last_became_active":"2024-05-14T09:40:43.098862+0000","last_became_peered":"2024-05-14T09:40:43.098862+0000","last_unstale":"2024-05-14T10:12:16.477857+0000","last_undegraded":"2024-05-14T10:12:16.477857+0000","last_fullsized":"2024-05-14T10:12:16.477857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883346,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"33'22","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:30.659457+0000","last_change":"2024-05-14T10:12:30.659524+0000","last_active":"2024-05-14T10:12:30.659457+0000","last_peered":"2024-05-14T10:12:30.659457+0000","last_clean":"2024-05-14T10:12:30.659457+0000","last_became_active":"2024-05-14T09:40:45.752627+0000","last_became_peered":"2024-05-14T09:40:45.752627+0000","last_unstale":"2024-05-14T10:12:30.659457+0000","last_undegraded":"2024-05-14T10:12:30.659457+0000","last_fullsized":"2024-05-14T10:12:30.659457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-05-14T10:12:30.659261+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-05-14T10:12:30.659261+0000","last_clean_scrub_stamp":"2024-05-14T10:12:30.659261+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:29:27.339387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'57","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.348476+0000","last_change":"2024-05-14T09:40:53.662032+0000","last_active":"2024-05-14T10:11:03.348476+0000","last_peered":"2024-05-14T10:11:03.348476+0000","last_clean":"2024-05-14T10:11:03.348476+0000","last_became_active":"2024-05-14T09:40:53.661453+0000","last_became_peered":"2024-05-14T09:40:53.661453+0000","last_unstale":"2024-05-14T10:11:03.348476+0000","last_undegraded":"2024-05-14T10:11:03.348476+0000","last_fullsized":"2024-05-14T10:11:03.348476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:11.724866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'10","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.867388+0000","last_change":"2024-05-14T09:40:43.114965+0000","last_active":"2024-05-14T10:11:57.867388+0000","last_peered":"2024-05-14T10:11:57.867388+0000","last_clean":"2024-05-14T10:11:57.867388+0000","last_became_active":"2024-05-14T09:40:43.114379+0000","last_became_peered":"2024-05-14T09:40:43.114379+0000","last_unstale":"2024-05-14T10:11:57.867388+0000","last_undegraded":"2024-05-14T10:11:57.867388+0000","last_fullsized":"2024-05-14T10:11:57.867388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:43.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'21","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630273+0000","last_change":"2024-05-14T09:40:45.758305+0000","last_active":"2024-05-14T10:12:13.630273+0000","last_peered":"2024-05-14T10:12:13.630273+0000","last_clean":"2024-05-14T10:12:13.630273+0000","last_became_active":"2024-05-14T09:40:45.754110+0000","last_became_peered":"2024-05-14T09:40:45.754110+0000","last_unstale":"2024-05-14T10:12:13.630273+0000","last_undegraded":"2024-05-14T10:12:13.630273+0000","last_fullsized":"2024-05-14T10:12:13.630273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:12:42.923050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'83","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:01.093757+0000","last_change":"2024-05-14T09:41:04.601574+0000","last_active":"2024-05-14T10:11:01.093757+0000","last_peered":"2024-05-14T10:11:01.093757+0000","last_clean":"2024-05-14T10:11:01.093757+0000","last_became_active":"2024-05-14T09:41:04.599475+0000","last_became_peered":"2024-05-14T09:41:04.599475+0000","last_unstale":"2024-05-14T10:11:01.093757+0000","last_undegraded":"2024-05-14T10:11:01.093757+0000","last_fullsized":"2024-05-14T10:11:01.093757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:48.734273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"33'3","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:44.766090+0000","last_change":"2024-05-14T09:40:43.110296+0000","last_active":"2024-05-14T10:10:44.766090+0000","last_peered":"2024-05-14T10:10:44.766090+0000","last_clean":"2024-05-14T10:10:44.766090+0000","last_became_active":"2024-05-14T09:40:43.109932+0000","last_became_peered":"2024-05-14T09:40:43.109932+0000","last_unstale":"2024-05-14T10:10:44.766090+0000","last_undegraded":"2024-05-14T10:10:44.766090+0000","last_fullsized":"2024-05-14T10:10:44.766090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:29.003048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630118+0000","last_change":"2024-05-14T09:40:45.773110+0000","last_active":"2024-05-14T10:12:13.630118+0000","last_peered":"2024-05-14T10:12:13.630118+0000","last_clean":"2024-05-14T10:12:13.630118+0000","last_became_active":"2024-05-14T09:40:45.770117+0000","last_became_peered":"2024-05-14T09:40:45.770117+0000","last_unstale":"2024-05-14T10:12:13.630118+0000","last_undegraded":"2024-05-14T10:12:13.630118+0000","last_fullsized":"2024-05-14T10:12:13.630118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:28.718450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'79","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.770815+0000","last_change":"2024-05-14T09:40:53.652049+0000","last_active":"2024-05-14T10:11:05.770815+0000","last_peered":"2024-05-14T10:11:05.770815+0000","last_clean":"2024-05-14T10:11:05.770815+0000","last_became_active":"2024-05-14T09:40:53.651570+0000","last_became_peered":"2024-05-14T09:40:53.651570+0000","last_unstale":"2024-05-14T10:11:05.770815+0000","last_undegraded":"2024-05-14T10:11:05.770815+0000","last_fullsized":"2024-05-14T10:11:05.770815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:11:30.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'20","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.846441+0000","last_change":"2024-05-14T09:40:45.753771+0000","last_active":"2024-05-14T10:12:13.846441+0000","last_peered":"2024-05-14T10:12:13.846441+0000","last_clean":"2024-05-14T10:12:13.846441+0000","last_became_active":"2024-05-14T09:40:45.753319+0000","last_became_peered":"2024-05-14T09:40:45.753319+0000","last_unstale":"2024-05-14T10:12:13.846441+0000","last_undegraded":"2024-05-14T10:12:13.846441+0000","last_fullsized":"2024-05-14T10:12:13.846441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:56.910106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'565","reported_seq":614,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.868105+0000","last_change":"2024-05-14T09:40:43.125708+0000","last_active":"2024-05-14T10:11:57.868105+0000","last_peered":"2024-05-14T10:11:57.868105+0000","last_clean":"2024-05-14T10:11:57.868105+0000","last_became_active":"2024-05-14T09:40:43.125239+0000","last_became_peered":"2024-05-14T09:40:43.125239+0000","last_unstale":"2024-05-14T10:11:57.868105+0000","last_undegraded":"2024-05-14T10:11:57.868105+0000","last_fullsized":"2024-05-14T10:11:57.868105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:22.781125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'67","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.417574+0000","last_change":"2024-05-14T09:40:53.663353+0000","last_active":"2024-05-14T10:11:06.417574+0000","last_peered":"2024-05-14T10:11:06.417574+0000","last_clean":"2024-05-14T10:11:06.417574+0000","last_became_active":"2024-05-14T09:40:53.662559+0000","last_became_peered":"2024-05-14T09:40:53.662559+0000","last_unstale":"2024-05-14T10:11:06.417574+0000","last_undegraded":"2024-05-14T10:11:06.417574+0000","last_fullsized":"2024-05-14T10:11:06.417574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:33:14.708431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'23","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:30.872602+0000","last_change":"2024-05-14T10:12:30.872654+0000","last_active":"2024-05-14T10:12:30.872602+0000","last_peered":"2024-05-14T10:12:30.872602+0000","last_clean":"2024-05-14T10:12:30.872602+0000","last_became_active":"2024-05-14T09:40:45.751015+0000","last_became_peered":"2024-05-14T09:40:45.751015+0000","last_unstale":"2024-05-14T10:12:30.872602+0000","last_undegraded":"2024-05-14T10:12:30.872602+0000","last_fullsized":"2024-05-14T10:12:30.872602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-05-14T10:12:30.872472+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-05-14T10:12:30.872472+0000","last_clean_scrub_stamp":"2024-05-14T10:12:30.872472+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:41:29.803841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"33'4","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:28.872394+0000","last_change":"2024-05-14T10:12:28.872446+0000","last_active":"2024-05-14T10:12:28.872394+0000","last_peered":"2024-05-14T10:12:28.872394+0000","last_clean":"2024-05-14T10:12:28.872394+0000","last_became_active":"2024-05-14T09:40:43.022234+0000","last_became_peered":"2024-05-14T09:40:43.022234+0000","last_unstale":"2024-05-14T10:12:28.872394+0000","last_undegraded":"2024-05-14T10:12:28.872394+0000","last_fullsized":"2024-05-14T10:12:28.872394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-14T10:12:28.872261+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-14T10:12:28.872261+0000","last_clean_scrub_stamp":"2024-05-14T10:12:28.872261+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:05.133996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'86","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:07.536728+0000","last_change":"2024-05-14T09:41:04.601663+0000","last_active":"2024-05-14T10:11:07.536728+0000","last_peered":"2024-05-14T10:11:07.536728+0000","last_clean":"2024-05-14T10:11:07.536728+0000","last_became_active":"2024-05-14T09:41:04.600186+0000","last_became_peered":"2024-05-14T09:41:04.600186+0000","last_unstale":"2024-05-14T10:11:07.536728+0000","last_undegraded":"2024-05-14T10:11:07.536728+0000","last_fullsized":"2024-05-14T10:11:07.536728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:44:07.460256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.564072+0000","last_change":"2024-05-14T09:40:45.746999+0000","last_active":"2024-05-14T10:12:13.564072+0000","last_peered":"2024-05-14T10:12:13.564072+0000","last_clean":"2024-05-14T10:12:13.564072+0000","last_became_active":"2024-05-14T09:40:45.746607+0000","last_became_peered":"2024-05-14T09:40:45.746607+0000","last_unstale":"2024-05-14T10:12:13.564072+0000","last_undegraded":"2024-05-14T10:12:13.564072+0000","last_fullsized":"2024-05-14T10:12:13.564072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'13","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:31.916222+0000","last_change":"2024-05-14T10:12:31.916282+0000","last_active":"2024-05-14T10:12:31.916222+0000","last_peered":"2024-05-14T10:12:31.916222+0000","last_clean":"2024-05-14T10:12:31.916222+0000","last_became_active":"2024-05-14T09:40:43.104277+0000","last_became_peered":"2024-05-14T09:40:43.104277+0000","last_unstale":"2024-05-14T10:12:31.916222+0000","last_undegraded":"2024-05-14T10:12:31.916222+0000","last_fullsized":"2024-05-14T10:12:31.916222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-05-14T10:12:31.916080+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-05-14T10:12:31.916080+0000","last_clean_scrub_stamp":"2024-05-14T10:12:31.916080+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:01:06.286093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'61","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:27.890723+0000","last_change":"2024-05-14T09:40:53.649256+0000","last_active":"2024-05-14T10:12:27.890723+0000","last_peered":"2024-05-14T10:12:27.890723+0000","last_clean":"2024-05-14T10:12:27.890723+0000","last_became_active":"2024-05-14T09:40:53.648765+0000","last_became_peered":"2024-05-14T09:40:53.648765+0000","last_unstale":"2024-05-14T10:12:27.890723+0000","last_undegraded":"2024-05-14T10:12:27.890723+0000","last_fullsized":"2024-05-14T10:12:27.890723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":11669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"33'17","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.458918+0000","last_change":"2024-05-14T09:40:45.730862+0000","last_active":"2024-05-14T10:11:06.458918+0000","last_peered":"2024-05-14T10:11:06.458918+0000","last_clean":"2024-05-14T10:11:06.458918+0000","last_became_active":"2024-05-14T09:40:45.730014+0000","last_became_peered":"2024-05-14T09:40:45.730014+0000","last_unstale":"2024-05-14T10:11:06.458918+0000","last_undegraded":"2024-05-14T10:11:06.458918+0000","last_fullsized":"2024-05-14T10:11:06.458918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:49:05.679719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:57.868371+0000","last_change":"2024-05-14T09:40:43.112127+0000","last_active":"2024-05-14T10:11:57.868371+0000","last_peered":"2024-05-14T10:11:57.868371+0000","last_clean":"2024-05-14T10:11:57.868371+0000","last_became_active":"2024-05-14T09:40:43.111574+0000","last_became_peered":"2024-05-14T09:40:43.111574+0000","last_unstale":"2024-05-14T10:11:57.868371+0000","last_undegraded":"2024-05-14T10:11:57.868371+0000","last_fullsized":"2024-05-14T10:11:57.868371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:40:13.668017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'68","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.436416+0000","last_change":"2024-05-14T09:40:53.666100+0000","last_active":"2024-05-14T10:11:05.436416+0000","last_peered":"2024-05-14T10:11:05.436416+0000","last_clean":"2024-05-14T10:11:05.436416+0000","last_became_active":"2024-05-14T09:40:53.665635+0000","last_became_peered":"2024-05-14T09:40:53.665635+0000","last_unstale":"2024-05-14T10:11:05.436416+0000","last_undegraded":"2024-05-14T10:11:05.436416+0000","last_fullsized":"2024-05-14T10:11:05.436416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:21.693629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":6362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"33'26","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.491986+0000","last_change":"2024-05-14T09:40:45.758554+0000","last_active":"2024-05-14T10:12:13.491986+0000","last_peered":"2024-05-14T10:12:13.491986+0000","last_clean":"2024-05-14T10:12:13.491986+0000","last_became_active":"2024-05-14T09:40:45.757938+0000","last_became_peered":"2024-05-14T09:40:45.757938+0000","last_unstale":"2024-05-14T10:12:13.491986+0000","last_undegraded":"2024-05-14T10:12:13.491986+0000","last_fullsized":"2024-05-14T10:12:13.491986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:02.946780+0000","last_change":"2024-05-14T09:40:43.116767+0000","last_active":"2024-05-14T10:12:02.946780+0000","last_peered":"2024-05-14T10:12:02.946780+0000","last_clean":"2024-05-14T10:12:02.946780+0000","last_became_active":"2024-05-14T09:40:43.116142+0000","last_became_peered":"2024-05-14T09:40:43.116142+0000","last_unstale":"2024-05-14T10:12:02.946780+0000","last_undegraded":"2024-05-14T10:12:02.946780+0000","last_fullsized":"2024-05-14T10:12:02.946780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:37:42.255871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'50","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:56.148905+0000","last_change":"2024-05-14T09:40:53.666811+0000","last_active":"2024-05-14T10:10:56.148905+0000","last_peered":"2024-05-14T10:10:56.148905+0000","last_clean":"2024-05-14T10:10:56.148905+0000","last_became_active":"2024-05-14T09:40:53.666455+0000","last_became_peered":"2024-05-14T09:40:53.666455+0000","last_unstale":"2024-05-14T10:10:56.148905+0000","last_undegraded":"2024-05-14T10:10:56.148905+0000","last_fullsized":"2024-05-14T10:10:56.148905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:24:33.234602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":7373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'19","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.561912+0000","last_change":"2024-05-14T09:40:45.768162+0000","last_active":"2024-05-14T10:12:13.561912+0000","last_peered":"2024-05-14T10:12:13.561912+0000","last_clean":"2024-05-14T10:12:13.561912+0000","last_became_active":"2024-05-14T09:40:45.767810+0000","last_became_peered":"2024-05-14T09:40:45.767810+0000","last_unstale":"2024-05-14T10:12:13.561912+0000","last_undegraded":"2024-05-14T10:12:13.561912+0000","last_fullsized":"2024-05-14T10:12:13.561912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'1179","reported_seq":1237,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:32.881494+0000","last_change":"2024-05-14T10:12:32.881526+0000","last_active":"2024-05-14T10:12:32.881494+0000","last_peered":"2024-05-14T10:12:32.881494+0000","last_clean":"2024-05-14T10:12:32.881494+0000","last_became_active":"2024-05-14T09:40:43.114902+0000","last_became_peered":"2024-05-14T09:40:43.114902+0000","last_unstale":"2024-05-14T10:12:32.881494+0000","last_undegraded":"2024-05-14T10:12:32.881494+0000","last_fullsized":"2024-05-14T10:12:32.881494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'1179","last_scrub_stamp":"2024-05-14T10:12:32.881414+0000","last_deep_scrub":"33'1179","last_deep_scrub_stamp":"2024-05-14T10:12:32.881414+0000","last_clean_scrub_stamp":"2024-05-14T10:12:32.881414+0000","objects_scrubbed":2,"log_size":1179,"log_dups_size":0,"ondisk_log_size":1179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:32:35.119521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2830,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'101","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.461617+0000","last_change":"2024-05-14T09:40:53.650297+0000","last_active":"2024-05-14T10:11:03.461617+0000","last_peered":"2024-05-14T10:11:03.461617+0000","last_clean":"2024-05-14T10:11:03.461617+0000","last_became_active":"2024-05-14T09:40:53.649263+0000","last_became_peered":"2024-05-14T09:40:53.649263+0000","last_unstale":"2024-05-14T10:11:03.461617+0000","last_undegraded":"2024-05-14T10:11:03.461617+0000","last_fullsized":"2024-05-14T10:11:03.461617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":14510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'21","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.495651+0000","last_change":"2024-05-14T09:40:45.733131+0000","last_active":"2024-05-14T10:12:13.495651+0000","last_peered":"2024-05-14T10:12:13.495651+0000","last_clean":"2024-05-14T10:12:13.495651+0000","last_became_active":"2024-05-14T09:40:45.732154+0000","last_became_peered":"2024-05-14T09:40:45.732154+0000","last_unstale":"2024-05-14T10:12:13.495651+0000","last_undegraded":"2024-05-14T10:12:13.495651+0000","last_fullsized":"2024-05-14T10:12:13.495651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:09.343002+0000","last_change":"2024-05-14T09:40:43.112841+0000","last_active":"2024-05-14T10:12:09.343002+0000","last_peered":"2024-05-14T10:12:09.343002+0000","last_clean":"2024-05-14T10:12:09.343002+0000","last_became_active":"2024-05-14T09:40:43.110703+0000","last_became_peered":"2024-05-14T09:40:43.110703+0000","last_unstale":"2024-05-14T10:12:09.343002+0000","last_undegraded":"2024-05-14T10:12:09.343002+0000","last_fullsized":"2024-05-14T10:12:09.343002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:01.271389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'52","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:10.809452+0000","last_change":"2024-05-14T09:40:53.657532+0000","last_active":"2024-05-14T10:12:10.809452+0000","last_peered":"2024-05-14T10:12:10.809452+0000","last_clean":"2024-05-14T10:12:10.809452+0000","last_became_active":"2024-05-14T09:40:53.657073+0000","last_became_peered":"2024-05-14T09:40:53.657073+0000","last_unstale":"2024-05-14T10:12:10.809452+0000","last_undegraded":"2024-05-14T10:12:10.809452+0000","last_fullsized":"2024-05-14T10:12:10.809452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623157+0000","last_change":"2024-05-14T09:40:45.752122+0000","last_active":"2024-05-14T10:12:13.623157+0000","last_peered":"2024-05-14T10:12:13.623157+0000","last_clean":"2024-05-14T10:12:13.623157+0000","last_became_active":"2024-05-14T09:40:45.751546+0000","last_became_peered":"2024-05-14T09:40:45.751546+0000","last_unstale":"2024-05-14T10:12:13.623157+0000","last_undegraded":"2024-05-14T10:12:13.623157+0000","last_fullsized":"2024-05-14T10:12:13.623157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:19:55.897772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"33'3","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:30.922729+0000","last_change":"2024-05-14T10:12:30.922800+0000","last_active":"2024-05-14T10:12:30.922729+0000","last_peered":"2024-05-14T10:12:30.922729+0000","last_clean":"2024-05-14T10:12:30.922729+0000","last_became_active":"2024-05-14T09:40:43.098776+0000","last_became_peered":"2024-05-14T09:40:43.098776+0000","last_unstale":"2024-05-14T10:12:30.922729+0000","last_undegraded":"2024-05-14T10:12:30.922729+0000","last_fullsized":"2024-05-14T10:12:30.922729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-05-14T10:12:30.922522+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-05-14T10:12:30.922522+0000","last_clean_scrub_stamp":"2024-05-14T10:12:30.922522+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:25:08.407735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'75","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:08.040648+0000","last_change":"2024-05-14T09:40:53.650794+0000","last_active":"2024-05-14T10:12:08.040648+0000","last_peered":"2024-05-14T10:12:08.040648+0000","last_clean":"2024-05-14T10:12:08.040648+0000","last_became_active":"2024-05-14T09:40:53.650139+0000","last_became_peered":"2024-05-14T09:40:53.650139+0000","last_unstale":"2024-05-14T10:12:08.040648+0000","last_undegraded":"2024-05-14T10:12:08.040648+0000","last_fullsized":"2024-05-14T10:12:08.040648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.639330+0000","last_change":"2024-05-14T09:40:45.748430+0000","last_active":"2024-05-14T10:12:13.639330+0000","last_peered":"2024-05-14T10:12:13.639330+0000","last_clean":"2024-05-14T10:12:13.639330+0000","last_became_active":"2024-05-14T09:40:45.748048+0000","last_became_peered":"2024-05-14T09:40:45.748048+0000","last_unstale":"2024-05-14T10:12:13.639330+0000","last_undegraded":"2024-05-14T10:12:13.639330+0000","last_fullsized":"2024-05-14T10:12:13.639330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:56:29.240543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'5","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.424978+0000","last_change":"2024-05-14T09:40:43.088293+0000","last_active":"2024-05-14T10:11:52.424978+0000","last_peered":"2024-05-14T10:11:52.424978+0000","last_clean":"2024-05-14T10:11:52.424978+0000","last_became_active":"2024-05-14T09:40:43.087310+0000","last_became_peered":"2024-05-14T09:40:43.087310+0000","last_unstale":"2024-05-14T10:11:52.424978+0000","last_undegraded":"2024-05-14T10:11:52.424978+0000","last_fullsized":"2024-05-14T10:11:52.424978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:47:38.611197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'60","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.497861+0000","last_change":"2024-05-14T09:41:04.598844+0000","last_active":"2024-05-14T10:11:03.497861+0000","last_peered":"2024-05-14T10:11:03.497861+0000","last_clean":"2024-05-14T10:11:03.497861+0000","last_became_active":"2024-05-14T09:41:04.597473+0000","last_became_peered":"2024-05-14T09:41:04.597473+0000","last_unstale":"2024-05-14T10:11:03.497861+0000","last_undegraded":"2024-05-14T10:11:03.497861+0000","last_fullsized":"2024-05-14T10:11:03.497861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:48.257782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"33'26","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.495705+0000","last_change":"2024-05-14T09:40:45.740074+0000","last_active":"2024-05-14T10:12:13.495705+0000","last_peered":"2024-05-14T10:12:13.495705+0000","last_clean":"2024-05-14T10:12:13.495705+0000","last_became_active":"2024-05-14T09:40:45.739647+0000","last_became_peered":"2024-05-14T09:40:45.739647+0000","last_unstale":"2024-05-14T10:12:13.495705+0000","last_undegraded":"2024-05-14T10:12:13.495705+0000","last_fullsized":"2024-05-14T10:12:13.495705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'449","reported_seq":932,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.947539+0000","last_change":"2024-05-14T09:40:43.043210+0000","last_active":"2024-05-14T10:12:13.947539+0000","last_peered":"2024-05-14T10:12:13.947539+0000","last_clean":"2024-05-14T10:12:13.947539+0000","last_became_active":"2024-05-14T09:40:43.042243+0000","last_became_peered":"2024-05-14T09:40:43.042243+0000","last_unstale":"2024-05-14T10:12:13.947539+0000","last_undegraded":"2024-05-14T10:12:13.947539+0000","last_fullsized":"2024-05-14T10:12:13.947539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117717,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":466,"num_write":444,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'62","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:13.029280+0000","last_change":"2024-05-14T09:40:53.652161+0000","last_active":"2024-05-14T10:11:13.029280+0000","last_peered":"2024-05-14T10:11:13.029280+0000","last_clean":"2024-05-14T10:11:13.029280+0000","last_became_active":"2024-05-14T09:40:53.649990+0000","last_became_peered":"2024-05-14T09:40:53.649990+0000","last_unstale":"2024-05-14T10:11:13.029280+0000","last_undegraded":"2024-05-14T10:11:13.029280+0000","last_fullsized":"2024-05-14T10:11:13.029280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"33'12","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.490259+0000","last_change":"2024-05-14T09:40:45.754250+0000","last_active":"2024-05-14T10:12:13.490259+0000","last_peered":"2024-05-14T10:12:13.490259+0000","last_clean":"2024-05-14T10:12:13.490259+0000","last_became_active":"2024-05-14T09:40:45.753850+0000","last_became_peered":"2024-05-14T09:40:45.753850+0000","last_unstale":"2024-05-14T10:12:13.490259+0000","last_undegraded":"2024-05-14T10:12:13.490259+0000","last_fullsized":"2024-05-14T10:12:13.490259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:27.863105+0000","last_change":"2024-05-14T09:40:43.111905+0000","last_active":"2024-05-14T10:11:27.863105+0000","last_peered":"2024-05-14T10:11:27.863105+0000","last_clean":"2024-05-14T10:11:27.863105+0000","last_became_active":"2024-05-14T09:40:43.108233+0000","last_became_peered":"2024-05-14T09:40:43.108233+0000","last_unstale":"2024-05-14T10:11:27.863105+0000","last_undegraded":"2024-05-14T10:11:27.863105+0000","last_fullsized":"2024-05-14T10:11:27.863105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:11:05.070938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'88","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:15.796902+0000","last_change":"2024-05-14T09:40:53.663789+0000","last_active":"2024-05-14T10:11:15.796902+0000","last_peered":"2024-05-14T10:11:15.796902+0000","last_clean":"2024-05-14T10:11:15.796902+0000","last_became_active":"2024-05-14T09:40:53.662980+0000","last_became_peered":"2024-05-14T09:40:53.662980+0000","last_unstale":"2024-05-14T10:11:15.796902+0000","last_undegraded":"2024-05-14T10:11:15.796902+0000","last_fullsized":"2024-05-14T10:11:15.796902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"33'18","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.529744+0000","last_change":"2024-05-14T09:40:45.754347+0000","last_active":"2024-05-14T10:12:13.529744+0000","last_peered":"2024-05-14T10:12:13.529744+0000","last_clean":"2024-05-14T10:12:13.529744+0000","last_became_active":"2024-05-14T09:40:45.753869+0000","last_became_peered":"2024-05-14T09:40:45.753869+0000","last_unstale":"2024-05-14T10:12:13.529744+0000","last_undegraded":"2024-05-14T10:12:13.529744+0000","last_fullsized":"2024-05-14T10:12:13.529744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'8","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:45.883971+0000","last_change":"2024-05-14T09:40:43.087481+0000","last_active":"2024-05-14T10:11:45.883971+0000","last_peered":"2024-05-14T10:11:45.883971+0000","last_clean":"2024-05-14T10:11:45.883971+0000","last_became_active":"2024-05-14T09:40:43.086487+0000","last_became_peered":"2024-05-14T09:40:43.086487+0000","last_unstale":"2024-05-14T10:11:45.883971+0000","last_undegraded":"2024-05-14T10:11:45.883971+0000","last_fullsized":"2024-05-14T10:11:45.883971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:54.225063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:24.762813+0000","last_change":"2024-05-14T09:40:22.705545+0000","last_active":"2024-05-14T10:10:24.762813+0000","last_peered":"2024-05-14T10:10:24.762813+0000","last_clean":"2024-05-14T10:10:24.762813+0000","last_became_active":"2024-05-14T09:40:22.701797+0000","last_became_peered":"2024-05-14T09:40:22.701797+0000","last_unstale":"2024-05-14T10:10:24.762813+0000","last_undegraded":"2024-05-14T10:10:24.762813+0000","last_fullsized":"2024-05-14T10:10:24.762813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:17.767400+0000","last_clean_scrub_stamp":"2024-05-14T09:40:17.767400+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:48:21.700172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'61","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:10:49.080123+0000","last_change":"2024-05-14T09:40:53.681915+0000","last_active":"2024-05-14T10:10:49.080123+0000","last_peered":"2024-05-14T10:10:49.080123+0000","last_clean":"2024-05-14T10:10:49.080123+0000","last_became_active":"2024-05-14T09:40:53.681296+0000","last_became_peered":"2024-05-14T09:40:53.681296+0000","last_unstale":"2024-05-14T10:10:49.080123+0000","last_undegraded":"2024-05-14T10:10:49.080123+0000","last_fullsized":"2024-05-14T10:10:49.080123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:21.455981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'23","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.633696+0000","last_change":"2024-05-14T09:41:04.213355+0000","last_active":"2024-05-14T10:12:13.633696+0000","last_peered":"2024-05-14T10:12:13.633696+0000","last_clean":"2024-05-14T10:12:13.633696+0000","last_became_active":"2024-05-14T09:41:04.212709+0000","last_became_peered":"2024-05-14T09:41:04.212709+0000","last_unstale":"2024-05-14T10:12:13.633696+0000","last_undegraded":"2024-05-14T10:12:13.633696+0000","last_fullsized":"2024-05-14T10:12:13.633696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"33'5","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:15.908917+0000","last_change":"2024-05-14T09:40:43.090401+0000","last_active":"2024-05-14T10:12:15.908917+0000","last_peered":"2024-05-14T10:12:15.908917+0000","last_clean":"2024-05-14T10:12:15.908917+0000","last_became_active":"2024-05-14T09:40:43.089548+0000","last_became_peered":"2024-05-14T09:40:43.089548+0000","last_unstale":"2024-05-14T10:12:15.908917+0000","last_undegraded":"2024-05-14T10:12:15.908917+0000","last_fullsized":"2024-05-14T10:12:15.908917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'79","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:07.506476+0000","last_change":"2024-05-14T09:40:53.677072+0000","last_active":"2024-05-14T10:11:07.506476+0000","last_peered":"2024-05-14T10:11:07.506476+0000","last_clean":"2024-05-14T10:11:07.506476+0000","last_became_active":"2024-05-14T09:40:53.676636+0000","last_became_peered":"2024-05-14T09:40:53.676636+0000","last_unstale":"2024-05-14T10:11:07.506476+0000","last_undegraded":"2024-05-14T10:11:07.506476+0000","last_fullsized":"2024-05-14T10:11:07.506476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":7859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'21","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623051+0000","last_change":"2024-05-14T09:40:45.750962+0000","last_active":"2024-05-14T10:12:13.623051+0000","last_peered":"2024-05-14T10:12:13.623051+0000","last_clean":"2024-05-14T10:12:13.623051+0000","last_became_active":"2024-05-14T09:40:45.750539+0000","last_became_peered":"2024-05-14T09:40:45.750539+0000","last_unstale":"2024-05-14T10:12:13.623051+0000","last_undegraded":"2024-05-14T10:12:13.623051+0000","last_fullsized":"2024-05-14T10:12:13.623051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T09:50:42.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.041461+0000","last_change":"2024-05-14T09:40:43.122483+0000","last_active":"2024-05-14T10:12:13.041461+0000","last_peered":"2024-05-14T10:12:13.041461+0000","last_clean":"2024-05-14T10:12:13.041461+0000","last_became_active":"2024-05-14T09:40:43.121427+0000","last_became_peered":"2024-05-14T09:40:43.121427+0000","last_unstale":"2024-05-14T10:12:13.041461+0000","last_undegraded":"2024-05-14T10:12:13.041461+0000","last_fullsized":"2024-05-14T10:12:13.041461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'90","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:25.813505+0000","last_change":"2024-05-14T09:40:53.656157+0000","last_active":"2024-05-14T10:12:25.813505+0000","last_peered":"2024-05-14T10:12:25.813505+0000","last_clean":"2024-05-14T10:12:25.813505+0000","last_became_active":"2024-05-14T09:40:53.655141+0000","last_became_peered":"2024-05-14T09:40:53.655141+0000","last_unstale":"2024-05-14T10:12:25.813505+0000","last_undegraded":"2024-05-14T10:12:25.813505+0000","last_fullsized":"2024-05-14T10:12:25.813505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'24","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655700+0000","last_change":"2024-05-14T09:40:45.778555+0000","last_active":"2024-05-14T10:12:13.655700+0000","last_peered":"2024-05-14T10:12:13.655700+0000","last_clean":"2024-05-14T10:12:13.655700+0000","last_became_active":"2024-05-14T09:40:45.776967+0000","last_became_peered":"2024-05-14T09:40:45.776967+0000","last_unstale":"2024-05-14T10:12:13.655700+0000","last_undegraded":"2024-05-14T10:12:13.655700+0000","last_fullsized":"2024-05-14T10:12:13.655700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:45:35.032854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"33'3","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:15.908976+0000","last_change":"2024-05-14T09:40:43.043359+0000","last_active":"2024-05-14T10:12:15.908976+0000","last_peered":"2024-05-14T10:12:15.908976+0000","last_clean":"2024-05-14T10:12:15.908976+0000","last_became_active":"2024-05-14T09:40:43.042486+0000","last_became_peered":"2024-05-14T09:40:43.042486+0000","last_unstale":"2024-05-14T10:12:15.908976+0000","last_undegraded":"2024-05-14T10:12:15.908976+0000","last_fullsized":"2024-05-14T10:12:15.908976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'69","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.556561+0000","last_change":"2024-05-14T09:40:53.662719+0000","last_active":"2024-05-14T10:11:05.556561+0000","last_peered":"2024-05-14T10:11:05.556561+0000","last_clean":"2024-05-14T10:11:05.556561+0000","last_became_active":"2024-05-14T09:40:53.660933+0000","last_became_peered":"2024-05-14T09:40:53.660933+0000","last_unstale":"2024-05-14T10:11:05.556561+0000","last_undegraded":"2024-05-14T10:11:05.556561+0000","last_fullsized":"2024-05-14T10:11:05.556561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:02.584358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'15","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655467+0000","last_change":"2024-05-14T09:40:45.776336+0000","last_active":"2024-05-14T10:12:13.655467+0000","last_peered":"2024-05-14T10:12:13.655467+0000","last_clean":"2024-05-14T10:12:13.655467+0000","last_became_active":"2024-05-14T09:40:45.775936+0000","last_became_peered":"2024-05-14T09:40:45.775936+0000","last_unstale":"2024-05-14T10:12:13.655467+0000","last_undegraded":"2024-05-14T10:12:13.655467+0000","last_fullsized":"2024-05-14T10:12:13.655467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:43:59.300900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'7","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:04.105943+0000","last_change":"2024-05-14T09:40:43.124714+0000","last_active":"2024-05-14T10:12:04.105943+0000","last_peered":"2024-05-14T10:12:04.105943+0000","last_clean":"2024-05-14T10:12:04.105943+0000","last_became_active":"2024-05-14T09:40:43.124370+0000","last_became_peered":"2024-05-14T09:40:43.124370+0000","last_unstale":"2024-05-14T10:12:04.105943+0000","last_undegraded":"2024-05-14T10:12:04.105943+0000","last_fullsized":"2024-05-14T10:12:04.105943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:52.132214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'76","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.457975+0000","last_change":"2024-05-14T09:40:53.667102+0000","last_active":"2024-05-14T10:11:06.457975+0000","last_peered":"2024-05-14T10:11:06.457975+0000","last_clean":"2024-05-14T10:11:06.457975+0000","last_became_active":"2024-05-14T09:40:53.666666+0000","last_became_peered":"2024-05-14T09:40:53.666666+0000","last_unstale":"2024-05-14T10:11:06.457975+0000","last_undegraded":"2024-05-14T10:11:06.457975+0000","last_fullsized":"2024-05-14T10:11:06.457975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:02:03.076710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'22","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.645621+0000","last_change":"2024-05-14T09:40:45.777251+0000","last_active":"2024-05-14T10:12:13.645621+0000","last_peered":"2024-05-14T10:12:13.645621+0000","last_clean":"2024-05-14T10:12:13.645621+0000","last_became_active":"2024-05-14T09:40:45.775668+0000","last_became_peered":"2024-05-14T09:40:45.775668+0000","last_unstale":"2024-05-14T10:12:13.645621+0000","last_undegraded":"2024-05-14T10:12:13.645621+0000","last_fullsized":"2024-05-14T10:12:13.645621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:01:54.917354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'26","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:29.930742+0000","last_change":"2024-05-14T10:12:29.930791+0000","last_active":"2024-05-14T10:12:29.930742+0000","last_peered":"2024-05-14T10:12:29.930742+0000","last_clean":"2024-05-14T10:12:29.930742+0000","last_became_active":"2024-05-14T09:40:43.039186+0000","last_became_peered":"2024-05-14T09:40:43.039186+0000","last_unstale":"2024-05-14T10:12:29.930742+0000","last_undegraded":"2024-05-14T10:12:29.930742+0000","last_fullsized":"2024-05-14T10:12:29.930742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-05-14T10:12:29.930609+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-05-14T10:12:29.930609+0000","last_clean_scrub_stamp":"2024-05-14T10:12:29.930609+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:34:31.817064+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'79","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:20.812211+0000","last_change":"2024-05-14T09:40:53.667056+0000","last_active":"2024-05-14T10:12:20.812211+0000","last_peered":"2024-05-14T10:12:20.812211+0000","last_clean":"2024-05-14T10:12:20.812211+0000","last_became_active":"2024-05-14T09:40:53.666575+0000","last_became_peered":"2024-05-14T09:40:53.666575+0000","last_unstale":"2024-05-14T10:12:20.812211+0000","last_undegraded":"2024-05-14T10:12:20.812211+0000","last_fullsized":"2024-05-14T10:12:20.812211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":7996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'21","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.850810+0000","last_change":"2024-05-14T09:40:45.754466+0000","last_active":"2024-05-14T10:12:13.850810+0000","last_peered":"2024-05-14T10:12:13.850810+0000","last_clean":"2024-05-14T10:12:13.850810+0000","last_became_active":"2024-05-14T09:40:45.753839+0000","last_became_peered":"2024-05-14T09:40:45.753839+0000","last_unstale":"2024-05-14T10:12:13.850810+0000","last_undegraded":"2024-05-14T10:12:13.850810+0000","last_fullsized":"2024-05-14T10:12:13.850810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:42:18.052670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'5","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:34.188111+0000","last_change":"2024-05-14T09:40:43.121744+0000","last_active":"2024-05-14T10:11:34.188111+0000","last_peered":"2024-05-14T10:11:34.188111+0000","last_clean":"2024-05-14T10:11:34.188111+0000","last_became_active":"2024-05-14T09:40:43.121388+0000","last_became_peered":"2024-05-14T09:40:43.121388+0000","last_unstale":"2024-05-14T10:11:34.188111+0000","last_undegraded":"2024-05-14T10:11:34.188111+0000","last_fullsized":"2024-05-14T10:11:34.188111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:08:08.897860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'76","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:21.724351+0000","last_change":"2024-05-14T09:40:53.659658+0000","last_active":"2024-05-14T10:12:21.724351+0000","last_peered":"2024-05-14T10:12:21.724351+0000","last_clean":"2024-05-14T10:12:21.724351+0000","last_became_active":"2024-05-14T09:40:53.659191+0000","last_became_peered":"2024-05-14T09:40:53.659191+0000","last_unstale":"2024-05-14T10:12:21.724351+0000","last_undegraded":"2024-05-14T10:12:21.724351+0000","last_fullsized":"2024-05-14T10:12:21.724351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":8058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'34","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655238+0000","last_change":"2024-05-14T09:40:45.776748+0000","last_active":"2024-05-14T10:12:13.655238+0000","last_peered":"2024-05-14T10:12:13.655238+0000","last_clean":"2024-05-14T10:12:13.655238+0000","last_became_active":"2024-05-14T09:40:45.776451+0000","last_became_peered":"2024-05-14T09:40:45.776451+0000","last_unstale":"2024-05-14T10:12:13.655238+0000","last_undegraded":"2024-05-14T10:12:13.655238+0000","last_fullsized":"2024-05-14T10:12:13.655238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:39.890407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:09.356299+0000","last_change":"2024-05-14T09:40:43.086185+0000","last_active":"2024-05-14T10:12:09.356299+0000","last_peered":"2024-05-14T10:12:09.356299+0000","last_clean":"2024-05-14T10:12:09.356299+0000","last_became_active":"2024-05-14T09:40:43.085320+0000","last_became_peered":"2024-05-14T09:40:43.085320+0000","last_unstale":"2024-05-14T10:12:09.356299+0000","last_undegraded":"2024-05-14T10:12:09.356299+0000","last_fullsized":"2024-05-14T10:12:09.356299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:26:22.301593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'63","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:21.710555+0000","last_change":"2024-05-14T09:40:53.673710+0000","last_active":"2024-05-14T10:11:21.710555+0000","last_peered":"2024-05-14T10:11:21.710555+0000","last_clean":"2024-05-14T10:11:21.710555+0000","last_became_active":"2024-05-14T09:40:53.672089+0000","last_became_peered":"2024-05-14T09:40:53.672089+0000","last_unstale":"2024-05-14T10:11:21.710555+0000","last_undegraded":"2024-05-14T10:11:21.710555+0000","last_fullsized":"2024-05-14T10:11:21.710555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":6897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'25","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.489206+0000","last_change":"2024-05-14T09:40:45.767220+0000","last_active":"2024-05-14T10:12:13.489206+0000","last_peered":"2024-05-14T10:12:13.489206+0000","last_clean":"2024-05-14T10:12:13.489206+0000","last_became_active":"2024-05-14T09:40:45.766895+0000","last_became_peered":"2024-05-14T09:40:45.766895+0000","last_unstale":"2024-05-14T10:12:13.489206+0000","last_undegraded":"2024-05-14T10:12:13.489206+0000","last_fullsized":"2024-05-14T10:12:13.489206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'14","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:28.665007+0000","last_change":"2024-05-14T10:12:28.665094+0000","last_active":"2024-05-14T10:12:28.665007+0000","last_peered":"2024-05-14T10:12:28.665007+0000","last_clean":"2024-05-14T10:12:28.665007+0000","last_became_active":"2024-05-14T09:40:43.124129+0000","last_became_peered":"2024-05-14T09:40:43.124129+0000","last_unstale":"2024-05-14T10:12:28.665007+0000","last_undegraded":"2024-05-14T10:12:28.665007+0000","last_fullsized":"2024-05-14T10:12:28.665007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-05-14T10:12:28.664786+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-05-14T10:12:28.664786+0000","last_clean_scrub_stamp":"2024-05-14T10:12:28.664786+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:57:16.926378+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'71","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:06.445761+0000","last_change":"2024-05-14T09:40:53.664722+0000","last_active":"2024-05-14T10:11:06.445761+0000","last_peered":"2024-05-14T10:11:06.445761+0000","last_clean":"2024-05-14T10:11:06.445761+0000","last_became_active":"2024-05-14T09:40:53.664194+0000","last_became_peered":"2024-05-14T09:40:53.664194+0000","last_unstale":"2024-05-14T10:11:06.445761+0000","last_undegraded":"2024-05-14T10:11:06.445761+0000","last_fullsized":"2024-05-14T10:11:06.445761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:35:57.826557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":7358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'20","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.643712+0000","last_change":"2024-05-14T09:40:45.770662+0000","last_active":"2024-05-14T10:12:13.643712+0000","last_peered":"2024-05-14T10:12:13.643712+0000","last_clean":"2024-05-14T10:12:13.643712+0000","last_became_active":"2024-05-14T09:40:45.768058+0000","last_became_peered":"2024-05-14T09:40:45.768058+0000","last_unstale":"2024-05-14T10:12:13.643712+0000","last_undegraded":"2024-05-14T10:12:13.643712+0000","last_fullsized":"2024-05-14T10:12:13.643712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:41:13.296625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'824","reported_seq":872,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:56.423487+0000","last_change":"2024-05-14T09:40:43.113989+0000","last_active":"2024-05-14T10:11:56.423487+0000","last_peered":"2024-05-14T10:11:56.423487+0000","last_clean":"2024-05-14T10:11:56.423487+0000","last_became_active":"2024-05-14T09:40:43.113589+0000","last_became_peered":"2024-05-14T09:40:43.113589+0000","last_unstale":"2024-05-14T10:11:56.423487+0000","last_undegraded":"2024-05-14T10:11:56.423487+0000","last_fullsized":"2024-05-14T10:11:56.423487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:42:17.351523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'80","reported_seq":115,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:13.029108+0000","last_change":"2024-05-14T09:40:53.663887+0000","last_active":"2024-05-14T10:11:13.029108+0000","last_peered":"2024-05-14T10:11:13.029108+0000","last_clean":"2024-05-14T10:11:13.029108+0000","last_became_active":"2024-05-14T09:40:53.663419+0000","last_became_peered":"2024-05-14T09:40:53.663419+0000","last_unstale":"2024-05-14T10:11:13.029108+0000","last_undegraded":"2024-05-14T10:11:13.029108+0000","last_fullsized":"2024-05-14T10:11:13.029108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":12628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"33'24","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.653832+0000","last_change":"2024-05-14T09:40:45.767184+0000","last_active":"2024-05-14T10:12:13.653832+0000","last_peered":"2024-05-14T10:12:13.653832+0000","last_clean":"2024-05-14T10:12:13.653832+0000","last_became_active":"2024-05-14T09:40:45.766784+0000","last_became_peered":"2024-05-14T09:40:45.766784+0000","last_unstale":"2024-05-14T10:12:13.653832+0000","last_undegraded":"2024-05-14T10:12:13.653832+0000","last_fullsized":"2024-05-14T10:12:13.653832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:10:10.269804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'309","reported_seq":366,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:29.899048+0000","last_change":"2024-05-14T10:12:29.899141+0000","last_active":"2024-05-14T10:12:29.899048+0000","last_peered":"2024-05-14T10:12:29.899048+0000","last_clean":"2024-05-14T10:12:29.899048+0000","last_became_active":"2024-05-14T09:40:43.088906+0000","last_became_peered":"2024-05-14T09:40:43.088906+0000","last_unstale":"2024-05-14T10:12:29.899048+0000","last_undegraded":"2024-05-14T10:12:29.899048+0000","last_fullsized":"2024-05-14T10:12:29.899048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'309","last_scrub_stamp":"2024-05-14T10:12:29.898924+0000","last_deep_scrub":"33'309","last_deep_scrub_stamp":"2024-05-14T10:12:29.898924+0000","last_clean_scrub_stamp":"2024-05-14T10:12:29.898924+0000","objects_scrubbed":3,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:48:49.361938+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'115","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.819059+0000","last_change":"2024-05-14T09:40:53.667412+0000","last_active":"2024-05-14T10:11:05.819059+0000","last_peered":"2024-05-14T10:11:05.819059+0000","last_clean":"2024-05-14T10:11:05.819059+0000","last_became_active":"2024-05-14T09:40:53.666533+0000","last_became_peered":"2024-05-14T09:40:53.666533+0000","last_unstale":"2024-05-14T10:11:05.819059+0000","last_undegraded":"2024-05-14T10:11:05.819059+0000","last_fullsized":"2024-05-14T10:11:05.819059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:53:41.310701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'25","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.473524+0000","last_change":"2024-05-14T09:41:04.250664+0000","last_active":"2024-05-14T10:12:13.473524+0000","last_peered":"2024-05-14T10:12:13.473524+0000","last_clean":"2024-05-14T10:12:13.473524+0000","last_became_active":"2024-05-14T09:41:04.250043+0000","last_became_peered":"2024-05-14T09:41:04.250043+0000","last_unstale":"2024-05-14T10:12:13.473524+0000","last_undegraded":"2024-05-14T10:12:13.473524+0000","last_fullsized":"2024-05-14T10:12:13.473524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:54.436624+0000","last_change":"2024-05-14T09:40:43.116130+0000","last_active":"2024-05-14T10:11:54.436624+0000","last_peered":"2024-05-14T10:11:54.436624+0000","last_clean":"2024-05-14T10:11:54.436624+0000","last_became_active":"2024-05-14T09:40:43.115741+0000","last_became_peered":"2024-05-14T09:40:43.115741+0000","last_unstale":"2024-05-14T10:11:54.436624+0000","last_undegraded":"2024-05-14T10:11:54.436624+0000","last_fullsized":"2024-05-14T10:11:54.436624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:35.083285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'83","reported_seq":118,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:16.709358+0000","last_change":"2024-05-14T09:40:53.667088+0000","last_active":"2024-05-14T10:11:16.709358+0000","last_peered":"2024-05-14T10:11:16.709358+0000","last_clean":"2024-05-14T10:11:16.709358+0000","last_became_active":"2024-05-14T09:40:53.662581+0000","last_became_peered":"2024-05-14T09:40:53.662581+0000","last_unstale":"2024-05-14T10:11:16.709358+0000","last_undegraded":"2024-05-14T10:11:16.709358+0000","last_fullsized":"2024-05-14T10:11:16.709358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.617351+0000","last_change":"2024-05-14T09:40:45.774302+0000","last_active":"2024-05-14T10:12:13.617351+0000","last_peered":"2024-05-14T10:12:13.617351+0000","last_clean":"2024-05-14T10:12:13.617351+0000","last_became_active":"2024-05-14T09:40:45.773879+0000","last_became_peered":"2024-05-14T09:40:45.773879+0000","last_unstale":"2024-05-14T10:12:13.617351+0000","last_undegraded":"2024-05-14T10:12:13.617351+0000","last_fullsized":"2024-05-14T10:12:13.617351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:32:09.921679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'11","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:10.831471+0000","last_change":"2024-05-14T09:40:43.116616+0000","last_active":"2024-05-14T10:12:10.831471+0000","last_peered":"2024-05-14T10:12:10.831471+0000","last_clean":"2024-05-14T10:12:10.831471+0000","last_became_active":"2024-05-14T09:40:43.115166+0000","last_became_peered":"2024-05-14T09:40:43.115166+0000","last_unstale":"2024-05-14T10:12:10.831471+0000","last_undegraded":"2024-05-14T10:12:10.831471+0000","last_fullsized":"2024-05-14T10:12:10.831471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:22:52.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'85","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:16.709447+0000","last_change":"2024-05-14T09:40:53.668423+0000","last_active":"2024-05-14T10:11:16.709447+0000","last_peered":"2024-05-14T10:11:16.709447+0000","last_clean":"2024-05-14T10:11:16.709447+0000","last_became_active":"2024-05-14T09:40:53.664838+0000","last_became_peered":"2024-05-14T09:40:53.664838+0000","last_unstale":"2024-05-14T10:11:16.709447+0000","last_undegraded":"2024-05-14T10:11:16.709447+0000","last_fullsized":"2024-05-14T10:11:16.709447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":10155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'59","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.476035+0000","last_change":"2024-05-14T09:40:53.656095+0000","last_active":"2024-05-14T10:11:05.476035+0000","last_peered":"2024-05-14T10:11:05.476035+0000","last_clean":"2024-05-14T10:11:05.476035+0000","last_became_active":"2024-05-14T09:40:53.655439+0000","last_became_peered":"2024-05-14T09:40:53.655439+0000","last_unstale":"2024-05-14T10:11:05.476035+0000","last_undegraded":"2024-05-14T10:11:05.476035+0000","last_fullsized":"2024-05-14T10:11:05.476035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'26","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:18.042330+0000","last_change":"2024-05-14T09:40:45.744447+0000","last_active":"2024-05-14T10:12:18.042330+0000","last_peered":"2024-05-14T10:12:18.042330+0000","last_clean":"2024-05-14T10:12:18.042330+0000","last_became_active":"2024-05-14T09:40:45.743611+0000","last_became_peered":"2024-05-14T09:40:45.743611+0000","last_unstale":"2024-05-14T10:12:18.042330+0000","last_undegraded":"2024-05-14T10:12:18.042330+0000","last_fullsized":"2024-05-14T10:12:18.042330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'7","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:04.107149+0000","last_change":"2024-05-14T09:40:43.122005+0000","last_active":"2024-05-14T10:12:04.107149+0000","last_peered":"2024-05-14T10:12:04.107149+0000","last_clean":"2024-05-14T10:12:04.107149+0000","last_became_active":"2024-05-14T09:40:43.121629+0000","last_became_peered":"2024-05-14T09:40:43.121629+0000","last_unstale":"2024-05-14T10:12:04.107149+0000","last_undegraded":"2024-05-14T10:12:04.107149+0000","last_fullsized":"2024-05-14T10:12:04.107149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:31:03.016812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'63","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:03.462172+0000","last_change":"2024-05-14T09:40:53.679415+0000","last_active":"2024-05-14T10:11:03.462172+0000","last_peered":"2024-05-14T10:11:03.462172+0000","last_clean":"2024-05-14T10:11:03.462172+0000","last_became_active":"2024-05-14T09:40:53.678851+0000","last_became_peered":"2024-05-14T09:40:53.678851+0000","last_unstale":"2024-05-14T10:11:03.462172+0000","last_undegraded":"2024-05-14T10:11:03.462172+0000","last_fullsized":"2024-05-14T10:11:03.462172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:59:48.049763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'26","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.539879+0000","last_change":"2024-05-14T09:40:45.743111+0000","last_active":"2024-05-14T10:12:13.539879+0000","last_peered":"2024-05-14T10:12:13.539879+0000","last_clean":"2024-05-14T10:12:13.539879+0000","last_became_active":"2024-05-14T09:40:45.742702+0000","last_became_peered":"2024-05-14T09:40:45.742702+0000","last_unstale":"2024-05-14T10:12:13.539879+0000","last_undegraded":"2024-05-14T10:12:13.539879+0000","last_fullsized":"2024-05-14T10:12:13.539879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:16.723546+0000","last_change":"2024-05-14T09:40:43.116535+0000","last_active":"2024-05-14T10:12:16.723546+0000","last_peered":"2024-05-14T10:12:16.723546+0000","last_clean":"2024-05-14T10:12:16.723546+0000","last_became_active":"2024-05-14T09:40:43.115860+0000","last_became_peered":"2024-05-14T09:40:43.115860+0000","last_unstale":"2024-05-14T10:12:16.723546+0000","last_undegraded":"2024-05-14T10:12:16.723546+0000","last_fullsized":"2024-05-14T10:12:16.723546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'339","reported_seq":386,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:52.430157+0000","last_change":"2024-05-14T09:40:43.120700+0000","last_active":"2024-05-14T10:11:52.430157+0000","last_peered":"2024-05-14T10:11:52.430157+0000","last_clean":"2024-05-14T10:11:52.430157+0000","last_became_active":"2024-05-14T09:40:43.120353+0000","last_became_peered":"2024-05-14T09:40:43.120353+0000","last_unstale":"2024-05-14T10:11:52.430157+0000","last_undegraded":"2024-05-14T10:11:52.430157+0000","last_fullsized":"2024-05-14T10:11:52.430157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:35.425012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'24","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.493282+0000","last_change":"2024-05-14T09:40:45.758385+0000","last_active":"2024-05-14T10:12:13.493282+0000","last_peered":"2024-05-14T10:12:13.493282+0000","last_clean":"2024-05-14T10:12:13.493282+0000","last_became_active":"2024-05-14T09:40:45.758017+0000","last_became_peered":"2024-05-14T09:40:45.758017+0000","last_unstale":"2024-05-14T10:12:13.493282+0000","last_undegraded":"2024-05-14T10:12:13.493282+0000","last_fullsized":"2024-05-14T10:12:13.493282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'56","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:05.820884+0000","last_change":"2024-05-14T09:40:53.671995+0000","last_active":"2024-05-14T10:11:05.820884+0000","last_peered":"2024-05-14T10:11:05.820884+0000","last_clean":"2024-05-14T10:11:05.820884+0000","last_became_active":"2024-05-14T09:40:53.671145+0000","last_became_peered":"2024-05-14T09:40:53.671145+0000","last_unstale":"2024-05-14T10:11:05.820884+0000","last_undegraded":"2024-05-14T10:11:05.820884+0000","last_fullsized":"2024-05-14T10:11:05.820884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'472","reported_seq":520,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.187495+0000","last_change":"2024-05-14T09:40:43.105812+0000","last_active":"2024-05-14T10:12:13.187495+0000","last_peered":"2024-05-14T10:12:13.187495+0000","last_clean":"2024-05-14T10:12:13.187495+0000","last_became_active":"2024-05-14T09:40:43.104821+0000","last_became_peered":"2024-05-14T09:40:43.104821+0000","last_unstale":"2024-05-14T10:12:13.187495+0000","last_undegraded":"2024-05-14T10:12:13.187495+0000","last_fullsized":"2024-05-14T10:12:13.187495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:41.619569+0000","last_clean_scrub_stamp":"2024-05-14T09:40:41.619569+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'22","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.640694+0000","last_change":"2024-05-14T09:40:45.746294+0000","last_active":"2024-05-14T10:12:13.640694+0000","last_peered":"2024-05-14T10:12:13.640694+0000","last_clean":"2024-05-14T10:12:13.640694+0000","last_became_active":"2024-05-14T09:40:45.745850+0000","last_became_peered":"2024-05-14T09:40:45.745850+0000","last_unstale":"2024-05-14T10:12:13.640694+0000","last_undegraded":"2024-05-14T10:12:13.640694+0000","last_fullsized":"2024-05-14T10:12:13.640694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:53:17.774486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'74","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:11:07.490091+0000","last_change":"2024-05-14T09:40:53.670990+0000","last_active":"2024-05-14T10:11:07.490091+0000","last_peered":"2024-05-14T10:11:07.490091+0000","last_clean":"2024-05-14T10:11:07.490091+0000","last_became_active":"2024-05-14T09:40:53.669094+0000","last_became_peered":"2024-05-14T09:40:53.669094+0000","last_unstale":"2024-05-14T10:11:07.490091+0000","last_undegraded":"2024-05-14T10:11:07.490091+0000","last_fullsized":"2024-05-14T10:11:07.490091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:52.073045+0000","last_clean_scrub_stamp":"2024-05-14T09:40:52.073045+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":7350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.851152+0000","last_change":"2024-05-14T09:40:45.754615+0000","last_active":"2024-05-14T10:12:13.851152+0000","last_peered":"2024-05-14T10:12:13.851152+0000","last_clean":"2024-05-14T10:12:13.851152+0000","last_became_active":"2024-05-14T09:40:45.754283+0000","last_became_peered":"2024-05-14T09:40:45.754283+0000","last_unstale":"2024-05-14T10:12:13.851152+0000","last_undegraded":"2024-05-14T10:12:13.851152+0000","last_fullsized":"2024-05-14T10:12:13.851152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:28:22.722534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'26","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.633863+0000","last_change":"2024-05-14T09:40:45.753218+0000","last_active":"2024-05-14T10:12:13.633863+0000","last_peered":"2024-05-14T10:12:13.633863+0000","last_clean":"2024-05-14T10:12:13.633863+0000","last_became_active":"2024-05-14T09:40:45.752599+0000","last_became_peered":"2024-05-14T09:40:45.752599+0000","last_unstale":"2024-05-14T10:12:13.633863+0000","last_undegraded":"2024-05-14T10:12:13.633863+0000","last_fullsized":"2024-05-14T10:12:13.633863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'26","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.615687+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T10:12:13.615687+0000","last_peered":"2024-05-14T10:12:13.615687+0000","last_clean":"2024-05-14T10:12:13.615687+0000","last_became_active":"2024-05-14T09:40:45.750387+0000","last_became_peered":"2024-05-14T09:40:45.750387+0000","last_unstale":"2024-05-14T10:12:13.615687+0000","last_undegraded":"2024-05-14T10:12:13.615687+0000","last_fullsized":"2024-05-14T10:12:13.615687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:54.689111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'18","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.475675+0000","last_change":"2024-05-14T09:41:04.251002+0000","last_active":"2024-05-14T10:12:13.475675+0000","last_peered":"2024-05-14T10:12:13.475675+0000","last_clean":"2024-05-14T10:12:13.475675+0000","last_became_active":"2024-05-14T09:41:04.250037+0000","last_became_peered":"2024-05-14T09:41:04.250037+0000","last_unstale":"2024-05-14T10:12:13.475675+0000","last_undegraded":"2024-05-14T10:12:13.475675+0000","last_fullsized":"2024-05-14T10:12:13.475675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'17","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.572785+0000","last_change":"2024-05-14T09:40:45.723956+0000","last_active":"2024-05-14T10:12:13.572785+0000","last_peered":"2024-05-14T10:12:13.572785+0000","last_clean":"2024-05-14T10:12:13.572785+0000","last_became_active":"2024-05-14T09:40:45.723040+0000","last_became_peered":"2024-05-14T09:40:45.723040+0000","last_unstale":"2024-05-14T10:12:13.572785+0000","last_undegraded":"2024-05-14T10:12:13.572785+0000","last_fullsized":"2024-05-14T10:12:13.572785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.488205+0000","last_change":"2024-05-14T09:40:45.746942+0000","last_active":"2024-05-14T10:12:13.488205+0000","last_peered":"2024-05-14T10:12:13.488205+0000","last_clean":"2024-05-14T10:12:13.488205+0000","last_became_active":"2024-05-14T09:40:45.745393+0000","last_became_peered":"2024-05-14T09:40:45.745393+0000","last_unstale":"2024-05-14T10:12:13.488205+0000","last_undegraded":"2024-05-14T10:12:13.488205+0000","last_fullsized":"2024-05-14T10:12:13.488205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'32","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.860871+0000","last_change":"2024-05-14T09:40:45.772238+0000","last_active":"2024-05-14T10:12:13.860871+0000","last_peered":"2024-05-14T10:12:13.860871+0000","last_clean":"2024-05-14T10:12:13.860871+0000","last_became_active":"2024-05-14T09:40:45.771838+0000","last_became_peered":"2024-05-14T09:40:45.771838+0000","last_unstale":"2024-05-14T10:12:13.860871+0000","last_undegraded":"2024-05-14T10:12:13.860871+0000","last_fullsized":"2024-05-14T10:12:13.860871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:15:23.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"33'17","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.529559+0000","last_change":"2024-05-14T09:40:45.727770+0000","last_active":"2024-05-14T10:12:13.529559+0000","last_peered":"2024-05-14T10:12:13.529559+0000","last_clean":"2024-05-14T10:12:13.529559+0000","last_became_active":"2024-05-14T09:40:45.725283+0000","last_became_peered":"2024-05-14T09:40:45.725283+0000","last_unstale":"2024-05-14T10:12:13.529559+0000","last_undegraded":"2024-05-14T10:12:13.529559+0000","last_fullsized":"2024-05-14T10:12:13.529559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'19","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.624093+0000","last_change":"2024-05-14T09:40:45.749288+0000","last_active":"2024-05-14T10:12:13.624093+0000","last_peered":"2024-05-14T10:12:13.624093+0000","last_clean":"2024-05-14T10:12:13.624093+0000","last_became_active":"2024-05-14T09:40:45.748925+0000","last_became_peered":"2024-05-14T09:40:45.748925+0000","last_unstale":"2024-05-14T10:12:13.624093+0000","last_undegraded":"2024-05-14T10:12:13.624093+0000","last_fullsized":"2024-05-14T10:12:13.624093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:03.576418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'25","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:16.723492+0000","last_change":"2024-05-14T09:40:45.724197+0000","last_active":"2024-05-14T10:12:16.723492+0000","last_peered":"2024-05-14T10:12:16.723492+0000","last_clean":"2024-05-14T10:12:16.723492+0000","last_became_active":"2024-05-14T09:40:45.723317+0000","last_became_peered":"2024-05-14T09:40:45.723317+0000","last_unstale":"2024-05-14T10:12:16.723492+0000","last_undegraded":"2024-05-14T10:12:16.723492+0000","last_fullsized":"2024-05-14T10:12:16.723492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'24","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.621654+0000","last_change":"2024-05-14T09:40:45.770723+0000","last_active":"2024-05-14T10:12:13.621654+0000","last_peered":"2024-05-14T10:12:13.621654+0000","last_clean":"2024-05-14T10:12:13.621654+0000","last_became_active":"2024-05-14T09:40:45.769772+0000","last_became_peered":"2024-05-14T09:40:45.769772+0000","last_unstale":"2024-05-14T10:12:13.621654+0000","last_undegraded":"2024-05-14T10:12:13.621654+0000","last_fullsized":"2024-05-14T10:12:13.621654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:44.852533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"33'33","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:26.742617+0000","last_change":"2024-05-14T10:12:26.742764+0000","last_active":"2024-05-14T10:12:26.742617+0000","last_peered":"2024-05-14T10:12:26.742617+0000","last_clean":"2024-05-14T10:12:26.742617+0000","last_became_active":"2024-05-14T09:40:45.765830+0000","last_became_peered":"2024-05-14T09:40:45.765830+0000","last_unstale":"2024-05-14T10:12:26.742617+0000","last_undegraded":"2024-05-14T10:12:26.742617+0000","last_fullsized":"2024-05-14T10:12:26.742617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'33","last_scrub_stamp":"2024-05-14T10:12:26.742354+0000","last_deep_scrub":"33'33","last_deep_scrub_stamp":"2024-05-14T10:12:26.742354+0000","last_clean_scrub_stamp":"2024-05-14T10:12:26.742354+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:19:11.797077+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'27","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.854039+0000","last_change":"2024-05-14T09:40:45.760838+0000","last_active":"2024-05-14T10:12:13.854039+0000","last_peered":"2024-05-14T10:12:13.854039+0000","last_clean":"2024-05-14T10:12:13.854039+0000","last_became_active":"2024-05-14T09:40:45.760535+0000","last_became_peered":"2024-05-14T09:40:45.760535+0000","last_unstale":"2024-05-14T10:12:13.854039+0000","last_undegraded":"2024-05-14T10:12:13.854039+0000","last_fullsized":"2024-05-14T10:12:13.854039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:14:41.786880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"33'23","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.648019+0000","last_change":"2024-05-14T09:40:45.778218+0000","last_active":"2024-05-14T10:12:13.648019+0000","last_peered":"2024-05-14T10:12:13.648019+0000","last_clean":"2024-05-14T10:12:13.648019+0000","last_became_active":"2024-05-14T09:40:45.775602+0000","last_became_peered":"2024-05-14T09:40:45.775602+0000","last_unstale":"2024-05-14T10:12:13.648019+0000","last_undegraded":"2024-05-14T10:12:13.648019+0000","last_fullsized":"2024-05-14T10:12:13.648019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:08:40.574917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'33","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.632008+0000","last_change":"2024-05-14T09:40:45.748996+0000","last_active":"2024-05-14T10:12:13.632008+0000","last_peered":"2024-05-14T10:12:13.632008+0000","last_clean":"2024-05-14T10:12:13.632008+0000","last_became_active":"2024-05-14T09:40:45.748266+0000","last_became_peered":"2024-05-14T09:40:45.748266+0000","last_unstale":"2024-05-14T10:12:13.632008+0000","last_undegraded":"2024-05-14T10:12:13.632008+0000","last_fullsized":"2024-05-14T10:12:13.632008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'22","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.622070+0000","last_change":"2024-05-14T09:41:04.613266+0000","last_active":"2024-05-14T10:12:13.622070+0000","last_peered":"2024-05-14T10:12:13.622070+0000","last_clean":"2024-05-14T10:12:13.622070+0000","last_became_active":"2024-05-14T09:41:04.612160+0000","last_became_peered":"2024-05-14T09:41:04.612160+0000","last_unstale":"2024-05-14T10:12:13.622070+0000","last_undegraded":"2024-05-14T10:12:13.622070+0000","last_fullsized":"2024-05-14T10:12:13.622070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'28","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.623303+0000","last_change":"2024-05-14T09:40:45.757279+0000","last_active":"2024-05-14T10:12:13.623303+0000","last_peered":"2024-05-14T10:12:13.623303+0000","last_clean":"2024-05-14T10:12:13.623303+0000","last_became_active":"2024-05-14T09:40:45.749692+0000","last_became_peered":"2024-05-14T09:40:45.749692+0000","last_unstale":"2024-05-14T10:12:13.623303+0000","last_undegraded":"2024-05-14T10:12:13.623303+0000","last_fullsized":"2024-05-14T10:12:13.623303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:39:52.486187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'27","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.487344+0000","last_change":"2024-05-14T09:40:45.744802+0000","last_active":"2024-05-14T10:12:13.487344+0000","last_peered":"2024-05-14T10:12:13.487344+0000","last_clean":"2024-05-14T10:12:13.487344+0000","last_became_active":"2024-05-14T09:40:45.744011+0000","last_became_peered":"2024-05-14T09:40:45.744011+0000","last_unstale":"2024-05-14T10:12:13.487344+0000","last_undegraded":"2024-05-14T10:12:13.487344+0000","last_fullsized":"2024-05-14T10:12:13.487344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'24","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.486987+0000","last_change":"2024-05-14T09:40:45.757983+0000","last_active":"2024-05-14T10:12:13.486987+0000","last_peered":"2024-05-14T10:12:13.486987+0000","last_clean":"2024-05-14T10:12:13.486987+0000","last_became_active":"2024-05-14T09:40:45.757450+0000","last_became_peered":"2024-05-14T09:40:45.757450+0000","last_unstale":"2024-05-14T10:12:13.486987+0000","last_undegraded":"2024-05-14T10:12:13.486987+0000","last_fullsized":"2024-05-14T10:12:13.486987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'33","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.572384+0000","last_change":"2024-05-14T09:40:45.745021+0000","last_active":"2024-05-14T10:12:13.572384+0000","last_peered":"2024-05-14T10:12:13.572384+0000","last_clean":"2024-05-14T10:12:13.572384+0000","last_became_active":"2024-05-14T09:40:45.744550+0000","last_became_peered":"2024-05-14T09:40:45.744550+0000","last_unstale":"2024-05-14T10:12:13.572384+0000","last_undegraded":"2024-05-14T10:12:13.572384+0000","last_fullsized":"2024-05-14T10:12:13.572384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'17","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.644582+0000","last_change":"2024-05-14T09:40:45.749109+0000","last_active":"2024-05-14T10:12:13.644582+0000","last_peered":"2024-05-14T10:12:13.644582+0000","last_clean":"2024-05-14T10:12:13.644582+0000","last_became_active":"2024-05-14T09:40:45.748419+0000","last_became_peered":"2024-05-14T09:40:45.748419+0000","last_unstale":"2024-05-14T10:12:13.644582+0000","last_undegraded":"2024-05-14T10:12:13.644582+0000","last_fullsized":"2024-05-14T10:12:13.644582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:37.719133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'23","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.846466+0000","last_change":"2024-05-14T09:40:45.753508+0000","last_active":"2024-05-14T10:12:13.846466+0000","last_peered":"2024-05-14T10:12:13.846466+0000","last_clean":"2024-05-14T10:12:13.846466+0000","last_became_active":"2024-05-14T09:40:45.752982+0000","last_became_peered":"2024-05-14T09:40:45.752982+0000","last_unstale":"2024-05-14T10:12:13.846466+0000","last_undegraded":"2024-05-14T10:12:13.846466+0000","last_fullsized":"2024-05-14T10:12:13.846466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:44:15.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"33'32","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.861693+0000","last_change":"2024-05-14T09:40:45.759266+0000","last_active":"2024-05-14T10:12:13.861693+0000","last_peered":"2024-05-14T10:12:13.861693+0000","last_clean":"2024-05-14T10:12:13.861693+0000","last_became_active":"2024-05-14T09:40:45.758912+0000","last_became_peered":"2024-05-14T09:40:45.758912+0000","last_unstale":"2024-05-14T10:12:13.861693+0000","last_undegraded":"2024-05-14T10:12:13.861693+0000","last_fullsized":"2024-05-14T10:12:13.861693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:35:31.297169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'28","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.655653+0000","last_change":"2024-05-14T09:40:45.780527+0000","last_active":"2024-05-14T10:12:13.655653+0000","last_peered":"2024-05-14T10:12:13.655653+0000","last_clean":"2024-05-14T10:12:13.655653+0000","last_became_active":"2024-05-14T09:40:45.780197+0000","last_became_peered":"2024-05-14T09:40:45.780197+0000","last_unstale":"2024-05-14T10:12:13.655653+0000","last_undegraded":"2024-05-14T10:12:13.655653+0000","last_fullsized":"2024-05-14T10:12:13.655653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:04:38.220230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'19","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.572527+0000","last_change":"2024-05-14T09:40:45.761049+0000","last_active":"2024-05-14T10:12:13.572527+0000","last_peered":"2024-05-14T10:12:13.572527+0000","last_clean":"2024-05-14T10:12:13.572527+0000","last_became_active":"2024-05-14T09:40:45.760738+0000","last_became_peered":"2024-05-14T09:40:45.760738+0000","last_unstale":"2024-05-14T10:12:13.572527+0000","last_undegraded":"2024-05-14T10:12:13.572527+0000","last_fullsized":"2024-05-14T10:12:13.572527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'17","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.645430+0000","last_change":"2024-05-14T09:40:45.776380+0000","last_active":"2024-05-14T10:12:13.645430+0000","last_peered":"2024-05-14T10:12:13.645430+0000","last_clean":"2024-05-14T10:12:13.645430+0000","last_became_active":"2024-05-14T09:40:45.776005+0000","last_became_peered":"2024-05-14T09:40:45.776005+0000","last_unstale":"2024-05-14T10:12:13.645430+0000","last_undegraded":"2024-05-14T10:12:13.645430+0000","last_fullsized":"2024-05-14T10:12:13.645430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:25:27.969792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'24","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.630346+0000","last_change":"2024-05-14T09:41:04.214552+0000","last_active":"2024-05-14T10:12:13.630346+0000","last_peered":"2024-05-14T10:12:13.630346+0000","last_clean":"2024-05-14T10:12:13.630346+0000","last_became_active":"2024-05-14T09:41:04.213721+0000","last_became_peered":"2024-05-14T09:41:04.213721+0000","last_unstale":"2024-05-14T10:12:13.630346+0000","last_undegraded":"2024-05-14T10:12:13.630346+0000","last_fullsized":"2024-05-14T10:12:13.630346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"33'23","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.650378+0000","last_change":"2024-05-14T09:40:45.776955+0000","last_active":"2024-05-14T10:12:13.650378+0000","last_peered":"2024-05-14T10:12:13.650378+0000","last_clean":"2024-05-14T10:12:13.650378+0000","last_became_active":"2024-05-14T09:40:45.775953+0000","last_became_peered":"2024-05-14T09:40:45.775953+0000","last_unstale":"2024-05-14T10:12:13.650378+0000","last_undegraded":"2024-05-14T10:12:13.650378+0000","last_fullsized":"2024-05-14T10:12:13.650378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:30:13.534273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.626341+0000","last_change":"2024-05-14T09:40:45.750766+0000","last_active":"2024-05-14T10:12:13.626341+0000","last_peered":"2024-05-14T10:12:13.626341+0000","last_clean":"2024-05-14T10:12:13.626341+0000","last_became_active":"2024-05-14T09:40:45.750416+0000","last_became_peered":"2024-05-14T09:40:45.750416+0000","last_unstale":"2024-05-14T10:12:13.626341+0000","last_undegraded":"2024-05-14T10:12:13.626341+0000","last_fullsized":"2024-05-14T10:12:13.626341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:29:30.022171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"33'25","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:29.616042+0000","last_change":"2024-05-14T10:12:29.616116+0000","last_active":"2024-05-14T10:12:29.616042+0000","last_peered":"2024-05-14T10:12:29.616042+0000","last_clean":"2024-05-14T10:12:29.616042+0000","last_became_active":"2024-05-14T09:40:45.746640+0000","last_became_peered":"2024-05-14T09:40:45.746640+0000","last_unstale":"2024-05-14T10:12:29.616042+0000","last_undegraded":"2024-05-14T10:12:29.616042+0000","last_fullsized":"2024-05-14T10:12:29.616042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2024-05-14T10:12:29.615849+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2024-05-14T10:12:29.615849+0000","last_clean_scrub_stamp":"2024-05-14T10:12:29.615849+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:11:56.829249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"33'19","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.499642+0000","last_change":"2024-05-14T09:40:45.752947+0000","last_active":"2024-05-14T10:12:13.499642+0000","last_peered":"2024-05-14T10:12:13.499642+0000","last_clean":"2024-05-14T10:12:13.499642+0000","last_became_active":"2024-05-14T09:40:45.752589+0000","last_became_peered":"2024-05-14T09:40:45.752589+0000","last_unstale":"2024-05-14T10:12:13.499642+0000","last_undegraded":"2024-05-14T10:12:13.499642+0000","last_fullsized":"2024-05-14T10:12:13.499642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:13.652852+0000","last_change":"2024-05-14T09:40:45.771577+0000","last_active":"2024-05-14T10:12:13.652852+0000","last_peered":"2024-05-14T10:12:13.652852+0000","last_clean":"2024-05-14T10:12:13.652852+0000","last_became_active":"2024-05-14T09:40:45.771228+0000","last_became_peered":"2024-05-14T09:40:45.771228+0000","last_unstale":"2024-05-14T10:12:13.652852+0000","last_undegraded":"2024-05-14T10:12:13.652852+0000","last_fullsized":"2024-05-14T10:12:13.652852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T09:40:43.913689+0000","last_clean_scrub_stamp":"2024-05-14T09:40:43.913689+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:21:36.361964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2167,"num_write_kb":250271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2329,"ondisk_log_size":2329,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1480,"ondisk_log_size":1480,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21977357,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":432,"num_read_kb":466,"num_write":6515,"num_write_kb":24638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44105728,"data_stored":43954714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4979,"ondisk_log_size":4979,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719477127,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39728,"kb_used_data":8552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332112,"statfs":{"total":96636764160,"available":96596082688,"internally_reserved":0,"allocated":8757248,"data_stored":8538561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719477129,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52208,"kb_used_data":8552,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94319632,"statfs":{"total":96636764160,"available":96583303168,"internally_reserved":0,"allocated":8757248,"data_stored":8537925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":16,"seq":68719477130,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40712,"kb_used_data":9536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331128,"statfs":{"total":96636764160,"available":96595075072,"internally_reserved":0,"allocated":9764864,"data_stored":9540150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719477126,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":267048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477126,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45396,"kb_used_data":5900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326444,"statfs":{"total":96636764160,"available":96590278656,"internally_reserved":0,"allocated":6041600,"data_stored":5817281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509832,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40248,"kb_used_data":13232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331592,"statfs":{"total":96636764160,"available":96595550208,"internally_reserved":0,"allocated":13549568,"data_stored":13323781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542533,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39860,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331980,"statfs":{"total":96636764160,"available":96595947520,"internally_reserved":0,"allocated":372736,"data_stored":149981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542535,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":149547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5095424,"data_stored":5078310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":118445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9412608,"data_stored":9391547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12603392,"data_stored":12584810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T10:12:37.128 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.128 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.128 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.128 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.128 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.129 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.129 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.129 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.129 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.129 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.129 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.129 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.129 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.129 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.130 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.130 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.130 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.130 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.130 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.130 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.130 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.130 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.130 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.130 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.131 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.131 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.131 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.131 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.131 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.131 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.131 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.131 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.131 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.131 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.132 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.132 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.132 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.132 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.132 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.132 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.132 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-14T09:40:17.767400+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=17, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.132 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.132 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.132 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.133 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.133 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.133 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.133 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.133 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.133 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.133 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.133 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.133 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.133 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.134 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.134 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.134 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.134 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.134 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.134 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.134 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.134 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.134 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.135 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.135 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.135 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.135 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.135 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.135 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.135 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.135 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.135 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.135 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.135 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.136 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.136 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.136 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.136 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.136 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.136 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.136 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.136 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.136 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.136 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.137 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-14T09:40:41.619569+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=41, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.137 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.137 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-14T09:40:52.073045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.137 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.137 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.137 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.137 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.137 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.137 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.137 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.137 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.138 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.138 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.138 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.138 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.138 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.138 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.138 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.138 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.138 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.138 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.139 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.139 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.139 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.139 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.139 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.139 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.139 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.139 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.139 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.139 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.140 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.140 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-14T09:40:43.913689+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=9, tm_min=40, tm_sec=43, tm_wday=1, tm_yday=135, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=14, tm_hour=10, tm_min=12, tm_sec=23, tm_wday=1, tm_yday=135, tm_isdst=0) 2024-05-14T10:12:37.140 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-14T10:12:57.141 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T10:12:57.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.424+0000 7f008a400640 1 Processor -- start 2024-05-14T10:12:57.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.424+0000 7f008a400640 1 -- start start 2024-05-14T10:12:57.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.427+0000 7f008a400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00840c7e80 0x7f0084074810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:57.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.427+0000 7f008a400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f008415c860 0x7f008415cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:57.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.427+0000 7f008a400640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00840c8650 con 0x7f0084156930 2024-05-14T10:12:57.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.427+0000 7f008a400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f0084160a10 con 0x7f008415c860 2024-05-14T10:12:57.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.427+0000 7f008a400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f0084074d50 con 0x7f00840c7e80 2024-05-14T10:12:57.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.449+0000 7f0083400640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f0084156930 0x7f00840c6e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:43334/0 (socket says 172.21.15.135:43334) 2024-05-14T10:12:57.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.449+0000 7f0083400640 1 -- 172.21.15.135:0/1876583247 learned_addr learned my addr 172.21.15.135:0/1876583247 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:57.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.454+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606472078 0 0) 0x7f00840c8650 con 0x7f0084156930 2024-05-14T10:12:57.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.454+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0068003520 con 0x7f0084156930 2024-05-14T10:12:57.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.460+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1801940769 0 0) 0x7f0068003520 con 0x7f0084156930 2024-05-14T10:12:57.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.460+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00840c7e80 msgr2=0x7f0084074810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.460+0000 7f0082a00640 1 --2- 172.21.15.135:0/1876583247 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00840c7e80 0x7f0084074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.460+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 >> v2:172.21.15.196:3300/0 conn(0x7f008415c860 msgr2=0x7f008415cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.460+0000 7f0082a00640 1 --2- 172.21.15.135:0/1876583247 >> v2:172.21.15.196:3300/0 conn(0x7f008415c860 0x7f008415cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.460+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00840c8930 con 0x7f0084156930 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.461+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f006c0016f0 con 0x7f0084156930 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.461+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 >> v1:172.21.15.135:6789/0 conn(0x7f0084156930 legacy=0x7f00840c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.461+0000 7f0082a00640 1 --2- 172.21.15.135:0/1876583247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 0x7f0068003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.461+0000 7f0082a00640 1 --2- 172.21.15.135:0/1876583247 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0068004800 0x7f0068004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.461+0000 7f0082a00640 1 --2- 172.21.15.135:0/1876583247 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00840c7e80 0x7f006800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.461+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0084160a10 con 0x7f0068003a50 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.461+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0084074d50 con 0x7f0068004800 2024-05-14T10:12:57.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.461+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f006800bf00 con 0x7f00840c7e80 2024-05-14T10:12:57.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.465+0000 7f0083400640 1 --2- 172.21.15.135:0/1876583247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 0x7f0068003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:57.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.471+0000 7f0083400640 1 -- 172.21.15.135:0/1876583247 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00840c7e80 msgr2=0x7f006800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:57.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.471+0000 7f0083400640 1 --2- 172.21.15.135:0/1876583247 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00840c7e80 0x7f006800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:57.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.471+0000 7f0083400640 1 -- 172.21.15.135:0/1876583247 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0068004800 msgr2=0x7f0068004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:57.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.471+0000 7f0083400640 1 --2- 172.21.15.135:0/1876583247 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0068004800 0x7f0068004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:57.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.471+0000 7f0083400640 1 -- 172.21.15.135:0/1876583247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0068003520 con 0x7f0068003a50 2024-05-14T10:12:57.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.475+0000 7f0083400640 1 --2- 172.21.15.135:0/1876583247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 0x7f0068003ec0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c190 tx=0x7f0068005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189350c07ce83401 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:57.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.483+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c007cc0 con 0x7f0068003a50 2024-05-14T10:12:57.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.483+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006c005af0 con 0x7f0068003a50 2024-05-14T10:12:57.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.483+0000 7f0082a00640 1 -- 172.21.15.135:0/1876583247 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c007070 con 0x7f0068003a50 2024-05-14T10:12:57.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.484+0000 7f008a400640 1 -- 172.21.15.135:0/1876583247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 msgr2=0x7f0068003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:57.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.484+0000 7f008a400640 1 --2- 172.21.15.135:0/1876583247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 0x7f0068003ec0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c190 tx=0x7f0068005830 comp rx=0 tx=0).stop 2024-05-14T10:12:57.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.484+0000 7f0083e00640 1 -- 172.21.15.135:0/1876583247 reap_dead start 2024-05-14T10:12:57.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.484+0000 7f008a400640 1 -- 172.21.15.135:0/1876583247 shutdown_connections 2024-05-14T10:12:57.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.484+0000 7f008a400640 1 -- 172.21.15.135:0/1876583247 >> 172.21.15.135:0/1876583247 conn(0x7f0084073cf0 msgr2=0x7f0084074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:57.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.485+0000 7f008a400640 1 -- 172.21.15.135:0/1876583247 shutdown_connections 2024-05-14T10:12:57.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.485+0000 7f008a400640 1 -- 172.21.15.135:0/1876583247 wait complete. 2024-05-14T10:12:57.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.489+0000 7f008a400640 1 Processor -- start 2024-05-14T10:12:57.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.489+0000 7f008a400640 1 -- start start 2024-05-14T10:12:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.491+0000 7f008a400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 0x7f0084158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.491+0000 7f008a400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00841520b0 0x7f008415ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.492+0000 7f008a400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f008415b0b0 0x7f008415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.492+0000 7f008a400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f008415d1b0 con 0x7f0068003a50 2024-05-14T10:12:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.492+0000 7f008a400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0084160730 con 0x7f008415b0b0 2024-05-14T10:12:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.492+0000 7f008a400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f00840c9b50 con 0x7f00841520b0 2024-05-14T10:12:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.493+0000 7f0083400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 0x7f0084158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:57.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.493+0000 7f0083400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 0x7f0084158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50962/0 (socket says 172.21.15.135:50962) 2024-05-14T10:12:57.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.493+0000 7f0083400640 1 -- 172.21.15.135:0/2999523801 learned_addr learned my addr 172.21.15.135:0/2999523801 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:57.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.498+0000 7f0083400640 1 -- 172.21.15.135:0/2999523801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00841520b0 msgr2=0x7f008415ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:57.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.498+0000 7f0083400640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00841520b0 0x7f008415ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:57.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.498+0000 7f0083400640 1 -- 172.21.15.135:0/2999523801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f008415b0b0 msgr2=0x7f008415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:57.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.498+0000 7f0083400640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f008415b0b0 0x7f008415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:57.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.498+0000 7f0083400640 1 -- 172.21.15.135:0/2999523801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008415a810 con 0x7f0068003a50 2024-05-14T10:12:57.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.501+0000 7f0083400640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 0x7f0084158cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c1f0 tx=0x7f00840c8820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:57.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.508+0000 7f007be00640 1 -- 172.21.15.135:0/2999523801 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c005e60 con 0x7f0068003a50 2024-05-14T10:12:57.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.508+0000 7f007be00640 1 -- 172.21.15.135:0/2999523801 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006c042070 con 0x7f0068003a50 2024-05-14T10:12:57.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.508+0000 7f007be00640 1 -- 172.21.15.135:0/2999523801 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c007490 con 0x7f0068003a50 2024-05-14T10:12:57.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.508+0000 7f008a400640 1 -- 172.21.15.135:0/2999523801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00841526a0 con 0x7f0068003a50 2024-05-14T10:12:57.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.508+0000 7f008a400640 1 -- 172.21.15.135:0/2999523801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0084152940 con 0x7f0068003a50 2024-05-14T10:12:57.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.510+0000 7f008a400640 1 -- 172.21.15.135:0/2999523801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0084069a90 con 0x7f0068003a50 2024-05-14T10:12:57.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.562+0000 7f007be00640 1 -- 172.21.15.135:0/2999523801 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f006c051430 con 0x7f0068003a50 2024-05-14T10:12:57.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.564+0000 7f007be00640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0060076350 0x7f0060078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:57.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.564+0000 7f007aa00640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0060076350 0x7f0060078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:57.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.566+0000 7f007aa00640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0060076350 0x7f0060078860 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00840cd290 tx=0x7f0074006d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:57.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.570+0000 7f007be00640 1 -- 172.21.15.135:0/2999523801 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f006c005aa0 con 0x7f0068003a50 2024-05-14T10:12:57.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:57.932+0000 7f007be00640 1 -- 172.21.15.135:0/2999523801 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f006c081f20 con 0x7f0068003a50 2024-05-14T10:12:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.142+0000 7f008a400640 1 -- 172.21.15.135:0/2999523801 --> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00841595c0 con 0x7f0060076350 2024-05-14T10:12:58.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.168+0000 7f007be00640 1 -- 172.21.15.135:0/2999523801 <== mgr.4100 v2:172.21.15.135:6800/88161500 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333952 (secure 0 0 0) 0x7f00841595c0 con 0x7f0060076350 2024-05-14T10:12:58.169 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T10:12:58.174 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-14T10:12:58.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.177+0000 7f008a400640 1 -- 172.21.15.135:0/2999523801 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0060076350 msgr2=0x7f0060078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:58.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.177+0000 7f008a400640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0060076350 0x7f0060078860 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00840cd290 tx=0x7f0074006d10 comp rx=0 tx=0).stop 2024-05-14T10:12:58.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.177+0000 7f008a400640 1 -- 172.21.15.135:0/2999523801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 msgr2=0x7f0084158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:58.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.177+0000 7f008a400640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 0x7f0084158cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c1f0 tx=0x7f00840c8820 comp rx=0 tx=0).stop 2024-05-14T10:12:58.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.177+0000 7f008a400640 1 -- 172.21.15.135:0/2999523801 shutdown_connections 2024-05-14T10:12:58.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.177+0000 7f008a400640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f0060076350 0x7f0060078860 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:58.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.177+0000 7f008a400640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f008415b0b0 0x7f008415b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:58.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.177+0000 7f008a400640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00841520b0 0x7f008415ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:58.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.177+0000 7f008a400640 1 --2- 172.21.15.135:0/2999523801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068003a50 0x7f0084158cc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:58.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.177+0000 7f008a400640 1 -- 172.21.15.135:0/2999523801 >> 172.21.15.135:0/2999523801 conn(0x7f0084073cf0 msgr2=0x7f008406d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:58.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.178+0000 7f008a400640 1 -- 172.21.15.135:0/2999523801 shutdown_connections 2024-05-14T10:12:58.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.178+0000 7f008a400640 1 -- 172.21.15.135:0/2999523801 wait complete. 2024-05-14T10:12:58.207 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":1010,"stamp":"2024-05-14T10:12:57.397058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22567725,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":498,"num_read_kb":521,"num_write":8783,"num_write_kb":276537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8898,"ondisk_log_size":8898,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":313032,"kb_used_data":46984,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754661688,"statfs":{"total":773094113280,"available":772773568512,"internally_reserved":0,"allocated":48111616,"data_stored":46324274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":272354866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006313"},"pg_stats":[{"pgid":"2.1f","version":"33'579","reported_seq":638,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:27.738449+0000","last_change":"2024-05-14T10:12:27.738541+0000","last_active":"2024-05-14T10:12:27.738449+0000","last_peered":"2024-05-14T10:12:27.738449+0000","last_clean":"2024-05-14T10:12:27.738449+0000","last_became_active":"2024-05-14T09:40:43.105731+0000","last_became_peered":"2024-05-14T09:40:43.105731+0000","last_unstale":"2024-05-14T10:12:27.738449+0000","last_undegraded":"2024-05-14T10:12:27.738449+0000","last_fullsized":"2024-05-14T10:12:27.738449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'579","last_scrub_stamp":"2024-05-14T10:12:27.738245+0000","last_deep_scrub":"33'579","last_deep_scrub_stamp":"2024-05-14T10:12:27.738245+0000","last_clean_scrub_stamp":"2024-05-14T10:12:27.738245+0000","objects_scrubbed":5,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:33:48.610209+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573,"num_write_kb":4404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'15","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:32.903784+0000","last_change":"2024-05-14T10:12:32.903784+0000","last_active":"2024-05-14T10:12:32.903784+0000","last_peered":"2024-05-14T10:12:32.903784+0000","last_clean":"2024-05-14T10:12:32.903784+0000","last_became_active":"2024-05-14T09:40:45.747865+0000","last_became_peered":"2024-05-14T09:40:45.747865+0000","last_unstale":"2024-05-14T10:12:32.903784+0000","last_undegraded":"2024-05-14T10:12:32.903784+0000","last_fullsized":"2024-05-14T10:12:32.903784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-05-14T10:12:32.903661+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-05-14T10:12:32.903661+0000","last_clean_scrub_stamp":"2024-05-14T10:12:32.903661+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:05:43.681979+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'61","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:47.007203+0000","last_change":"2024-05-14T10:12:47.007274+0000","last_active":"2024-05-14T10:12:47.007203+0000","last_peered":"2024-05-14T10:12:47.007203+0000","last_clean":"2024-05-14T10:12:47.007203+0000","last_became_active":"2024-05-14T09:40:53.664366+0000","last_became_peered":"2024-05-14T09:40:53.664366+0000","last_unstale":"2024-05-14T10:12:47.007203+0000","last_undegraded":"2024-05-14T10:12:47.007203+0000","last_fullsized":"2024-05-14T10:12:47.007203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-05-14T10:12:47.006971+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-05-14T10:12:47.006971+0000","last_clean_scrub_stamp":"2024-05-14T10:12:47.006971+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:33:41.654536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'88","reported_seq":148,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:35.883757+0000","last_change":"2024-05-14T10:12:35.883757+0000","last_active":"2024-05-14T10:12:35.883757+0000","last_peered":"2024-05-14T10:12:35.883757+0000","last_clean":"2024-05-14T10:12:35.883757+0000","last_became_active":"2024-05-14T09:40:43.098862+0000","last_became_peered":"2024-05-14T09:40:43.098862+0000","last_unstale":"2024-05-14T10:12:35.883757+0000","last_undegraded":"2024-05-14T10:12:35.883757+0000","last_fullsized":"2024-05-14T10:12:35.883757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'88","last_scrub_stamp":"2024-05-14T10:12:35.883502+0000","last_deep_scrub":"33'88","last_deep_scrub_stamp":"2024-05-14T10:12:35.883502+0000","last_clean_scrub_stamp":"2024-05-14T10:12:35.883502+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:38:21.578386+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883346,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"33'22","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:30.659457+0000","last_change":"2024-05-14T10:12:30.659524+0000","last_active":"2024-05-14T10:12:30.659457+0000","last_peered":"2024-05-14T10:12:30.659457+0000","last_clean":"2024-05-14T10:12:30.659457+0000","last_became_active":"2024-05-14T09:40:45.752627+0000","last_became_peered":"2024-05-14T09:40:45.752627+0000","last_unstale":"2024-05-14T10:12:30.659457+0000","last_undegraded":"2024-05-14T10:12:30.659457+0000","last_fullsized":"2024-05-14T10:12:30.659457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-05-14T10:12:30.659261+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-05-14T10:12:30.659261+0000","last_clean_scrub_stamp":"2024-05-14T10:12:30.659261+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:29:27.339387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'57","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:39.972347+0000","last_change":"2024-05-14T10:12:39.972488+0000","last_active":"2024-05-14T10:12:39.972347+0000","last_peered":"2024-05-14T10:12:39.972347+0000","last_clean":"2024-05-14T10:12:39.972347+0000","last_became_active":"2024-05-14T09:40:53.661453+0000","last_became_peered":"2024-05-14T09:40:53.661453+0000","last_unstale":"2024-05-14T10:12:39.972347+0000","last_undegraded":"2024-05-14T10:12:39.972347+0000","last_fullsized":"2024-05-14T10:12:39.972347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'57","last_scrub_stamp":"2024-05-14T10:12:39.972100+0000","last_deep_scrub":"33'57","last_deep_scrub_stamp":"2024-05-14T10:12:39.972100+0000","last_clean_scrub_stamp":"2024-05-14T10:12:39.972100+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:29:36.652226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":4019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'12","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:42.253372+0000","last_change":"2024-05-14T10:12:42.253460+0000","last_active":"2024-05-14T10:12:42.253372+0000","last_peered":"2024-05-14T10:12:42.253372+0000","last_clean":"2024-05-14T10:12:42.253372+0000","last_became_active":"2024-05-14T09:40:43.114379+0000","last_became_peered":"2024-05-14T09:40:43.114379+0000","last_unstale":"2024-05-14T10:12:42.253372+0000","last_undegraded":"2024-05-14T10:12:42.253372+0000","last_fullsized":"2024-05-14T10:12:42.253372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-05-14T10:12:42.253183+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-05-14T10:12:42.253183+0000","last_clean_scrub_stamp":"2024-05-14T10:12:42.253183+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:49:03.543288+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'21","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:45.133301+0000","last_change":"2024-05-14T10:12:45.133424+0000","last_active":"2024-05-14T10:12:45.133301+0000","last_peered":"2024-05-14T10:12:45.133301+0000","last_clean":"2024-05-14T10:12:45.133301+0000","last_became_active":"2024-05-14T09:40:45.754110+0000","last_became_peered":"2024-05-14T09:40:45.754110+0000","last_unstale":"2024-05-14T10:12:45.133301+0000","last_undegraded":"2024-05-14T10:12:45.133301+0000","last_fullsized":"2024-05-14T10:12:45.133301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-05-14T10:12:45.132989+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-05-14T10:12:45.132989+0000","last_clean_scrub_stamp":"2024-05-14T10:12:45.132989+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:49:36.307434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'83","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:45.932445+0000","last_change":"2024-05-14T10:12:45.932517+0000","last_active":"2024-05-14T10:12:45.932445+0000","last_peered":"2024-05-14T10:12:45.932445+0000","last_clean":"2024-05-14T10:12:45.932445+0000","last_became_active":"2024-05-14T09:41:04.599475+0000","last_became_peered":"2024-05-14T09:41:04.599475+0000","last_unstale":"2024-05-14T10:12:45.932445+0000","last_undegraded":"2024-05-14T10:12:45.932445+0000","last_fullsized":"2024-05-14T10:12:45.932445+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'83","last_scrub_stamp":"2024-05-14T10:12:45.932241+0000","last_deep_scrub":"33'83","last_deep_scrub_stamp":"2024-05-14T10:12:45.932241+0000","last_clean_scrub_stamp":"2024-05-14T10:12:45.932241+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:28:47.705148+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":7631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"33'4","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:38.306899+0000","last_change":"2024-05-14T10:12:38.306983+0000","last_active":"2024-05-14T10:12:38.306899+0000","last_peered":"2024-05-14T10:12:38.306899+0000","last_clean":"2024-05-14T10:12:38.306899+0000","last_became_active":"2024-05-14T09:40:43.109932+0000","last_became_peered":"2024-05-14T09:40:43.109932+0000","last_unstale":"2024-05-14T10:12:38.306899+0000","last_undegraded":"2024-05-14T10:12:38.306899+0000","last_fullsized":"2024-05-14T10:12:38.306899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-14T10:12:38.306660+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-14T10:12:38.306660+0000","last_clean_scrub_stamp":"2024-05-14T10:12:38.306660+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:29:34.986786+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'32","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:47.080368+0000","last_change":"2024-05-14T10:12:47.080434+0000","last_active":"2024-05-14T10:12:47.080368+0000","last_peered":"2024-05-14T10:12:47.080368+0000","last_clean":"2024-05-14T10:12:47.080368+0000","last_became_active":"2024-05-14T09:40:45.770117+0000","last_became_peered":"2024-05-14T09:40:45.770117+0000","last_unstale":"2024-05-14T10:12:47.080368+0000","last_undegraded":"2024-05-14T10:12:47.080368+0000","last_fullsized":"2024-05-14T10:12:47.080368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'32","last_scrub_stamp":"2024-05-14T10:12:47.080162+0000","last_deep_scrub":"33'32","last_deep_scrub_stamp":"2024-05-14T10:12:47.080162+0000","last_clean_scrub_stamp":"2024-05-14T10:12:47.080162+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:29:48.844310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'79","reported_seq":121,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:38.994314+0000","last_change":"2024-05-14T10:12:38.994457+0000","last_active":"2024-05-14T10:12:38.994314+0000","last_peered":"2024-05-14T10:12:38.994314+0000","last_clean":"2024-05-14T10:12:38.994314+0000","last_became_active":"2024-05-14T09:40:53.651570+0000","last_became_peered":"2024-05-14T09:40:53.651570+0000","last_unstale":"2024-05-14T10:12:38.994314+0000","last_undegraded":"2024-05-14T10:12:38.994314+0000","last_fullsized":"2024-05-14T10:12:38.994314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'79","last_scrub_stamp":"2024-05-14T10:12:38.994032+0000","last_deep_scrub":"33'79","last_deep_scrub_stamp":"2024-05-14T10:12:38.994032+0000","last_clean_scrub_stamp":"2024-05-14T10:12:38.994032+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:16:50.461134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":7498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'20","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:40.999606+0000","last_change":"2024-05-14T10:12:40.999672+0000","last_active":"2024-05-14T10:12:40.999606+0000","last_peered":"2024-05-14T10:12:40.999606+0000","last_clean":"2024-05-14T10:12:40.999606+0000","last_became_active":"2024-05-14T09:40:45.753319+0000","last_became_peered":"2024-05-14T09:40:45.753319+0000","last_unstale":"2024-05-14T10:12:40.999606+0000","last_undegraded":"2024-05-14T10:12:40.999606+0000","last_fullsized":"2024-05-14T10:12:40.999606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-05-14T10:12:40.999411+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-05-14T10:12:40.999411+0000","last_clean_scrub_stamp":"2024-05-14T10:12:40.999411+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:38:38.917826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'568","reported_seq":626,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:43.252895+0000","last_change":"2024-05-14T10:12:43.252974+0000","last_active":"2024-05-14T10:12:43.252895+0000","last_peered":"2024-05-14T10:12:43.252895+0000","last_clean":"2024-05-14T10:12:43.252895+0000","last_became_active":"2024-05-14T09:40:43.125239+0000","last_became_peered":"2024-05-14T09:40:43.125239+0000","last_unstale":"2024-05-14T10:12:43.252895+0000","last_undegraded":"2024-05-14T10:12:43.252895+0000","last_fullsized":"2024-05-14T10:12:43.252895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'568","last_scrub_stamp":"2024-05-14T10:12:43.252676+0000","last_deep_scrub":"33'568","last_deep_scrub_stamp":"2024-05-14T10:12:43.252676+0000","last_clean_scrub_stamp":"2024-05-14T10:12:43.252676+0000","objects_scrubbed":3,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:34:45.736769+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'67","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:40.950694+0000","last_change":"2024-05-14T10:12:40.950864+0000","last_active":"2024-05-14T10:12:40.950694+0000","last_peered":"2024-05-14T10:12:40.950694+0000","last_clean":"2024-05-14T10:12:40.950694+0000","last_became_active":"2024-05-14T09:40:53.662559+0000","last_became_peered":"2024-05-14T09:40:53.662559+0000","last_unstale":"2024-05-14T10:12:40.950694+0000","last_undegraded":"2024-05-14T10:12:40.950694+0000","last_fullsized":"2024-05-14T10:12:40.950694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'67","last_scrub_stamp":"2024-05-14T10:12:40.950330+0000","last_deep_scrub":"33'67","last_deep_scrub_stamp":"2024-05-14T10:12:40.950330+0000","last_clean_scrub_stamp":"2024-05-14T10:12:40.950330+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:07:08.981990+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":8465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'23","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:30.872602+0000","last_change":"2024-05-14T10:12:30.872654+0000","last_active":"2024-05-14T10:12:30.872602+0000","last_peered":"2024-05-14T10:12:30.872602+0000","last_clean":"2024-05-14T10:12:30.872602+0000","last_became_active":"2024-05-14T09:40:45.751015+0000","last_became_peered":"2024-05-14T09:40:45.751015+0000","last_unstale":"2024-05-14T10:12:30.872602+0000","last_undegraded":"2024-05-14T10:12:30.872602+0000","last_fullsized":"2024-05-14T10:12:30.872602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-05-14T10:12:30.872472+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-05-14T10:12:30.872472+0000","last_clean_scrub_stamp":"2024-05-14T10:12:30.872472+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:41:29.803841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"33'4","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:28.872394+0000","last_change":"2024-05-14T10:12:28.872446+0000","last_active":"2024-05-14T10:12:28.872394+0000","last_peered":"2024-05-14T10:12:28.872394+0000","last_clean":"2024-05-14T10:12:28.872394+0000","last_became_active":"2024-05-14T09:40:43.022234+0000","last_became_peered":"2024-05-14T09:40:43.022234+0000","last_unstale":"2024-05-14T10:12:28.872394+0000","last_undegraded":"2024-05-14T10:12:28.872394+0000","last_fullsized":"2024-05-14T10:12:28.872394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-14T10:12:28.872261+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-14T10:12:28.872261+0000","last_clean_scrub_stamp":"2024-05-14T10:12:28.872261+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:05.133996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'86","reported_seq":137,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:46.962016+0000","last_change":"2024-05-14T10:12:46.962090+0000","last_active":"2024-05-14T10:12:46.962016+0000","last_peered":"2024-05-14T10:12:46.962016+0000","last_clean":"2024-05-14T10:12:46.962016+0000","last_became_active":"2024-05-14T09:41:04.600186+0000","last_became_peered":"2024-05-14T09:41:04.600186+0000","last_unstale":"2024-05-14T10:12:46.962016+0000","last_undegraded":"2024-05-14T10:12:46.962016+0000","last_fullsized":"2024-05-14T10:12:46.962016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'86","last_scrub_stamp":"2024-05-14T10:12:46.961791+0000","last_deep_scrub":"33'86","last_deep_scrub_stamp":"2024-05-14T10:12:46.961791+0000","last_clean_scrub_stamp":"2024-05-14T10:12:46.961791+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:38:32.656675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'22","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:34.905143+0000","last_change":"2024-05-14T10:12:34.905251+0000","last_active":"2024-05-14T10:12:34.905143+0000","last_peered":"2024-05-14T10:12:34.905143+0000","last_clean":"2024-05-14T10:12:34.905143+0000","last_became_active":"2024-05-14T09:40:45.746607+0000","last_became_peered":"2024-05-14T09:40:45.746607+0000","last_unstale":"2024-05-14T10:12:34.905143+0000","last_undegraded":"2024-05-14T10:12:34.905143+0000","last_fullsized":"2024-05-14T10:12:34.905143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-05-14T10:12:34.904941+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-05-14T10:12:34.904941+0000","last_clean_scrub_stamp":"2024-05-14T10:12:34.904941+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:28:36.677848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'13","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:31.916222+0000","last_change":"2024-05-14T10:12:31.916282+0000","last_active":"2024-05-14T10:12:31.916222+0000","last_peered":"2024-05-14T10:12:31.916222+0000","last_clean":"2024-05-14T10:12:31.916222+0000","last_became_active":"2024-05-14T09:40:43.104277+0000","last_became_peered":"2024-05-14T09:40:43.104277+0000","last_unstale":"2024-05-14T10:12:31.916222+0000","last_undegraded":"2024-05-14T10:12:31.916222+0000","last_fullsized":"2024-05-14T10:12:31.916222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-05-14T10:12:31.916080+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-05-14T10:12:31.916080+0000","last_clean_scrub_stamp":"2024-05-14T10:12:31.916080+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:01:06.286093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'61","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:40.808036+0000","last_change":"2024-05-14T10:12:40.808116+0000","last_active":"2024-05-14T10:12:40.808036+0000","last_peered":"2024-05-14T10:12:40.808036+0000","last_clean":"2024-05-14T10:12:40.808036+0000","last_became_active":"2024-05-14T09:40:53.648765+0000","last_became_peered":"2024-05-14T09:40:53.648765+0000","last_unstale":"2024-05-14T10:12:40.808036+0000","last_undegraded":"2024-05-14T10:12:40.808036+0000","last_fullsized":"2024-05-14T10:12:40.808036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-05-14T10:12:40.807807+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-05-14T10:12:40.807807+0000","last_clean_scrub_stamp":"2024-05-14T10:12:40.807807+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:33:53.244079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":11669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"33'17","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:33.880991+0000","last_change":"2024-05-14T10:12:33.881059+0000","last_active":"2024-05-14T10:12:33.880991+0000","last_peered":"2024-05-14T10:12:33.880991+0000","last_clean":"2024-05-14T10:12:33.880991+0000","last_became_active":"2024-05-14T09:40:45.730014+0000","last_became_peered":"2024-05-14T09:40:45.730014+0000","last_unstale":"2024-05-14T10:12:33.880991+0000","last_undegraded":"2024-05-14T10:12:33.880991+0000","last_fullsized":"2024-05-14T10:12:33.880991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'17","last_scrub_stamp":"2024-05-14T10:12:33.880762+0000","last_deep_scrub":"33'17","last_deep_scrub_stamp":"2024-05-14T10:12:33.880762+0000","last_clean_scrub_stamp":"2024-05-14T10:12:33.880762+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:23:58.665357+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'7","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:40.256880+0000","last_change":"2024-05-14T10:12:40.256963+0000","last_active":"2024-05-14T10:12:40.256880+0000","last_peered":"2024-05-14T10:12:40.256880+0000","last_clean":"2024-05-14T10:12:40.256880+0000","last_became_active":"2024-05-14T09:40:43.111574+0000","last_became_peered":"2024-05-14T09:40:43.111574+0000","last_unstale":"2024-05-14T10:12:40.256880+0000","last_undegraded":"2024-05-14T10:12:40.256880+0000","last_fullsized":"2024-05-14T10:12:40.256880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-05-14T10:12:40.256653+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-05-14T10:12:40.256653+0000","last_clean_scrub_stamp":"2024-05-14T10:12:40.256653+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:09:17.666761+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'68","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:41.935219+0000","last_change":"2024-05-14T10:12:41.935353+0000","last_active":"2024-05-14T10:12:41.935219+0000","last_peered":"2024-05-14T10:12:41.935219+0000","last_clean":"2024-05-14T10:12:41.935219+0000","last_became_active":"2024-05-14T09:40:53.665635+0000","last_became_peered":"2024-05-14T09:40:53.665635+0000","last_unstale":"2024-05-14T10:12:41.935219+0000","last_undegraded":"2024-05-14T10:12:41.935219+0000","last_fullsized":"2024-05-14T10:12:41.935219+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'68","last_scrub_stamp":"2024-05-14T10:12:41.934916+0000","last_deep_scrub":"33'68","last_deep_scrub_stamp":"2024-05-14T10:12:41.934916+0000","last_clean_scrub_stamp":"2024-05-14T10:12:41.934916+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:12.198584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":6362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"33'26","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:34.637952+0000","last_change":"2024-05-14T10:12:34.638089+0000","last_active":"2024-05-14T10:12:34.637952+0000","last_peered":"2024-05-14T10:12:34.637952+0000","last_clean":"2024-05-14T10:12:34.637952+0000","last_became_active":"2024-05-14T09:40:45.757938+0000","last_became_peered":"2024-05-14T09:40:45.757938+0000","last_unstale":"2024-05-14T10:12:34.637952+0000","last_undegraded":"2024-05-14T10:12:34.637952+0000","last_fullsized":"2024-05-14T10:12:34.637952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-05-14T10:12:34.637695+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-05-14T10:12:34.637695+0000","last_clean_scrub_stamp":"2024-05-14T10:12:34.637695+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:48:55.927801+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'12","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:36.991177+0000","last_change":"2024-05-14T10:12:36.991256+0000","last_active":"2024-05-14T10:12:36.991177+0000","last_peered":"2024-05-14T10:12:36.991177+0000","last_clean":"2024-05-14T10:12:36.991177+0000","last_became_active":"2024-05-14T09:40:43.116142+0000","last_became_peered":"2024-05-14T09:40:43.116142+0000","last_unstale":"2024-05-14T10:12:36.991177+0000","last_undegraded":"2024-05-14T10:12:36.991177+0000","last_fullsized":"2024-05-14T10:12:36.991177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-05-14T10:12:36.990977+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-05-14T10:12:36.990977+0000","last_clean_scrub_stamp":"2024-05-14T10:12:36.990977+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:43:18.312426+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'50","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:42.947159+0000","last_change":"2024-05-14T10:12:42.947231+0000","last_active":"2024-05-14T10:12:42.947159+0000","last_peered":"2024-05-14T10:12:42.947159+0000","last_clean":"2024-05-14T10:12:42.947159+0000","last_became_active":"2024-05-14T09:40:53.666455+0000","last_became_peered":"2024-05-14T09:40:53.666455+0000","last_unstale":"2024-05-14T10:12:42.947159+0000","last_undegraded":"2024-05-14T10:12:42.947159+0000","last_fullsized":"2024-05-14T10:12:42.947159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'50","last_scrub_stamp":"2024-05-14T10:12:42.946940+0000","last_deep_scrub":"33'50","last_deep_scrub_stamp":"2024-05-14T10:12:42.946940+0000","last_clean_scrub_stamp":"2024-05-14T10:12:42.946940+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:49:04.237046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":7373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'19","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:43.973575+0000","last_change":"2024-05-14T10:12:43.973700+0000","last_active":"2024-05-14T10:12:43.973575+0000","last_peered":"2024-05-14T10:12:43.973575+0000","last_clean":"2024-05-14T10:12:43.973575+0000","last_became_active":"2024-05-14T09:40:45.767810+0000","last_became_peered":"2024-05-14T09:40:45.767810+0000","last_unstale":"2024-05-14T10:12:43.973575+0000","last_undegraded":"2024-05-14T10:12:43.973575+0000","last_fullsized":"2024-05-14T10:12:43.973575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-05-14T10:12:43.973301+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-05-14T10:12:43.973301+0000","last_clean_scrub_stamp":"2024-05-14T10:12:43.973301+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:38:07.561030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'1179","reported_seq":1237,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:32.881494+0000","last_change":"2024-05-14T10:12:32.881526+0000","last_active":"2024-05-14T10:12:32.881494+0000","last_peered":"2024-05-14T10:12:32.881494+0000","last_clean":"2024-05-14T10:12:32.881494+0000","last_became_active":"2024-05-14T09:40:43.114902+0000","last_became_peered":"2024-05-14T09:40:43.114902+0000","last_unstale":"2024-05-14T10:12:32.881494+0000","last_undegraded":"2024-05-14T10:12:32.881494+0000","last_fullsized":"2024-05-14T10:12:32.881494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'1179","last_scrub_stamp":"2024-05-14T10:12:32.881414+0000","last_deep_scrub":"33'1179","last_deep_scrub_stamp":"2024-05-14T10:12:32.881414+0000","last_clean_scrub_stamp":"2024-05-14T10:12:32.881414+0000","objects_scrubbed":2,"log_size":1179,"log_dups_size":0,"ondisk_log_size":1179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:32:35.119521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2830,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'101","reported_seq":146,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:44.993069+0000","last_change":"2024-05-14T10:12:44.993236+0000","last_active":"2024-05-14T10:12:44.993069+0000","last_peered":"2024-05-14T10:12:44.993069+0000","last_clean":"2024-05-14T10:12:44.993069+0000","last_became_active":"2024-05-14T09:40:53.649263+0000","last_became_peered":"2024-05-14T09:40:53.649263+0000","last_unstale":"2024-05-14T10:12:44.993069+0000","last_undegraded":"2024-05-14T10:12:44.993069+0000","last_fullsized":"2024-05-14T10:12:44.993069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'101","last_scrub_stamp":"2024-05-14T10:12:44.992822+0000","last_deep_scrub":"33'101","last_deep_scrub_stamp":"2024-05-14T10:12:44.992822+0000","last_clean_scrub_stamp":"2024-05-14T10:12:44.992822+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:31:19.358868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":14510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'21","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:34.867524+0000","last_change":"2024-05-14T10:12:34.867547+0000","last_active":"2024-05-14T10:12:34.867524+0000","last_peered":"2024-05-14T10:12:34.867524+0000","last_clean":"2024-05-14T10:12:34.867524+0000","last_became_active":"2024-05-14T09:40:45.732154+0000","last_became_peered":"2024-05-14T09:40:45.732154+0000","last_unstale":"2024-05-14T10:12:34.867524+0000","last_undegraded":"2024-05-14T10:12:34.867524+0000","last_fullsized":"2024-05-14T10:12:34.867524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-05-14T10:12:34.867450+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-05-14T10:12:34.867450+0000","last_clean_scrub_stamp":"2024-05-14T10:12:34.867450+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:39:59.222306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'7","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:41.266524+0000","last_change":"2024-05-14T10:12:41.266671+0000","last_active":"2024-05-14T10:12:41.266524+0000","last_peered":"2024-05-14T10:12:41.266524+0000","last_clean":"2024-05-14T10:12:41.266524+0000","last_became_active":"2024-05-14T09:40:43.110703+0000","last_became_peered":"2024-05-14T09:40:43.110703+0000","last_unstale":"2024-05-14T10:12:41.266524+0000","last_undegraded":"2024-05-14T10:12:41.266524+0000","last_fullsized":"2024-05-14T10:12:41.266524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-05-14T10:12:41.266316+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-05-14T10:12:41.266316+0000","last_clean_scrub_stamp":"2024-05-14T10:12:41.266316+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:11.529984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'52","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:38.683591+0000","last_change":"2024-05-14T10:12:38.683726+0000","last_active":"2024-05-14T10:12:38.683591+0000","last_peered":"2024-05-14T10:12:38.683591+0000","last_clean":"2024-05-14T10:12:38.683591+0000","last_became_active":"2024-05-14T09:40:53.657073+0000","last_became_peered":"2024-05-14T09:40:53.657073+0000","last_unstale":"2024-05-14T10:12:38.683591+0000","last_undegraded":"2024-05-14T10:12:38.683591+0000","last_fullsized":"2024-05-14T10:12:38.683591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'52","last_scrub_stamp":"2024-05-14T10:12:38.683237+0000","last_deep_scrub":"33'52","last_deep_scrub_stamp":"2024-05-14T10:12:38.683237+0000","last_clean_scrub_stamp":"2024-05-14T10:12:38.683237+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:13:46.176058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":5685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"33'18","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:35.266568+0000","last_change":"2024-05-14T10:12:35.266643+0000","last_active":"2024-05-14T10:12:35.266568+0000","last_peered":"2024-05-14T10:12:35.266568+0000","last_clean":"2024-05-14T10:12:35.266568+0000","last_became_active":"2024-05-14T09:40:45.751546+0000","last_became_peered":"2024-05-14T09:40:45.751546+0000","last_unstale":"2024-05-14T10:12:35.266568+0000","last_undegraded":"2024-05-14T10:12:35.266568+0000","last_fullsized":"2024-05-14T10:12:35.266568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-05-14T10:12:35.266373+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-05-14T10:12:35.266373+0000","last_clean_scrub_stamp":"2024-05-14T10:12:35.266373+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:15:21.238843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"33'3","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:30.922729+0000","last_change":"2024-05-14T10:12:30.922800+0000","last_active":"2024-05-14T10:12:30.922729+0000","last_peered":"2024-05-14T10:12:30.922729+0000","last_clean":"2024-05-14T10:12:30.922729+0000","last_became_active":"2024-05-14T09:40:43.098776+0000","last_became_peered":"2024-05-14T09:40:43.098776+0000","last_unstale":"2024-05-14T10:12:30.922729+0000","last_undegraded":"2024-05-14T10:12:30.922729+0000","last_fullsized":"2024-05-14T10:12:30.922729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-05-14T10:12:30.922522+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-05-14T10:12:30.922522+0000","last_clean_scrub_stamp":"2024-05-14T10:12:30.922522+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:25:08.407735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'75","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:41.855013+0000","last_change":"2024-05-14T10:12:41.855050+0000","last_active":"2024-05-14T10:12:41.855013+0000","last_peered":"2024-05-14T10:12:41.855013+0000","last_clean":"2024-05-14T10:12:41.855013+0000","last_became_active":"2024-05-14T09:40:53.650139+0000","last_became_peered":"2024-05-14T09:40:53.650139+0000","last_unstale":"2024-05-14T10:12:41.855013+0000","last_undegraded":"2024-05-14T10:12:41.855013+0000","last_fullsized":"2024-05-14T10:12:41.855013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'75","last_scrub_stamp":"2024-05-14T10:12:41.854895+0000","last_deep_scrub":"33'75","last_deep_scrub_stamp":"2024-05-14T10:12:41.854895+0000","last_clean_scrub_stamp":"2024-05-14T10:12:41.854895+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:07:14.838780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":8252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'20","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:35.969681+0000","last_change":"2024-05-14T10:12:35.969804+0000","last_active":"2024-05-14T10:12:35.969681+0000","last_peered":"2024-05-14T10:12:35.969681+0000","last_clean":"2024-05-14T10:12:35.969681+0000","last_became_active":"2024-05-14T09:40:45.748048+0000","last_became_peered":"2024-05-14T09:40:45.748048+0000","last_unstale":"2024-05-14T10:12:35.969681+0000","last_undegraded":"2024-05-14T10:12:35.969681+0000","last_fullsized":"2024-05-14T10:12:35.969681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-05-14T10:12:35.969436+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-05-14T10:12:35.969436+0000","last_clean_scrub_stamp":"2024-05-14T10:12:35.969436+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:24:13.679038+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'5","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:38.247172+0000","last_change":"2024-05-14T10:12:38.247238+0000","last_active":"2024-05-14T10:12:38.247172+0000","last_peered":"2024-05-14T10:12:38.247172+0000","last_clean":"2024-05-14T10:12:38.247172+0000","last_became_active":"2024-05-14T09:40:43.087310+0000","last_became_peered":"2024-05-14T09:40:43.087310+0000","last_unstale":"2024-05-14T10:12:38.247172+0000","last_undegraded":"2024-05-14T10:12:38.247172+0000","last_fullsized":"2024-05-14T10:12:38.247172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-05-14T10:12:38.246979+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-05-14T10:12:38.246979+0000","last_clean_scrub_stamp":"2024-05-14T10:12:38.246979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:32:32.025418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'60","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:51.025277+0000","last_change":"2024-05-14T10:12:51.025405+0000","last_active":"2024-05-14T10:12:51.025277+0000","last_peered":"2024-05-14T10:12:51.025277+0000","last_clean":"2024-05-14T10:12:51.025277+0000","last_became_active":"2024-05-14T09:41:04.597473+0000","last_became_peered":"2024-05-14T09:41:04.597473+0000","last_unstale":"2024-05-14T10:12:51.025277+0000","last_undegraded":"2024-05-14T10:12:51.025277+0000","last_fullsized":"2024-05-14T10:12:51.025277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'60","last_scrub_stamp":"2024-05-14T10:12:51.025043+0000","last_deep_scrub":"33'60","last_deep_scrub_stamp":"2024-05-14T10:12:51.025043+0000","last_clean_scrub_stamp":"2024-05-14T10:12:51.025043+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:08.937322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"33'26","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:35.851719+0000","last_change":"2024-05-14T10:12:35.851719+0000","last_active":"2024-05-14T10:12:35.851719+0000","last_peered":"2024-05-14T10:12:35.851719+0000","last_clean":"2024-05-14T10:12:35.851719+0000","last_became_active":"2024-05-14T09:40:45.739647+0000","last_became_peered":"2024-05-14T09:40:45.739647+0000","last_unstale":"2024-05-14T10:12:35.851719+0000","last_undegraded":"2024-05-14T10:12:35.851719+0000","last_fullsized":"2024-05-14T10:12:35.851719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-05-14T10:12:35.851499+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-05-14T10:12:35.851499+0000","last_clean_scrub_stamp":"2024-05-14T10:12:35.851499+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:57:57.742259+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'451","reported_seq":942,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:30.962754+0000","last_change":"2024-05-14T10:12:30.962808+0000","last_active":"2024-05-14T10:12:30.962754+0000","last_peered":"2024-05-14T10:12:30.962754+0000","last_clean":"2024-05-14T10:12:30.962754+0000","last_became_active":"2024-05-14T09:40:43.042243+0000","last_became_peered":"2024-05-14T09:40:43.042243+0000","last_unstale":"2024-05-14T10:12:30.962754+0000","last_undegraded":"2024-05-14T10:12:30.962754+0000","last_fullsized":"2024-05-14T10:12:30.962754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'451","last_scrub_stamp":"2024-05-14T10:12:30.962637+0000","last_deep_scrub":"33'451","last_deep_scrub_stamp":"2024-05-14T10:12:30.962637+0000","last_clean_scrub_stamp":"2024-05-14T10:12:30.962637+0000","objects_scrubbed":3,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:31:54.168167+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117717,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":432,"num_read_kb":466,"num_write":444,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'62","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:42.899885+0000","last_change":"2024-05-14T10:12:42.899958+0000","last_active":"2024-05-14T10:12:42.899885+0000","last_peered":"2024-05-14T10:12:42.899885+0000","last_clean":"2024-05-14T10:12:42.899885+0000","last_became_active":"2024-05-14T09:40:53.649990+0000","last_became_peered":"2024-05-14T09:40:53.649990+0000","last_unstale":"2024-05-14T10:12:42.899885+0000","last_undegraded":"2024-05-14T10:12:42.899885+0000","last_fullsized":"2024-05-14T10:12:42.899885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'62","last_scrub_stamp":"2024-05-14T10:12:42.899656+0000","last_deep_scrub":"33'62","last_deep_scrub_stamp":"2024-05-14T10:12:42.899656+0000","last_clean_scrub_stamp":"2024-05-14T10:12:42.899656+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:36:56.588909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":7509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"33'12","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:31.651532+0000","last_change":"2024-05-14T10:12:31.651599+0000","last_active":"2024-05-14T10:12:31.651532+0000","last_peered":"2024-05-14T10:12:31.651532+0000","last_clean":"2024-05-14T10:12:31.651532+0000","last_became_active":"2024-05-14T09:40:45.753850+0000","last_became_peered":"2024-05-14T09:40:45.753850+0000","last_unstale":"2024-05-14T10:12:31.651532+0000","last_undegraded":"2024-05-14T10:12:31.651532+0000","last_fullsized":"2024-05-14T10:12:31.651532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-05-14T10:12:31.651338+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-05-14T10:12:31.651338+0000","last_clean_scrub_stamp":"2024-05-14T10:12:31.651338+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:48:17.412970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'7","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:39.299219+0000","last_change":"2024-05-14T10:12:39.299219+0000","last_active":"2024-05-14T10:12:39.299219+0000","last_peered":"2024-05-14T10:12:39.299219+0000","last_clean":"2024-05-14T10:12:39.299219+0000","last_became_active":"2024-05-14T09:40:43.108233+0000","last_became_peered":"2024-05-14T09:40:43.108233+0000","last_unstale":"2024-05-14T10:12:39.299219+0000","last_undegraded":"2024-05-14T10:12:39.299219+0000","last_fullsized":"2024-05-14T10:12:39.299219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-05-14T10:12:39.298952+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-05-14T10:12:39.298952+0000","last_clean_scrub_stamp":"2024-05-14T10:12:39.298952+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:48:25.060584+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'88","reported_seq":132,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:39.687040+0000","last_change":"2024-05-14T10:12:39.687110+0000","last_active":"2024-05-14T10:12:39.687040+0000","last_peered":"2024-05-14T10:12:39.687040+0000","last_clean":"2024-05-14T10:12:39.687040+0000","last_became_active":"2024-05-14T09:40:53.662980+0000","last_became_peered":"2024-05-14T09:40:53.662980+0000","last_unstale":"2024-05-14T10:12:39.687040+0000","last_undegraded":"2024-05-14T10:12:39.687040+0000","last_fullsized":"2024-05-14T10:12:39.687040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'88","last_scrub_stamp":"2024-05-14T10:12:39.686840+0000","last_deep_scrub":"33'88","last_deep_scrub_stamp":"2024-05-14T10:12:39.686840+0000","last_clean_scrub_stamp":"2024-05-14T10:12:39.686840+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:46:51.299065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":8510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"33'18","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:31.859145+0000","last_change":"2024-05-14T10:12:31.859239+0000","last_active":"2024-05-14T10:12:31.859145+0000","last_peered":"2024-05-14T10:12:31.859145+0000","last_clean":"2024-05-14T10:12:31.859145+0000","last_became_active":"2024-05-14T09:40:45.753869+0000","last_became_peered":"2024-05-14T09:40:45.753869+0000","last_unstale":"2024-05-14T10:12:31.859145+0000","last_undegraded":"2024-05-14T10:12:31.859145+0000","last_fullsized":"2024-05-14T10:12:31.859145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-05-14T10:12:31.858948+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-05-14T10:12:31.858948+0000","last_clean_scrub_stamp":"2024-05-14T10:12:31.858948+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:54:33.182003+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'11","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:37.274598+0000","last_change":"2024-05-14T10:12:37.274658+0000","last_active":"2024-05-14T10:12:37.274598+0000","last_peered":"2024-05-14T10:12:37.274598+0000","last_clean":"2024-05-14T10:12:37.274598+0000","last_became_active":"2024-05-14T09:40:43.086487+0000","last_became_peered":"2024-05-14T09:40:43.086487+0000","last_unstale":"2024-05-14T10:12:37.274598+0000","last_undegraded":"2024-05-14T10:12:37.274598+0000","last_fullsized":"2024-05-14T10:12:37.274598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-05-14T10:12:37.274471+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-05-14T10:12:37.274471+0000","last_clean_scrub_stamp":"2024-05-14T10:12:37.274471+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:30:37.955806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"33'74","reported_seq":160,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:37.269385+0000","last_change":"2024-05-14T10:12:37.269471+0000","last_active":"2024-05-14T10:12:37.269385+0000","last_peered":"2024-05-14T10:12:37.269385+0000","last_clean":"2024-05-14T10:12:37.269385+0000","last_became_active":"2024-05-14T09:40:22.701797+0000","last_became_peered":"2024-05-14T09:40:22.701797+0000","last_unstale":"2024-05-14T10:12:37.269385+0000","last_undegraded":"2024-05-14T10:12:37.269385+0000","last_fullsized":"2024-05-14T10:12:37.269385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-05-14T10:12:37.269188+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-05-14T10:12:37.269188+0000","last_clean_scrub_stamp":"2024-05-14T10:12:37.269188+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:12:04.482588+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'61","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:48.996533+0000","last_change":"2024-05-14T10:12:48.996614+0000","last_active":"2024-05-14T10:12:48.996533+0000","last_peered":"2024-05-14T10:12:48.996533+0000","last_clean":"2024-05-14T10:12:48.996533+0000","last_became_active":"2024-05-14T09:40:53.681296+0000","last_became_peered":"2024-05-14T09:40:53.681296+0000","last_unstale":"2024-05-14T10:12:48.996533+0000","last_undegraded":"2024-05-14T10:12:48.996533+0000","last_fullsized":"2024-05-14T10:12:48.996533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2024-05-14T10:12:48.996307+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2024-05-14T10:12:48.996307+0000","last_clean_scrub_stamp":"2024-05-14T10:12:48.996307+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:38:34.691191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":5982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'23","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:37.063079+0000","last_change":"2024-05-14T10:12:37.063107+0000","last_active":"2024-05-14T10:12:37.063079+0000","last_peered":"2024-05-14T10:12:37.063079+0000","last_clean":"2024-05-14T10:12:37.063079+0000","last_became_active":"2024-05-14T09:41:04.212709+0000","last_became_peered":"2024-05-14T09:41:04.212709+0000","last_unstale":"2024-05-14T10:12:37.063079+0000","last_undegraded":"2024-05-14T10:12:37.063079+0000","last_fullsized":"2024-05-14T10:12:37.063079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-05-14T10:12:37.062996+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-05-14T10:12:37.062996+0000","last_clean_scrub_stamp":"2024-05-14T10:12:37.062996+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:39:28.090447+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"33'7","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:32.963102+0000","last_change":"2024-05-14T10:12:32.963161+0000","last_active":"2024-05-14T10:12:32.963102+0000","last_peered":"2024-05-14T10:12:32.963102+0000","last_clean":"2024-05-14T10:12:32.963102+0000","last_became_active":"2024-05-14T09:40:43.089548+0000","last_became_peered":"2024-05-14T09:40:43.089548+0000","last_unstale":"2024-05-14T10:12:32.963102+0000","last_undegraded":"2024-05-14T10:12:32.963102+0000","last_fullsized":"2024-05-14T10:12:32.963102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-05-14T10:12:32.962960+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-05-14T10:12:32.962960+0000","last_clean_scrub_stamp":"2024-05-14T10:12:32.962960+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:22:20.806177+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'79","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:46.990417+0000","last_change":"2024-05-14T10:12:46.990488+0000","last_active":"2024-05-14T10:12:46.990417+0000","last_peered":"2024-05-14T10:12:46.990417+0000","last_clean":"2024-05-14T10:12:46.990417+0000","last_became_active":"2024-05-14T09:40:53.676636+0000","last_became_peered":"2024-05-14T09:40:53.676636+0000","last_unstale":"2024-05-14T10:12:46.990417+0000","last_undegraded":"2024-05-14T10:12:46.990417+0000","last_fullsized":"2024-05-14T10:12:46.990417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'79","last_scrub_stamp":"2024-05-14T10:12:46.990206+0000","last_deep_scrub":"33'79","last_deep_scrub_stamp":"2024-05-14T10:12:46.990206+0000","last_clean_scrub_stamp":"2024-05-14T10:12:46.990206+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:44:38.150502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":7859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'21","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:43.208183+0000","last_change":"2024-05-14T10:12:43.208263+0000","last_active":"2024-05-14T10:12:43.208183+0000","last_peered":"2024-05-14T10:12:43.208183+0000","last_clean":"2024-05-14T10:12:43.208183+0000","last_became_active":"2024-05-14T09:40:45.750539+0000","last_became_peered":"2024-05-14T09:40:45.750539+0000","last_unstale":"2024-05-14T10:12:43.208183+0000","last_undegraded":"2024-05-14T10:12:43.208183+0000","last_fullsized":"2024-05-14T10:12:43.208183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-05-14T10:12:43.207961+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-05-14T10:12:43.207961+0000","last_clean_scrub_stamp":"2024-05-14T10:12:43.207961+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:16:32.920362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"33'5","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:33.890119+0000","last_change":"2024-05-14T10:12:33.890150+0000","last_active":"2024-05-14T10:12:33.890119+0000","last_peered":"2024-05-14T10:12:33.890119+0000","last_clean":"2024-05-14T10:12:33.890119+0000","last_became_active":"2024-05-14T09:40:43.121427+0000","last_became_peered":"2024-05-14T09:40:43.121427+0000","last_unstale":"2024-05-14T10:12:33.890119+0000","last_undegraded":"2024-05-14T10:12:33.890119+0000","last_fullsized":"2024-05-14T10:12:33.890119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-05-14T10:12:33.890042+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-05-14T10:12:33.890042+0000","last_clean_scrub_stamp":"2024-05-14T10:12:33.890042+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:01:36.549421+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'90","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:37.649621+0000","last_change":"2024-05-14T10:12:37.649695+0000","last_active":"2024-05-14T10:12:37.649621+0000","last_peered":"2024-05-14T10:12:37.649621+0000","last_clean":"2024-05-14T10:12:37.649621+0000","last_became_active":"2024-05-14T09:40:53.655141+0000","last_became_peered":"2024-05-14T09:40:53.655141+0000","last_unstale":"2024-05-14T10:12:37.649621+0000","last_undegraded":"2024-05-14T10:12:37.649621+0000","last_fullsized":"2024-05-14T10:12:37.649621+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'90","last_scrub_stamp":"2024-05-14T10:12:37.649405+0000","last_deep_scrub":"33'90","last_deep_scrub_stamp":"2024-05-14T10:12:37.649405+0000","last_clean_scrub_stamp":"2024-05-14T10:12:37.649405+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:38:23.344289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":8794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'24","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:50.071294+0000","last_change":"2024-05-14T10:12:50.071357+0000","last_active":"2024-05-14T10:12:50.071294+0000","last_peered":"2024-05-14T10:12:50.071294+0000","last_clean":"2024-05-14T10:12:50.071294+0000","last_became_active":"2024-05-14T09:40:45.776967+0000","last_became_peered":"2024-05-14T09:40:45.776967+0000","last_unstale":"2024-05-14T10:12:50.071294+0000","last_undegraded":"2024-05-14T10:12:50.071294+0000","last_fullsized":"2024-05-14T10:12:50.071294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-05-14T10:12:50.071108+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-05-14T10:12:50.071108+0000","last_clean_scrub_stamp":"2024-05-14T10:12:50.071108+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:21:43.298115+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"33'4","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:31.942670+0000","last_change":"2024-05-14T10:12:31.942744+0000","last_active":"2024-05-14T10:12:31.942670+0000","last_peered":"2024-05-14T10:12:31.942670+0000","last_clean":"2024-05-14T10:12:31.942670+0000","last_became_active":"2024-05-14T09:40:43.042486+0000","last_became_peered":"2024-05-14T09:40:43.042486+0000","last_unstale":"2024-05-14T10:12:31.942670+0000","last_undegraded":"2024-05-14T10:12:31.942670+0000","last_fullsized":"2024-05-14T10:12:31.942670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-05-14T10:12:31.942482+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-05-14T10:12:31.942482+0000","last_clean_scrub_stamp":"2024-05-14T10:12:31.942482+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:30:01.409209+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'69","reported_seq":113,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:49.068113+0000","last_change":"2024-05-14T10:12:49.068188+0000","last_active":"2024-05-14T10:12:49.068113+0000","last_peered":"2024-05-14T10:12:49.068113+0000","last_clean":"2024-05-14T10:12:49.068113+0000","last_became_active":"2024-05-14T09:40:53.660933+0000","last_became_peered":"2024-05-14T09:40:53.660933+0000","last_unstale":"2024-05-14T10:12:49.068113+0000","last_undegraded":"2024-05-14T10:12:49.068113+0000","last_fullsized":"2024-05-14T10:12:49.068113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'69","last_scrub_stamp":"2024-05-14T10:12:49.067916+0000","last_deep_scrub":"33'69","last_deep_scrub_stamp":"2024-05-14T10:12:49.067916+0000","last_clean_scrub_stamp":"2024-05-14T10:12:49.067916+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:18:49.387136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'15","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:45.158526+0000","last_change":"2024-05-14T10:12:45.158592+0000","last_active":"2024-05-14T10:12:45.158526+0000","last_peered":"2024-05-14T10:12:45.158526+0000","last_clean":"2024-05-14T10:12:45.158526+0000","last_became_active":"2024-05-14T09:40:45.775936+0000","last_became_peered":"2024-05-14T09:40:45.775936+0000","last_unstale":"2024-05-14T10:12:45.158526+0000","last_undegraded":"2024-05-14T10:12:45.158526+0000","last_fullsized":"2024-05-14T10:12:45.158526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-05-14T10:12:45.158332+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-05-14T10:12:45.158332+0000","last_clean_scrub_stamp":"2024-05-14T10:12:45.158332+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:28:46.931239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'9","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:32.918569+0000","last_change":"2024-05-14T10:12:32.918652+0000","last_active":"2024-05-14T10:12:32.918569+0000","last_peered":"2024-05-14T10:12:32.918569+0000","last_clean":"2024-05-14T10:12:32.918569+0000","last_became_active":"2024-05-14T09:40:43.124370+0000","last_became_peered":"2024-05-14T09:40:43.124370+0000","last_unstale":"2024-05-14T10:12:32.918569+0000","last_undegraded":"2024-05-14T10:12:32.918569+0000","last_fullsized":"2024-05-14T10:12:32.918569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-05-14T10:12:32.918369+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-05-14T10:12:32.918369+0000","last_clean_scrub_stamp":"2024-05-14T10:12:32.918369+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:56:43.530999+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'76","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:43.931700+0000","last_change":"2024-05-14T10:12:43.931753+0000","last_active":"2024-05-14T10:12:43.931700+0000","last_peered":"2024-05-14T10:12:43.931700+0000","last_clean":"2024-05-14T10:12:43.931700+0000","last_became_active":"2024-05-14T09:40:53.666666+0000","last_became_peered":"2024-05-14T09:40:53.666666+0000","last_unstale":"2024-05-14T10:12:43.931700+0000","last_undegraded":"2024-05-14T10:12:43.931700+0000","last_fullsized":"2024-05-14T10:12:43.931700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'76","last_scrub_stamp":"2024-05-14T10:12:43.931544+0000","last_deep_scrub":"33'76","last_deep_scrub_stamp":"2024-05-14T10:12:43.931544+0000","last_clean_scrub_stamp":"2024-05-14T10:12:43.931544+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:34:46.415638+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'22","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:49.111908+0000","last_change":"2024-05-14T10:12:49.111978+0000","last_active":"2024-05-14T10:12:49.111908+0000","last_peered":"2024-05-14T10:12:49.111908+0000","last_clean":"2024-05-14T10:12:49.111908+0000","last_became_active":"2024-05-14T09:40:45.775668+0000","last_became_peered":"2024-05-14T09:40:45.775668+0000","last_unstale":"2024-05-14T10:12:49.111908+0000","last_undegraded":"2024-05-14T10:12:49.111908+0000","last_fullsized":"2024-05-14T10:12:49.111908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-05-14T10:12:49.111692+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-05-14T10:12:49.111692+0000","last_clean_scrub_stamp":"2024-05-14T10:12:49.111692+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:34:50.510587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'26","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:29.930742+0000","last_change":"2024-05-14T10:12:29.930791+0000","last_active":"2024-05-14T10:12:29.930742+0000","last_peered":"2024-05-14T10:12:29.930742+0000","last_clean":"2024-05-14T10:12:29.930742+0000","last_became_active":"2024-05-14T09:40:43.039186+0000","last_became_peered":"2024-05-14T09:40:43.039186+0000","last_unstale":"2024-05-14T10:12:29.930742+0000","last_undegraded":"2024-05-14T10:12:29.930742+0000","last_fullsized":"2024-05-14T10:12:29.930742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-05-14T10:12:29.930609+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-05-14T10:12:29.930609+0000","last_clean_scrub_stamp":"2024-05-14T10:12:29.930609+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:34:31.817064+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'79","reported_seq":122,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:40.663860+0000","last_change":"2024-05-14T10:12:40.663933+0000","last_active":"2024-05-14T10:12:40.663860+0000","last_peered":"2024-05-14T10:12:40.663860+0000","last_clean":"2024-05-14T10:12:40.663860+0000","last_became_active":"2024-05-14T09:40:53.666575+0000","last_became_peered":"2024-05-14T09:40:53.666575+0000","last_unstale":"2024-05-14T10:12:40.663860+0000","last_undegraded":"2024-05-14T10:12:40.663860+0000","last_fullsized":"2024-05-14T10:12:40.663860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'79","last_scrub_stamp":"2024-05-14T10:12:40.663645+0000","last_deep_scrub":"33'79","last_deep_scrub_stamp":"2024-05-14T10:12:40.663645+0000","last_clean_scrub_stamp":"2024-05-14T10:12:40.663645+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:54.055115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":7996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'21","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:41.988659+0000","last_change":"2024-05-14T10:12:41.988731+0000","last_active":"2024-05-14T10:12:41.988659+0000","last_peered":"2024-05-14T10:12:41.988659+0000","last_clean":"2024-05-14T10:12:41.988659+0000","last_became_active":"2024-05-14T09:40:45.753839+0000","last_became_peered":"2024-05-14T09:40:45.753839+0000","last_unstale":"2024-05-14T10:12:41.988659+0000","last_undegraded":"2024-05-14T10:12:41.988659+0000","last_fullsized":"2024-05-14T10:12:41.988659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-05-14T10:12:41.988449+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-05-14T10:12:41.988449+0000","last_clean_scrub_stamp":"2024-05-14T10:12:41.988449+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:48:27.750081+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'7","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:39.001334+0000","last_change":"2024-05-14T10:12:39.001408+0000","last_active":"2024-05-14T10:12:39.001334+0000","last_peered":"2024-05-14T10:12:39.001334+0000","last_clean":"2024-05-14T10:12:39.001334+0000","last_became_active":"2024-05-14T09:40:43.121388+0000","last_became_peered":"2024-05-14T09:40:43.121388+0000","last_unstale":"2024-05-14T10:12:39.001334+0000","last_undegraded":"2024-05-14T10:12:39.001334+0000","last_fullsized":"2024-05-14T10:12:39.001334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-05-14T10:12:39.001140+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-05-14T10:12:39.001140+0000","last_clean_scrub_stamp":"2024-05-14T10:12:39.001140+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:21:55.197612+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'76","reported_seq":119,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:45.961731+0000","last_change":"2024-05-14T10:12:45.961865+0000","last_active":"2024-05-14T10:12:45.961731+0000","last_peered":"2024-05-14T10:12:45.961731+0000","last_clean":"2024-05-14T10:12:45.961731+0000","last_became_active":"2024-05-14T09:40:53.659191+0000","last_became_peered":"2024-05-14T09:40:53.659191+0000","last_unstale":"2024-05-14T10:12:45.961731+0000","last_undegraded":"2024-05-14T10:12:45.961731+0000","last_fullsized":"2024-05-14T10:12:45.961731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'76","last_scrub_stamp":"2024-05-14T10:12:45.961415+0000","last_deep_scrub":"33'76","last_deep_scrub_stamp":"2024-05-14T10:12:45.961415+0000","last_clean_scrub_stamp":"2024-05-14T10:12:45.961415+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:03:11.487737+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":8058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'34","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:47.131281+0000","last_change":"2024-05-14T10:12:47.131350+0000","last_active":"2024-05-14T10:12:47.131281+0000","last_peered":"2024-05-14T10:12:47.131281+0000","last_clean":"2024-05-14T10:12:47.131281+0000","last_became_active":"2024-05-14T09:40:45.776451+0000","last_became_peered":"2024-05-14T09:40:45.776451+0000","last_unstale":"2024-05-14T10:12:47.131281+0000","last_undegraded":"2024-05-14T10:12:47.131281+0000","last_fullsized":"2024-05-14T10:12:47.131281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2024-05-14T10:12:47.131088+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2024-05-14T10:12:47.131088+0000","last_clean_scrub_stamp":"2024-05-14T10:12:47.131088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:09:14.147441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'12","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:36.236235+0000","last_change":"2024-05-14T10:12:36.236311+0000","last_active":"2024-05-14T10:12:36.236235+0000","last_peered":"2024-05-14T10:12:36.236235+0000","last_clean":"2024-05-14T10:12:36.236235+0000","last_became_active":"2024-05-14T09:40:43.085320+0000","last_became_peered":"2024-05-14T09:40:43.085320+0000","last_unstale":"2024-05-14T10:12:36.236235+0000","last_undegraded":"2024-05-14T10:12:36.236235+0000","last_fullsized":"2024-05-14T10:12:36.236235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-05-14T10:12:36.236029+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-05-14T10:12:36.236029+0000","last_clean_scrub_stamp":"2024-05-14T10:12:36.236029+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:57:58.126788+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'63","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:51.097534+0000","last_change":"2024-05-14T10:12:51.097603+0000","last_active":"2024-05-14T10:12:51.097534+0000","last_peered":"2024-05-14T10:12:51.097534+0000","last_clean":"2024-05-14T10:12:51.097534+0000","last_became_active":"2024-05-14T09:40:53.672089+0000","last_became_peered":"2024-05-14T09:40:53.672089+0000","last_unstale":"2024-05-14T10:12:51.097534+0000","last_undegraded":"2024-05-14T10:12:51.097534+0000","last_fullsized":"2024-05-14T10:12:51.097534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'63","last_scrub_stamp":"2024-05-14T10:12:51.097326+0000","last_deep_scrub":"33'63","last_deep_scrub_stamp":"2024-05-14T10:12:51.097326+0000","last_clean_scrub_stamp":"2024-05-14T10:12:51.097326+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:15:11.847578+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":6897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'25","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:35.626354+0000","last_change":"2024-05-14T10:12:35.626423+0000","last_active":"2024-05-14T10:12:35.626354+0000","last_peered":"2024-05-14T10:12:35.626354+0000","last_clean":"2024-05-14T10:12:35.626354+0000","last_became_active":"2024-05-14T09:40:45.766895+0000","last_became_peered":"2024-05-14T09:40:45.766895+0000","last_unstale":"2024-05-14T10:12:35.626354+0000","last_undegraded":"2024-05-14T10:12:35.626354+0000","last_fullsized":"2024-05-14T10:12:35.626354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2024-05-14T10:12:35.626110+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2024-05-14T10:12:35.626110+0000","last_clean_scrub_stamp":"2024-05-14T10:12:35.626110+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:15:47.943666+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'14","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:28.665007+0000","last_change":"2024-05-14T10:12:28.665094+0000","last_active":"2024-05-14T10:12:28.665007+0000","last_peered":"2024-05-14T10:12:28.665007+0000","last_clean":"2024-05-14T10:12:28.665007+0000","last_became_active":"2024-05-14T09:40:43.124129+0000","last_became_peered":"2024-05-14T09:40:43.124129+0000","last_unstale":"2024-05-14T10:12:28.665007+0000","last_undegraded":"2024-05-14T10:12:28.665007+0000","last_fullsized":"2024-05-14T10:12:28.665007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-05-14T10:12:28.664786+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-05-14T10:12:28.664786+0000","last_clean_scrub_stamp":"2024-05-14T10:12:28.664786+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:57:16.926378+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'71","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:50.034325+0000","last_change":"2024-05-14T10:12:50.034384+0000","last_active":"2024-05-14T10:12:50.034325+0000","last_peered":"2024-05-14T10:12:50.034325+0000","last_clean":"2024-05-14T10:12:50.034325+0000","last_became_active":"2024-05-14T09:40:53.664194+0000","last_became_peered":"2024-05-14T09:40:53.664194+0000","last_unstale":"2024-05-14T10:12:50.034325+0000","last_undegraded":"2024-05-14T10:12:50.034325+0000","last_fullsized":"2024-05-14T10:12:50.034325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'71","last_scrub_stamp":"2024-05-14T10:12:50.034154+0000","last_deep_scrub":"33'71","last_deep_scrub_stamp":"2024-05-14T10:12:50.034154+0000","last_clean_scrub_stamp":"2024-05-14T10:12:50.034154+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:17:59.661512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":7358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'20","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:44.196989+0000","last_change":"2024-05-14T10:12:44.197024+0000","last_active":"2024-05-14T10:12:44.196989+0000","last_peered":"2024-05-14T10:12:44.196989+0000","last_clean":"2024-05-14T10:12:44.196989+0000","last_became_active":"2024-05-14T09:40:45.768058+0000","last_became_peered":"2024-05-14T09:40:45.768058+0000","last_unstale":"2024-05-14T10:12:44.196989+0000","last_undegraded":"2024-05-14T10:12:44.196989+0000","last_fullsized":"2024-05-14T10:12:44.196989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-05-14T10:12:44.196881+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-05-14T10:12:44.196881+0000","last_clean_scrub_stamp":"2024-05-14T10:12:44.196881+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:51:27.673185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'828","reported_seq":885,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:35.012346+0000","last_change":"2024-05-14T10:12:35.012433+0000","last_active":"2024-05-14T10:12:35.012346+0000","last_peered":"2024-05-14T10:12:35.012346+0000","last_clean":"2024-05-14T10:12:35.012346+0000","last_became_active":"2024-05-14T09:40:43.113589+0000","last_became_peered":"2024-05-14T09:40:43.113589+0000","last_unstale":"2024-05-14T10:12:35.012346+0000","last_undegraded":"2024-05-14T10:12:35.012346+0000","last_fullsized":"2024-05-14T10:12:35.012346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'828","last_scrub_stamp":"2024-05-14T10:12:35.012089+0000","last_deep_scrub":"33'828","last_deep_scrub_stamp":"2024-05-14T10:12:35.012089+0000","last_clean_scrub_stamp":"2024-05-14T10:12:35.012089+0000","objects_scrubbed":5,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:42:48.127175+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'80","reported_seq":123,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:43.918518+0000","last_change":"2024-05-14T10:12:43.918589+0000","last_active":"2024-05-14T10:12:43.918518+0000","last_peered":"2024-05-14T10:12:43.918518+0000","last_clean":"2024-05-14T10:12:43.918518+0000","last_became_active":"2024-05-14T09:40:53.663419+0000","last_became_peered":"2024-05-14T09:40:53.663419+0000","last_unstale":"2024-05-14T10:12:43.918518+0000","last_undegraded":"2024-05-14T10:12:43.918518+0000","last_fullsized":"2024-05-14T10:12:43.918518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'80","last_scrub_stamp":"2024-05-14T10:12:43.918315+0000","last_deep_scrub":"33'80","last_deep_scrub_stamp":"2024-05-14T10:12:43.918315+0000","last_clean_scrub_stamp":"2024-05-14T10:12:43.918315+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:21:09.074343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":12628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"33'24","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:37.995357+0000","last_change":"2024-05-14T10:12:37.995481+0000","last_active":"2024-05-14T10:12:37.995357+0000","last_peered":"2024-05-14T10:12:37.995357+0000","last_clean":"2024-05-14T10:12:37.995357+0000","last_became_active":"2024-05-14T09:40:45.766784+0000","last_became_peered":"2024-05-14T09:40:45.766784+0000","last_unstale":"2024-05-14T10:12:37.995357+0000","last_undegraded":"2024-05-14T10:12:37.995357+0000","last_fullsized":"2024-05-14T10:12:37.995357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-05-14T10:12:37.995118+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-05-14T10:12:37.995118+0000","last_clean_scrub_stamp":"2024-05-14T10:12:37.995118+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:58.737955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'309","reported_seq":366,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:29.899048+0000","last_change":"2024-05-14T10:12:29.899141+0000","last_active":"2024-05-14T10:12:29.899048+0000","last_peered":"2024-05-14T10:12:29.899048+0000","last_clean":"2024-05-14T10:12:29.899048+0000","last_became_active":"2024-05-14T09:40:43.088906+0000","last_became_peered":"2024-05-14T09:40:43.088906+0000","last_unstale":"2024-05-14T10:12:29.899048+0000","last_undegraded":"2024-05-14T10:12:29.899048+0000","last_fullsized":"2024-05-14T10:12:29.899048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'309","last_scrub_stamp":"2024-05-14T10:12:29.898924+0000","last_deep_scrub":"33'309","last_deep_scrub_stamp":"2024-05-14T10:12:29.898924+0000","last_clean_scrub_stamp":"2024-05-14T10:12:29.898924+0000","objects_scrubbed":3,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:48:49.361938+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'115","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:44.923042+0000","last_change":"2024-05-14T10:12:44.923129+0000","last_active":"2024-05-14T10:12:44.923042+0000","last_peered":"2024-05-14T10:12:44.923042+0000","last_clean":"2024-05-14T10:12:44.923042+0000","last_became_active":"2024-05-14T09:40:53.666533+0000","last_became_peered":"2024-05-14T09:40:53.666533+0000","last_unstale":"2024-05-14T10:12:44.923042+0000","last_undegraded":"2024-05-14T10:12:44.923042+0000","last_fullsized":"2024-05-14T10:12:44.923042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'115","last_scrub_stamp":"2024-05-14T10:12:44.922791+0000","last_deep_scrub":"33'115","last_deep_scrub_stamp":"2024-05-14T10:12:44.922791+0000","last_clean_scrub_stamp":"2024-05-14T10:12:44.922791+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:51:28.399096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'25","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:41.666294+0000","last_change":"2024-05-14T10:12:41.666375+0000","last_active":"2024-05-14T10:12:41.666294+0000","last_peered":"2024-05-14T10:12:41.666294+0000","last_clean":"2024-05-14T10:12:41.666294+0000","last_became_active":"2024-05-14T09:41:04.250043+0000","last_became_peered":"2024-05-14T09:41:04.250043+0000","last_unstale":"2024-05-14T10:12:41.666294+0000","last_undegraded":"2024-05-14T10:12:41.666294+0000","last_fullsized":"2024-05-14T10:12:41.666294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2024-05-14T10:12:41.666037+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2024-05-14T10:12:41.666037+0000","last_clean_scrub_stamp":"2024-05-14T10:12:41.666037+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:16:43.319079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'5","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:39.296294+0000","last_change":"2024-05-14T10:12:39.296371+0000","last_active":"2024-05-14T10:12:39.296294+0000","last_peered":"2024-05-14T10:12:39.296294+0000","last_clean":"2024-05-14T10:12:39.296294+0000","last_became_active":"2024-05-14T09:40:43.115741+0000","last_became_peered":"2024-05-14T09:40:43.115741+0000","last_unstale":"2024-05-14T10:12:39.296294+0000","last_undegraded":"2024-05-14T10:12:39.296294+0000","last_fullsized":"2024-05-14T10:12:39.296294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-05-14T10:12:39.296092+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-05-14T10:12:39.296092+0000","last_clean_scrub_stamp":"2024-05-14T10:12:39.296092+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:20:59.725328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'83","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:47.977972+0000","last_change":"2024-05-14T10:12:47.978133+0000","last_active":"2024-05-14T10:12:47.977972+0000","last_peered":"2024-05-14T10:12:47.977972+0000","last_clean":"2024-05-14T10:12:47.977972+0000","last_became_active":"2024-05-14T09:40:53.662581+0000","last_became_peered":"2024-05-14T09:40:53.662581+0000","last_unstale":"2024-05-14T10:12:47.977972+0000","last_undegraded":"2024-05-14T10:12:47.977972+0000","last_fullsized":"2024-05-14T10:12:47.977972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'83","last_scrub_stamp":"2024-05-14T10:12:47.977601+0000","last_deep_scrub":"33'83","last_deep_scrub_stamp":"2024-05-14T10:12:47.977601+0000","last_clean_scrub_stamp":"2024-05-14T10:12:47.977601+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:35:23.477402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":8224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'26","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:48.094383+0000","last_change":"2024-05-14T10:12:48.094448+0000","last_active":"2024-05-14T10:12:48.094383+0000","last_peered":"2024-05-14T10:12:48.094383+0000","last_clean":"2024-05-14T10:12:48.094383+0000","last_became_active":"2024-05-14T09:40:45.773879+0000","last_became_peered":"2024-05-14T09:40:45.773879+0000","last_unstale":"2024-05-14T10:12:48.094383+0000","last_undegraded":"2024-05-14T10:12:48.094383+0000","last_fullsized":"2024-05-14T10:12:48.094383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-05-14T10:12:48.094192+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-05-14T10:12:48.094192+0000","last_clean_scrub_stamp":"2024-05-14T10:12:48.094192+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:27:39.982042+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'12","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:36.014736+0000","last_change":"2024-05-14T10:12:36.014815+0000","last_active":"2024-05-14T10:12:36.014736+0000","last_peered":"2024-05-14T10:12:36.014736+0000","last_clean":"2024-05-14T10:12:36.014736+0000","last_became_active":"2024-05-14T09:40:43.115166+0000","last_became_peered":"2024-05-14T09:40:43.115166+0000","last_unstale":"2024-05-14T10:12:36.014736+0000","last_undegraded":"2024-05-14T10:12:36.014736+0000","last_fullsized":"2024-05-14T10:12:36.014736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-05-14T10:12:36.014412+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-05-14T10:12:36.014412+0000","last_clean_scrub_stamp":"2024-05-14T10:12:36.014412+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:24:00.799007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'85","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:49.025622+0000","last_change":"2024-05-14T10:12:49.025692+0000","last_active":"2024-05-14T10:12:49.025622+0000","last_peered":"2024-05-14T10:12:49.025622+0000","last_clean":"2024-05-14T10:12:49.025622+0000","last_became_active":"2024-05-14T09:40:53.664838+0000","last_became_peered":"2024-05-14T09:40:53.664838+0000","last_unstale":"2024-05-14T10:12:49.025622+0000","last_undegraded":"2024-05-14T10:12:49.025622+0000","last_fullsized":"2024-05-14T10:12:49.025622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'85","last_scrub_stamp":"2024-05-14T10:12:49.025415+0000","last_deep_scrub":"33'85","last_deep_scrub_stamp":"2024-05-14T10:12:49.025415+0000","last_clean_scrub_stamp":"2024-05-14T10:12:49.025415+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:32.018017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":10155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'59","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:36.661035+0000","last_change":"2024-05-14T10:12:36.661105+0000","last_active":"2024-05-14T10:12:36.661035+0000","last_peered":"2024-05-14T10:12:36.661035+0000","last_clean":"2024-05-14T10:12:36.661035+0000","last_became_active":"2024-05-14T09:40:53.655439+0000","last_became_peered":"2024-05-14T09:40:53.655439+0000","last_unstale":"2024-05-14T10:12:36.661035+0000","last_undegraded":"2024-05-14T10:12:36.661035+0000","last_fullsized":"2024-05-14T10:12:36.661035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2024-05-14T10:12:36.660826+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2024-05-14T10:12:36.660826+0000","last_clean_scrub_stamp":"2024-05-14T10:12:36.660826+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:28:38.433732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'26","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:36.840942+0000","last_change":"2024-05-14T10:12:36.841014+0000","last_active":"2024-05-14T10:12:36.840942+0000","last_peered":"2024-05-14T10:12:36.840942+0000","last_clean":"2024-05-14T10:12:36.840942+0000","last_became_active":"2024-05-14T09:40:45.743611+0000","last_became_peered":"2024-05-14T09:40:45.743611+0000","last_unstale":"2024-05-14T10:12:36.840942+0000","last_undegraded":"2024-05-14T10:12:36.840942+0000","last_fullsized":"2024-05-14T10:12:36.840942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-05-14T10:12:36.840783+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-05-14T10:12:36.840783+0000","last_clean_scrub_stamp":"2024-05-14T10:12:36.840783+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:30:37.522118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'7","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:40.286713+0000","last_change":"2024-05-14T10:12:40.286873+0000","last_active":"2024-05-14T10:12:40.286713+0000","last_peered":"2024-05-14T10:12:40.286713+0000","last_clean":"2024-05-14T10:12:40.286713+0000","last_became_active":"2024-05-14T09:40:43.121629+0000","last_became_peered":"2024-05-14T09:40:43.121629+0000","last_unstale":"2024-05-14T10:12:40.286713+0000","last_undegraded":"2024-05-14T10:12:40.286713+0000","last_fullsized":"2024-05-14T10:12:40.286713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-05-14T10:12:40.286389+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-05-14T10:12:40.286389+0000","last_clean_scrub_stamp":"2024-05-14T10:12:40.286389+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:12:29.848784+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'63","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:48.032556+0000","last_change":"2024-05-14T10:12:48.032637+0000","last_active":"2024-05-14T10:12:48.032556+0000","last_peered":"2024-05-14T10:12:48.032556+0000","last_clean":"2024-05-14T10:12:48.032556+0000","last_became_active":"2024-05-14T09:40:53.678851+0000","last_became_peered":"2024-05-14T09:40:53.678851+0000","last_unstale":"2024-05-14T10:12:48.032556+0000","last_undegraded":"2024-05-14T10:12:48.032556+0000","last_fullsized":"2024-05-14T10:12:48.032556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'63","last_scrub_stamp":"2024-05-14T10:12:48.032342+0000","last_deep_scrub":"33'63","last_deep_scrub_stamp":"2024-05-14T10:12:48.032342+0000","last_clean_scrub_stamp":"2024-05-14T10:12:48.032342+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:28:49.805249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'26","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:42.035445+0000","last_change":"2024-05-14T10:12:42.035575+0000","last_active":"2024-05-14T10:12:42.035445+0000","last_peered":"2024-05-14T10:12:42.035445+0000","last_clean":"2024-05-14T10:12:42.035445+0000","last_became_active":"2024-05-14T09:40:45.742702+0000","last_became_peered":"2024-05-14T09:40:45.742702+0000","last_unstale":"2024-05-14T10:12:42.035445+0000","last_undegraded":"2024-05-14T10:12:42.035445+0000","last_fullsized":"2024-05-14T10:12:42.035445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-05-14T10:12:42.035069+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-05-14T10:12:42.035069+0000","last_clean_scrub_stamp":"2024-05-14T10:12:42.035069+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:23:18.942143+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"33'5","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:37.935640+0000","last_change":"2024-05-14T10:12:37.935714+0000","last_active":"2024-05-14T10:12:37.935640+0000","last_peered":"2024-05-14T10:12:37.935640+0000","last_clean":"2024-05-14T10:12:37.935640+0000","last_became_active":"2024-05-14T09:40:43.115860+0000","last_became_peered":"2024-05-14T09:40:43.115860+0000","last_unstale":"2024-05-14T10:12:37.935640+0000","last_undegraded":"2024-05-14T10:12:37.935640+0000","last_fullsized":"2024-05-14T10:12:37.935640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-05-14T10:12:37.935448+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-05-14T10:12:37.935448+0000","last_clean_scrub_stamp":"2024-05-14T10:12:37.935448+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:46:49.547673+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'341","reported_seq":397,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:38.022401+0000","last_change":"2024-05-14T10:12:38.022478+0000","last_active":"2024-05-14T10:12:38.022401+0000","last_peered":"2024-05-14T10:12:38.022401+0000","last_clean":"2024-05-14T10:12:38.022401+0000","last_became_active":"2024-05-14T09:40:43.120353+0000","last_became_peered":"2024-05-14T09:40:43.120353+0000","last_unstale":"2024-05-14T10:12:38.022401+0000","last_undegraded":"2024-05-14T10:12:38.022401+0000","last_fullsized":"2024-05-14T10:12:38.022401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'341","last_scrub_stamp":"2024-05-14T10:12:38.022199+0000","last_deep_scrub":"33'341","last_deep_scrub_stamp":"2024-05-14T10:12:38.022199+0000","last_clean_scrub_stamp":"2024-05-14T10:12:38.022199+0000","objects_scrubbed":2,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:35:24.397316+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'24","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:33.631179+0000","last_change":"2024-05-14T10:12:33.631225+0000","last_active":"2024-05-14T10:12:33.631179+0000","last_peered":"2024-05-14T10:12:33.631179+0000","last_clean":"2024-05-14T10:12:33.631179+0000","last_became_active":"2024-05-14T09:40:45.758017+0000","last_became_peered":"2024-05-14T09:40:45.758017+0000","last_unstale":"2024-05-14T10:12:33.631179+0000","last_undegraded":"2024-05-14T10:12:33.631179+0000","last_fullsized":"2024-05-14T10:12:33.631179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-05-14T10:12:33.631068+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-05-14T10:12:33.631068+0000","last_clean_scrub_stamp":"2024-05-14T10:12:33.631068+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:03.894736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'56","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:36.016533+0000","last_change":"2024-05-14T10:12:36.016604+0000","last_active":"2024-05-14T10:12:36.016533+0000","last_peered":"2024-05-14T10:12:36.016533+0000","last_clean":"2024-05-14T10:12:36.016533+0000","last_became_active":"2024-05-14T09:40:53.671145+0000","last_became_peered":"2024-05-14T09:40:53.671145+0000","last_unstale":"2024-05-14T10:12:36.016533+0000","last_undegraded":"2024-05-14T10:12:36.016533+0000","last_fullsized":"2024-05-14T10:12:36.016533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'56","last_scrub_stamp":"2024-05-14T10:12:36.016337+0000","last_deep_scrub":"33'56","last_deep_scrub_stamp":"2024-05-14T10:12:36.016337+0000","last_clean_scrub_stamp":"2024-05-14T10:12:36.016337+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:13:16.530986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":4531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'474","reported_seq":530,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:36.952809+0000","last_change":"2024-05-14T10:12:36.952865+0000","last_active":"2024-05-14T10:12:36.952809+0000","last_peered":"2024-05-14T10:12:36.952809+0000","last_clean":"2024-05-14T10:12:36.952809+0000","last_became_active":"2024-05-14T09:40:43.104821+0000","last_became_peered":"2024-05-14T09:40:43.104821+0000","last_unstale":"2024-05-14T10:12:36.952809+0000","last_undegraded":"2024-05-14T10:12:36.952809+0000","last_fullsized":"2024-05-14T10:12:36.952809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'474","last_scrub_stamp":"2024-05-14T10:12:36.952680+0000","last_deep_scrub":"33'474","last_deep_scrub_stamp":"2024-05-14T10:12:36.952680+0000","last_clean_scrub_stamp":"2024-05-14T10:12:36.952680+0000","objects_scrubbed":3,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:13:44.445501+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'22","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:34.921406+0000","last_change":"2024-05-14T10:12:34.921537+0000","last_active":"2024-05-14T10:12:34.921406+0000","last_peered":"2024-05-14T10:12:34.921406+0000","last_clean":"2024-05-14T10:12:34.921406+0000","last_became_active":"2024-05-14T09:40:45.745850+0000","last_became_peered":"2024-05-14T09:40:45.745850+0000","last_unstale":"2024-05-14T10:12:34.921406+0000","last_undegraded":"2024-05-14T10:12:34.921406+0000","last_fullsized":"2024-05-14T10:12:34.921406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-05-14T10:12:34.921127+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-05-14T10:12:34.921127+0000","last_clean_scrub_stamp":"2024-05-14T10:12:34.921127+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:43:16.242576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'74","reported_seq":116,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:50.072035+0000","last_change":"2024-05-14T10:12:50.072192+0000","last_active":"2024-05-14T10:12:50.072035+0000","last_peered":"2024-05-14T10:12:50.072035+0000","last_clean":"2024-05-14T10:12:50.072035+0000","last_became_active":"2024-05-14T09:40:53.669094+0000","last_became_peered":"2024-05-14T09:40:53.669094+0000","last_unstale":"2024-05-14T10:12:50.072035+0000","last_undegraded":"2024-05-14T10:12:50.072035+0000","last_fullsized":"2024-05-14T10:12:50.072035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-05-14T10:12:50.071728+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-05-14T10:12:50.071728+0000","last_clean_scrub_stamp":"2024-05-14T10:12:50.071728+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:20:55.540664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":7350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'33","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:43.004593+0000","last_change":"2024-05-14T10:12:43.004726+0000","last_active":"2024-05-14T10:12:43.004593+0000","last_peered":"2024-05-14T10:12:43.004593+0000","last_clean":"2024-05-14T10:12:43.004593+0000","last_became_active":"2024-05-14T09:40:45.754283+0000","last_became_peered":"2024-05-14T09:40:45.754283+0000","last_unstale":"2024-05-14T10:12:43.004593+0000","last_undegraded":"2024-05-14T10:12:43.004593+0000","last_fullsized":"2024-05-14T10:12:43.004593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'33","last_scrub_stamp":"2024-05-14T10:12:43.004364+0000","last_deep_scrub":"33'33","last_deep_scrub_stamp":"2024-05-14T10:12:43.004364+0000","last_clean_scrub_stamp":"2024-05-14T10:12:43.004364+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:09:20.414472+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'26","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:35.016406+0000","last_change":"2024-05-14T10:12:35.016452+0000","last_active":"2024-05-14T10:12:35.016406+0000","last_peered":"2024-05-14T10:12:35.016406+0000","last_clean":"2024-05-14T10:12:35.016406+0000","last_became_active":"2024-05-14T09:40:45.752599+0000","last_became_peered":"2024-05-14T09:40:45.752599+0000","last_unstale":"2024-05-14T10:12:35.016406+0000","last_undegraded":"2024-05-14T10:12:35.016406+0000","last_fullsized":"2024-05-14T10:12:35.016406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-05-14T10:12:35.016289+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-05-14T10:12:35.016289+0000","last_clean_scrub_stamp":"2024-05-14T10:12:35.016289+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T10:57:58.929236+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'26","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:34.226758+0000","last_change":"2024-05-14T10:12:34.226897+0000","last_active":"2024-05-14T10:12:34.226758+0000","last_peered":"2024-05-14T10:12:34.226758+0000","last_clean":"2024-05-14T10:12:34.226758+0000","last_became_active":"2024-05-14T09:40:45.750387+0000","last_became_peered":"2024-05-14T09:40:45.750387+0000","last_unstale":"2024-05-14T10:12:34.226758+0000","last_undegraded":"2024-05-14T10:12:34.226758+0000","last_fullsized":"2024-05-14T10:12:34.226758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-05-14T10:12:34.226455+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-05-14T10:12:34.226455+0000","last_clean_scrub_stamp":"2024-05-14T10:12:34.226455+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:32:36.464562+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'18","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:42.697871+0000","last_change":"2024-05-14T10:12:42.697938+0000","last_active":"2024-05-14T10:12:42.697871+0000","last_peered":"2024-05-14T10:12:42.697871+0000","last_clean":"2024-05-14T10:12:42.697871+0000","last_became_active":"2024-05-14T09:41:04.250037+0000","last_became_peered":"2024-05-14T09:41:04.250037+0000","last_unstale":"2024-05-14T10:12:42.697871+0000","last_undegraded":"2024-05-14T10:12:42.697871+0000","last_fullsized":"2024-05-14T10:12:42.697871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-05-14T10:12:42.697663+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-05-14T10:12:42.697663+0000","last_clean_scrub_stamp":"2024-05-14T10:12:42.697663+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:20:55.817806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'17","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:38.929362+0000","last_change":"2024-05-14T10:12:38.929429+0000","last_active":"2024-05-14T10:12:38.929362+0000","last_peered":"2024-05-14T10:12:38.929362+0000","last_clean":"2024-05-14T10:12:38.929362+0000","last_became_active":"2024-05-14T09:40:45.723040+0000","last_became_peered":"2024-05-14T09:40:45.723040+0000","last_unstale":"2024-05-14T10:12:38.929362+0000","last_undegraded":"2024-05-14T10:12:38.929362+0000","last_fullsized":"2024-05-14T10:12:38.929362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'17","last_scrub_stamp":"2024-05-14T10:12:38.929130+0000","last_deep_scrub":"33'17","last_deep_scrub_stamp":"2024-05-14T10:12:38.929130+0000","last_clean_scrub_stamp":"2024-05-14T10:12:38.929130+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:31:52.320600+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'18","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:38.834938+0000","last_change":"2024-05-14T10:12:38.835007+0000","last_active":"2024-05-14T10:12:38.834938+0000","last_peered":"2024-05-14T10:12:38.834938+0000","last_clean":"2024-05-14T10:12:38.834938+0000","last_became_active":"2024-05-14T09:40:45.745393+0000","last_became_peered":"2024-05-14T09:40:45.745393+0000","last_unstale":"2024-05-14T10:12:38.834938+0000","last_undegraded":"2024-05-14T10:12:38.834938+0000","last_fullsized":"2024-05-14T10:12:38.834938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-05-14T10:12:38.834736+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-05-14T10:12:38.834736+0000","last_clean_scrub_stamp":"2024-05-14T10:12:38.834736+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:20:59.263972+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'32","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:45.997578+0000","last_change":"2024-05-14T10:12:45.997647+0000","last_active":"2024-05-14T10:12:45.997578+0000","last_peered":"2024-05-14T10:12:45.997578+0000","last_clean":"2024-05-14T10:12:45.997578+0000","last_became_active":"2024-05-14T09:40:45.771838+0000","last_became_peered":"2024-05-14T09:40:45.771838+0000","last_unstale":"2024-05-14T10:12:45.997578+0000","last_undegraded":"2024-05-14T10:12:45.997578+0000","last_fullsized":"2024-05-14T10:12:45.997578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'32","last_scrub_stamp":"2024-05-14T10:12:45.997379+0000","last_deep_scrub":"33'32","last_deep_scrub_stamp":"2024-05-14T10:12:45.997379+0000","last_clean_scrub_stamp":"2024-05-14T10:12:45.997379+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:34:48.481473+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"33'17","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:40.990111+0000","last_change":"2024-05-14T10:12:40.990219+0000","last_active":"2024-05-14T10:12:40.990111+0000","last_peered":"2024-05-14T10:12:40.990111+0000","last_clean":"2024-05-14T10:12:40.990111+0000","last_became_active":"2024-05-14T09:40:45.725283+0000","last_became_peered":"2024-05-14T09:40:45.725283+0000","last_unstale":"2024-05-14T10:12:40.990111+0000","last_undegraded":"2024-05-14T10:12:40.990111+0000","last_fullsized":"2024-05-14T10:12:40.990111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'17","last_scrub_stamp":"2024-05-14T10:12:40.989899+0000","last_deep_scrub":"33'17","last_deep_scrub_stamp":"2024-05-14T10:12:40.989899+0000","last_clean_scrub_stamp":"2024-05-14T10:12:40.989899+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:47:32.135320+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'19","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:41.266601+0000","last_change":"2024-05-14T10:12:41.266723+0000","last_active":"2024-05-14T10:12:41.266601+0000","last_peered":"2024-05-14T10:12:41.266601+0000","last_clean":"2024-05-14T10:12:41.266601+0000","last_became_active":"2024-05-14T09:40:45.748925+0000","last_became_peered":"2024-05-14T09:40:45.748925+0000","last_unstale":"2024-05-14T10:12:41.266601+0000","last_undegraded":"2024-05-14T10:12:41.266601+0000","last_fullsized":"2024-05-14T10:12:41.266601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-05-14T10:12:41.266304+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-05-14T10:12:41.266304+0000","last_clean_scrub_stamp":"2024-05-14T10:12:41.266304+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:24.650784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'25","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:39.953110+0000","last_change":"2024-05-14T10:12:39.953198+0000","last_active":"2024-05-14T10:12:39.953110+0000","last_peered":"2024-05-14T10:12:39.953110+0000","last_clean":"2024-05-14T10:12:39.953110+0000","last_became_active":"2024-05-14T09:40:45.723317+0000","last_became_peered":"2024-05-14T09:40:45.723317+0000","last_unstale":"2024-05-14T10:12:39.953110+0000","last_undegraded":"2024-05-14T10:12:39.953110+0000","last_fullsized":"2024-05-14T10:12:39.953110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2024-05-14T10:12:39.952896+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2024-05-14T10:12:39.952896+0000","last_clean_scrub_stamp":"2024-05-14T10:12:39.952896+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:16:41.605937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'24","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:46.115810+0000","last_change":"2024-05-14T10:12:46.115911+0000","last_active":"2024-05-14T10:12:46.115810+0000","last_peered":"2024-05-14T10:12:46.115810+0000","last_clean":"2024-05-14T10:12:46.115810+0000","last_became_active":"2024-05-14T09:40:45.769772+0000","last_became_peered":"2024-05-14T09:40:45.769772+0000","last_unstale":"2024-05-14T10:12:46.115810+0000","last_undegraded":"2024-05-14T10:12:46.115810+0000","last_fullsized":"2024-05-14T10:12:46.115810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-05-14T10:12:46.115597+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-05-14T10:12:46.115597+0000","last_clean_scrub_stamp":"2024-05-14T10:12:46.115597+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:09:45.641618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"33'33","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:26.742617+0000","last_change":"2024-05-14T10:12:26.742764+0000","last_active":"2024-05-14T10:12:26.742617+0000","last_peered":"2024-05-14T10:12:26.742617+0000","last_clean":"2024-05-14T10:12:26.742617+0000","last_became_active":"2024-05-14T09:40:45.765830+0000","last_became_peered":"2024-05-14T09:40:45.765830+0000","last_unstale":"2024-05-14T10:12:26.742617+0000","last_undegraded":"2024-05-14T10:12:26.742617+0000","last_fullsized":"2024-05-14T10:12:26.742617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'33","last_scrub_stamp":"2024-05-14T10:12:26.742354+0000","last_deep_scrub":"33'33","last_deep_scrub_stamp":"2024-05-14T10:12:26.742354+0000","last_clean_scrub_stamp":"2024-05-14T10:12:26.742354+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:19:11.797077+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'27","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:44.964609+0000","last_change":"2024-05-14T10:12:44.964676+0000","last_active":"2024-05-14T10:12:44.964609+0000","last_peered":"2024-05-14T10:12:44.964609+0000","last_clean":"2024-05-14T10:12:44.964609+0000","last_became_active":"2024-05-14T09:40:45.760535+0000","last_became_peered":"2024-05-14T09:40:45.760535+0000","last_unstale":"2024-05-14T10:12:44.964609+0000","last_undegraded":"2024-05-14T10:12:44.964609+0000","last_fullsized":"2024-05-14T10:12:44.964609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'27","last_scrub_stamp":"2024-05-14T10:12:44.964407+0000","last_deep_scrub":"33'27","last_deep_scrub_stamp":"2024-05-14T10:12:44.964407+0000","last_clean_scrub_stamp":"2024-05-14T10:12:44.964407+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:49:06.254513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"33'23","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:51.063817+0000","last_change":"2024-05-14T10:12:51.063913+0000","last_active":"2024-05-14T10:12:51.063817+0000","last_peered":"2024-05-14T10:12:51.063817+0000","last_clean":"2024-05-14T10:12:51.063817+0000","last_became_active":"2024-05-14T09:40:45.775602+0000","last_became_peered":"2024-05-14T09:40:45.775602+0000","last_unstale":"2024-05-14T10:12:51.063817+0000","last_undegraded":"2024-05-14T10:12:51.063817+0000","last_fullsized":"2024-05-14T10:12:51.063817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-05-14T10:12:51.063612+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-05-14T10:12:51.063612+0000","last_clean_scrub_stamp":"2024-05-14T10:12:51.063612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:21:04.183754+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'33","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:33.979019+0000","last_change":"2024-05-14T10:12:33.979046+0000","last_active":"2024-05-14T10:12:33.979019+0000","last_peered":"2024-05-14T10:12:33.979019+0000","last_clean":"2024-05-14T10:12:33.979019+0000","last_became_active":"2024-05-14T09:40:45.748266+0000","last_became_peered":"2024-05-14T09:40:45.748266+0000","last_unstale":"2024-05-14T10:12:33.979019+0000","last_undegraded":"2024-05-14T10:12:33.979019+0000","last_fullsized":"2024-05-14T10:12:33.979019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'33","last_scrub_stamp":"2024-05-14T10:12:33.978934+0000","last_deep_scrub":"33'33","last_deep_scrub_stamp":"2024-05-14T10:12:33.978934+0000","last_clean_scrub_stamp":"2024-05-14T10:12:33.978934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:05:47.148650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'22","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:39.072738+0000","last_change":"2024-05-14T10:12:39.072812+0000","last_active":"2024-05-14T10:12:39.072738+0000","last_peered":"2024-05-14T10:12:39.072738+0000","last_clean":"2024-05-14T10:12:39.072738+0000","last_became_active":"2024-05-14T09:41:04.612160+0000","last_became_peered":"2024-05-14T09:41:04.612160+0000","last_unstale":"2024-05-14T10:12:39.072738+0000","last_undegraded":"2024-05-14T10:12:39.072738+0000","last_fullsized":"2024-05-14T10:12:39.072738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-05-14T10:12:39.072530+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-05-14T10:12:39.072530+0000","last_clean_scrub_stamp":"2024-05-14T10:12:39.072530+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:42:52.187616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'28","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:44.179319+0000","last_change":"2024-05-14T10:12:44.179371+0000","last_active":"2024-05-14T10:12:44.179319+0000","last_peered":"2024-05-14T10:12:44.179319+0000","last_clean":"2024-05-14T10:12:44.179319+0000","last_became_active":"2024-05-14T09:40:45.749692+0000","last_became_peered":"2024-05-14T09:40:45.749692+0000","last_unstale":"2024-05-14T10:12:44.179319+0000","last_undegraded":"2024-05-14T10:12:44.179319+0000","last_fullsized":"2024-05-14T10:12:44.179319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-05-14T10:12:44.179174+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-05-14T10:12:44.179174+0000","last_clean_scrub_stamp":"2024-05-14T10:12:44.179174+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:11:35.075306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'27","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:37.866963+0000","last_change":"2024-05-14T10:12:37.867087+0000","last_active":"2024-05-14T10:12:37.866963+0000","last_peered":"2024-05-14T10:12:37.866963+0000","last_clean":"2024-05-14T10:12:37.866963+0000","last_became_active":"2024-05-14T09:40:45.744011+0000","last_became_peered":"2024-05-14T09:40:45.744011+0000","last_unstale":"2024-05-14T10:12:37.866963+0000","last_undegraded":"2024-05-14T10:12:37.866963+0000","last_fullsized":"2024-05-14T10:12:37.866963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'27","last_scrub_stamp":"2024-05-14T10:12:37.866586+0000","last_deep_scrub":"33'27","last_deep_scrub_stamp":"2024-05-14T10:12:37.866586+0000","last_clean_scrub_stamp":"2024-05-14T10:12:37.866586+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:55:34.655521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'24","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:32.670717+0000","last_change":"2024-05-14T10:12:32.670758+0000","last_active":"2024-05-14T10:12:32.670717+0000","last_peered":"2024-05-14T10:12:32.670717+0000","last_clean":"2024-05-14T10:12:32.670717+0000","last_became_active":"2024-05-14T09:40:45.757450+0000","last_became_peered":"2024-05-14T09:40:45.757450+0000","last_unstale":"2024-05-14T10:12:32.670717+0000","last_undegraded":"2024-05-14T10:12:32.670717+0000","last_fullsized":"2024-05-14T10:12:32.670717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-05-14T10:12:32.670604+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-05-14T10:12:32.670604+0000","last_clean_scrub_stamp":"2024-05-14T10:12:32.670604+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:09:10.080712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'33","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:42.994296+0000","last_change":"2024-05-14T10:12:42.994364+0000","last_active":"2024-05-14T10:12:42.994296+0000","last_peered":"2024-05-14T10:12:42.994296+0000","last_clean":"2024-05-14T10:12:42.994296+0000","last_became_active":"2024-05-14T09:40:45.744550+0000","last_became_peered":"2024-05-14T09:40:45.744550+0000","last_unstale":"2024-05-14T10:12:42.994296+0000","last_undegraded":"2024-05-14T10:12:42.994296+0000","last_fullsized":"2024-05-14T10:12:42.994296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'33","last_scrub_stamp":"2024-05-14T10:12:42.994043+0000","last_deep_scrub":"33'33","last_deep_scrub_stamp":"2024-05-14T10:12:42.994043+0000","last_clean_scrub_stamp":"2024-05-14T10:12:42.994043+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:34.619022+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'17","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:37.018272+0000","last_change":"2024-05-14T10:12:37.018339+0000","last_active":"2024-05-14T10:12:37.018272+0000","last_peered":"2024-05-14T10:12:37.018272+0000","last_clean":"2024-05-14T10:12:37.018272+0000","last_became_active":"2024-05-14T09:40:45.748419+0000","last_became_peered":"2024-05-14T09:40:45.748419+0000","last_unstale":"2024-05-14T10:12:37.018272+0000","last_undegraded":"2024-05-14T10:12:37.018272+0000","last_fullsized":"2024-05-14T10:12:37.018272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'17","last_scrub_stamp":"2024-05-14T10:12:37.018068+0000","last_deep_scrub":"33'17","last_deep_scrub_stamp":"2024-05-14T10:12:37.018068+0000","last_clean_scrub_stamp":"2024-05-14T10:12:37.018068+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:21:53.214540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'23","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:39.999157+0000","last_change":"2024-05-14T10:12:39.999195+0000","last_active":"2024-05-14T10:12:39.999157+0000","last_peered":"2024-05-14T10:12:39.999157+0000","last_clean":"2024-05-14T10:12:39.999157+0000","last_became_active":"2024-05-14T09:40:45.752982+0000","last_became_peered":"2024-05-14T09:40:45.752982+0000","last_unstale":"2024-05-14T10:12:39.999157+0000","last_undegraded":"2024-05-14T10:12:39.999157+0000","last_fullsized":"2024-05-14T10:12:39.999157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-05-14T10:12:39.999039+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-05-14T10:12:39.999039+0000","last_clean_scrub_stamp":"2024-05-14T10:12:39.999039+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:12:07.212438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"33'32","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:43.976196+0000","last_change":"2024-05-14T10:12:43.976264+0000","last_active":"2024-05-14T10:12:43.976196+0000","last_peered":"2024-05-14T10:12:43.976196+0000","last_clean":"2024-05-14T10:12:43.976196+0000","last_became_active":"2024-05-14T09:40:45.758912+0000","last_became_peered":"2024-05-14T09:40:45.758912+0000","last_unstale":"2024-05-14T10:12:43.976196+0000","last_undegraded":"2024-05-14T10:12:43.976196+0000","last_fullsized":"2024-05-14T10:12:43.976196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'32","last_scrub_stamp":"2024-05-14T10:12:43.975997+0000","last_deep_scrub":"33'32","last_deep_scrub_stamp":"2024-05-14T10:12:43.975997+0000","last_clean_scrub_stamp":"2024-05-14T10:12:43.975997+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:05:14.239665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'28","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:52.073041+0000","last_change":"2024-05-14T10:12:52.073111+0000","last_active":"2024-05-14T10:12:52.073041+0000","last_peered":"2024-05-14T10:12:52.073041+0000","last_clean":"2024-05-14T10:12:52.073041+0000","last_became_active":"2024-05-14T09:40:45.780197+0000","last_became_peered":"2024-05-14T09:40:45.780197+0000","last_unstale":"2024-05-14T10:12:52.073041+0000","last_undegraded":"2024-05-14T10:12:52.073041+0000","last_fullsized":"2024-05-14T10:12:52.073041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'28","last_scrub_stamp":"2024-05-14T10:12:52.072817+0000","last_deep_scrub":"33'28","last_deep_scrub_stamp":"2024-05-14T10:12:52.072817+0000","last_clean_scrub_stamp":"2024-05-14T10:12:52.072817+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:47:06.287688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'19","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:33.864289+0000","last_change":"2024-05-14T10:12:33.864322+0000","last_active":"2024-05-14T10:12:33.864289+0000","last_peered":"2024-05-14T10:12:33.864289+0000","last_clean":"2024-05-14T10:12:33.864289+0000","last_became_active":"2024-05-14T09:40:45.760738+0000","last_became_peered":"2024-05-14T09:40:45.760738+0000","last_unstale":"2024-05-14T10:12:33.864289+0000","last_undegraded":"2024-05-14T10:12:33.864289+0000","last_fullsized":"2024-05-14T10:12:33.864289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-05-14T10:12:33.864186+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-05-14T10:12:33.864186+0000","last_clean_scrub_stamp":"2024-05-14T10:12:33.864186+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:15:46.181742+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'17","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:46.143029+0000","last_change":"2024-05-14T10:12:46.143100+0000","last_active":"2024-05-14T10:12:46.143029+0000","last_peered":"2024-05-14T10:12:46.143029+0000","last_clean":"2024-05-14T10:12:46.143029+0000","last_became_active":"2024-05-14T09:40:45.776005+0000","last_became_peered":"2024-05-14T09:40:45.776005+0000","last_unstale":"2024-05-14T10:12:46.143029+0000","last_undegraded":"2024-05-14T10:12:46.143029+0000","last_fullsized":"2024-05-14T10:12:46.143029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'17","last_scrub_stamp":"2024-05-14T10:12:46.142795+0000","last_deep_scrub":"33'17","last_deep_scrub_stamp":"2024-05-14T10:12:46.142795+0000","last_clean_scrub_stamp":"2024-05-14T10:12:46.142795+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:38:31.837679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'24","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:38.029484+0000","last_change":"2024-05-14T10:12:38.029552+0000","last_active":"2024-05-14T10:12:38.029484+0000","last_peered":"2024-05-14T10:12:38.029484+0000","last_clean":"2024-05-14T10:12:38.029484+0000","last_became_active":"2024-05-14T09:41:04.213721+0000","last_became_peered":"2024-05-14T09:41:04.213721+0000","last_unstale":"2024-05-14T10:12:38.029484+0000","last_undegraded":"2024-05-14T10:12:38.029484+0000","last_fullsized":"2024-05-14T10:12:38.029484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-05-14T10:12:38.029281+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-05-14T10:12:38.029281+0000","last_clean_scrub_stamp":"2024-05-14T10:12:38.029281+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T11:11:10.913206+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"33'23","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:48.149885+0000","last_change":"2024-05-14T10:12:48.149954+0000","last_active":"2024-05-14T10:12:48.149885+0000","last_peered":"2024-05-14T10:12:48.149885+0000","last_clean":"2024-05-14T10:12:48.149885+0000","last_became_active":"2024-05-14T09:40:45.775953+0000","last_became_peered":"2024-05-14T09:40:45.775953+0000","last_unstale":"2024-05-14T10:12:48.149885+0000","last_undegraded":"2024-05-14T10:12:48.149885+0000","last_fullsized":"2024-05-14T10:12:48.149885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-05-14T10:12:48.149654+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-05-14T10:12:48.149654+0000","last_clean_scrub_stamp":"2024-05-14T10:12:48.149654+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:25:33.352077+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"33'18","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:42.257702+0000","last_change":"2024-05-14T10:12:42.257702+0000","last_active":"2024-05-14T10:12:42.257702+0000","last_peered":"2024-05-14T10:12:42.257702+0000","last_clean":"2024-05-14T10:12:42.257702+0000","last_became_active":"2024-05-14T09:40:45.750416+0000","last_became_peered":"2024-05-14T09:40:45.750416+0000","last_unstale":"2024-05-14T10:12:42.257702+0000","last_undegraded":"2024-05-14T10:12:42.257702+0000","last_fullsized":"2024-05-14T10:12:42.257702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-05-14T10:12:42.257442+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-05-14T10:12:42.257442+0000","last_clean_scrub_stamp":"2024-05-14T10:12:42.257442+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T12:32:55.708130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"33'25","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:29.616042+0000","last_change":"2024-05-14T10:12:29.616116+0000","last_active":"2024-05-14T10:12:29.616042+0000","last_peered":"2024-05-14T10:12:29.616042+0000","last_clean":"2024-05-14T10:12:29.616042+0000","last_became_active":"2024-05-14T09:40:45.746640+0000","last_became_peered":"2024-05-14T09:40:45.746640+0000","last_unstale":"2024-05-14T10:12:29.616042+0000","last_undegraded":"2024-05-14T10:12:29.616042+0000","last_fullsized":"2024-05-14T10:12:29.616042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2024-05-14T10:12:29.615849+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2024-05-14T10:12:29.615849+0000","last_clean_scrub_stamp":"2024-05-14T10:12:29.615849+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T13:11:56.829249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"33'19","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:39.853351+0000","last_change":"2024-05-14T10:12:39.853399+0000","last_active":"2024-05-14T10:12:39.853351+0000","last_peered":"2024-05-14T10:12:39.853351+0000","last_clean":"2024-05-14T10:12:39.853351+0000","last_became_active":"2024-05-14T09:40:45.752589+0000","last_became_peered":"2024-05-14T09:40:45.752589+0000","last_unstale":"2024-05-14T10:12:39.853351+0000","last_undegraded":"2024-05-14T10:12:39.853351+0000","last_fullsized":"2024-05-14T10:12:39.853351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-05-14T10:12:39.853215+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-05-14T10:12:39.853215+0000","last_clean_scrub_stamp":"2024-05-14T10:12:39.853215+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:07:41.425370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'20","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-14T10:12:36.261996+0000","last_change":"2024-05-14T10:12:36.262155+0000","last_active":"2024-05-14T10:12:36.261996+0000","last_peered":"2024-05-14T10:12:36.261996+0000","last_clean":"2024-05-14T10:12:36.261996+0000","last_became_active":"2024-05-14T09:40:45.771228+0000","last_became_peered":"2024-05-14T09:40:45.771228+0000","last_unstale":"2024-05-14T10:12:36.261996+0000","last_undegraded":"2024-05-14T10:12:36.261996+0000","last_fullsized":"2024-05-14T10:12:36.261996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-05-14T10:12:36.261716+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-05-14T10:12:36.261716+0000","last_clean_scrub_stamp":"2024-05-14T10:12:36.261716+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:57:24.523308+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2167,"num_write_kb":250271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2329,"ondisk_log_size":2329,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1480,"ondisk_log_size":1480,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":21977357,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":432,"num_read_kb":466,"num_write":6515,"num_write_kb":24638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44105728,"data_stored":43954714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5015,"ondisk_log_size":5015,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719477132,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39728,"kb_used_data":8552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332112,"statfs":{"total":96636764160,"available":96596082688,"internally_reserved":0,"allocated":8757248,"data_stored":8538561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719477134,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":8552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":8757248,"data_stored":8537925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":16,"seq":68719477135,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40712,"kb_used_data":9536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331128,"statfs":{"total":96636764160,"available":96595075072,"internally_reserved":0,"allocated":9764864,"data_stored":9540150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719477131,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":267048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477131,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45396,"kb_used_data":5900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326444,"statfs":{"total":96636764160,"available":96590278656,"internally_reserved":0,"allocated":6041600,"data_stored":5817281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509836,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40248,"kb_used_data":13232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331592,"statfs":{"total":96636764160,"available":96595550208,"internally_reserved":0,"allocated":13549568,"data_stored":13323781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542537,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39860,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331980,"statfs":{"total":96636764160,"available":96595947520,"internally_reserved":0,"allocated":372736,"data_stored":149981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542539,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":376832,"data_stored":149547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5095424,"data_stored":5078310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":118445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9412608,"data_stored":9391547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8404992,"data_stored":8389958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12603392,"data_stored":12584810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T10:12:58.213 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-14T10:12:58.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.518+0000 7f44a0000640 1 Processor -- start 2024-05-14T10:12:58.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.519+0000 7f44a0000640 1 -- start start 2024-05-14T10:12:58.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.521+0000 7f44a0000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f449815ab20 0x7f4498153f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:58.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.521+0000 7f44a0000640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4498074ce0 con 0x7f4498071f70 2024-05-14T10:12:58.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.521+0000 7f44a0000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4498074a00 con 0x7f44981544b0 2024-05-14T10:12:58.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.521+0000 7f44a0000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f449806cde0 con 0x7f449815ab20 2024-05-14T10:12:58.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.522+0000 7f449e000640 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f4498071f70 0x7f449806d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:43348/0 (socket says 172.21.15.135:43348) 2024-05-14T10:12:58.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.522+0000 7f449e000640 1 -- 172.21.15.135:0/843281290 learned_addr learned my addr 172.21.15.135:0/843281290 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:12:58.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.524+0000 7f449d600640 1 --2- 172.21.15.135:0/843281290 >> v2:172.21.15.196:3300/0 conn(0x7f449815ab20 0x7f4498153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:58.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.525+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 978554687 0 0) 0x7f4498074ce0 con 0x7f4498071f70 2024-05-14T10:12:58.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.525+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4480003520 con 0x7f4498071f70 2024-05-14T10:12:58.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3017516839 0 0) 0x7f4480003520 con 0x7f4498071f70 2024-05-14T10:12:58.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 >> v2:172.21.15.196:3300/0 conn(0x7f449815ab20 msgr2=0x7f4498153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:58.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 --2- 172.21.15.135:0/843281290 >> v2:172.21.15.196:3300/0 conn(0x7f449815ab20 0x7f4498153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:58.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 >> v1:172.21.15.196:6789/0 conn(0x7f44981544b0 legacy=0x7f44980c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:58.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449806c790 con 0x7f4498071f70 2024-05-14T10:12:58.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7f4490001a70 con 0x7f4498071f70 2024-05-14T10:12:58.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 >> v1:172.21.15.135:6789/0 conn(0x7f4498071f70 legacy=0x7f449806d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:58.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 --2- 172.21.15.135:0/843281290 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4480003aa0 0x7f4480003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:58.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 --2- 172.21.15.135:0/843281290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 0x7f4480004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:58.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 --2- 172.21.15.135:0/843281290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4480005350 0x7f448000fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:58.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f449806cde0 con 0x7f4480004800 2024-05-14T10:12:58.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4480010660 con 0x7f4480005350 2024-05-14T10:12:58.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.529+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f4480010860 con 0x7f4480003aa0 2024-05-14T10:12:58.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.533+0000 7f449cc00640 1 --2- 172.21.15.135:0/843281290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 0x7f4480004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:58.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.537+0000 7f449cc00640 1 -- 172.21.15.135:0/843281290 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4480003aa0 msgr2=0x7f4480003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:58.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.537+0000 7f449cc00640 1 --2- 172.21.15.135:0/843281290 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4480003aa0 0x7f4480003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:58.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.537+0000 7f449cc00640 1 -- 172.21.15.135:0/843281290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4480005350 msgr2=0x7f448000fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:58.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.537+0000 7f449cc00640 1 --2- 172.21.15.135:0/843281290 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4480005350 0x7f448000fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:58.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.537+0000 7f449cc00640 1 -- 172.21.15.135:0/843281290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4480003520 con 0x7f4480004800 2024-05-14T10:12:58.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.537+0000 7f449e000640 1 -- 172.21.15.135:0/843281290 reap_dead start 2024-05-14T10:12:58.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.539+0000 7f449cc00640 1 --2- 172.21.15.135:0/843281290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 0x7f4480004c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f44980738a0 tx=0x7f4480005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0dcb8ae92527724 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:58.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.544+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44840013b0 con 0x7f4480004800 2024-05-14T10:12:58.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.544+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44840052d0 con 0x7f4480004800 2024-05-14T10:12:58.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.544+0000 7f4497e00640 1 -- 172.21.15.135:0/843281290 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448402aa50 con 0x7f4480004800 2024-05-14T10:12:58.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.545+0000 7f44a0000640 1 -- 172.21.15.135:0/843281290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 msgr2=0x7f4480004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:58.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.545+0000 7f44a0000640 1 --2- 172.21.15.135:0/843281290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 0x7f4480004c10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f44980738a0 tx=0x7f4480005830 comp rx=0 tx=0).stop 2024-05-14T10:12:58.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.545+0000 7f44a0000640 1 -- 172.21.15.135:0/843281290 shutdown_connections 2024-05-14T10:12:58.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.545+0000 7f44a0000640 1 --2- 172.21.15.135:0/843281290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 0x7f4480004c10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:58.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.545+0000 7f44a0000640 1 -- 172.21.15.135:0/843281290 >> 172.21.15.135:0/843281290 conn(0x7f4498073d40 msgr2=0x7f4498074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:58.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.546+0000 7f44a0000640 1 -- 172.21.15.135:0/843281290 shutdown_connections 2024-05-14T10:12:58.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.546+0000 7f44a0000640 1 -- 172.21.15.135:0/843281290 wait complete. 2024-05-14T10:12:58.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.548+0000 7f44a0000640 1 Processor -- start 2024-05-14T10:12:58.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.549+0000 7f44a0000640 1 -- start start 2024-05-14T10:12:58.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.550+0000 7f44a0000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 0x7f44981553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:58.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.550+0000 7f44a0000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44980c88e0 0x7f4498156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:58.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.550+0000 7f44a0000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44980c8cf0 0x7f44981573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:58.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.550+0000 7f44a0000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4498153f70 con 0x7f4480004800 2024-05-14T10:12:58.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.550+0000 7f44a0000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f44980c4690 con 0x7f44980c8cf0 2024-05-14T10:12:58.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.550+0000 7f44a0000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f44981540f0 con 0x7f44980c88e0 2024-05-14T10:12:58.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.551+0000 7f449d600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 0x7f44981553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:58.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.551+0000 7f449d600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 0x7f44981553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50984/0 (socket says 172.21.15.135:50984) 2024-05-14T10:12:58.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.551+0000 7f449d600640 1 -- 172.21.15.135:0/543353618 learned_addr learned my addr 172.21.15.135:0/543353618 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:58.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.552+0000 7f449e000640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44980c8cf0 0x7f44981573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:58.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.556+0000 7f449d600640 1 -- 172.21.15.135:0/543353618 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44980c88e0 msgr2=0x7f4498156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:58.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.556+0000 7f449d600640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44980c88e0 0x7f4498156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:58.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.556+0000 7f449d600640 1 -- 172.21.15.135:0/543353618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44980c8cf0 msgr2=0x7f44981573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:58.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.556+0000 7f449d600640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44980c8cf0 0x7f44981573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:58.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.556+0000 7f449d600640 1 -- 172.21.15.135:0/543353618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4498155900 con 0x7f4480004800 2024-05-14T10:12:58.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.559+0000 7f449d600640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 0x7f44981553c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f448c00e770 tx=0x7f448c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:58.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.563+0000 7f4495600640 1 -- 172.21.15.135:0/543353618 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c017070 con 0x7f4480004800 2024-05-14T10:12:58.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.564+0000 7f4495600640 1 -- 172.21.15.135:0/543353618 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448c00c730 con 0x7f4480004800 2024-05-14T10:12:58.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.564+0000 7f44a0000640 1 -- 172.21.15.135:0/543353618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4498151880 con 0x7f4480004800 2024-05-14T10:12:58.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.564+0000 7f4495600640 1 -- 172.21.15.135:0/543353618 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c00cb20 con 0x7f4480004800 2024-05-14T10:12:58.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.564+0000 7f44a0000640 1 -- 172.21.15.135:0/543353618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4498151b20 con 0x7f4480004800 2024-05-14T10:12:58.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.565+0000 7f44a0000640 1 -- 172.21.15.135:0/543353618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4498069a60 con 0x7f4480004800 2024-05-14T10:12:58.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.900+0000 7f4495600640 1 -- 172.21.15.135:0/543353618 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f448c01a070 con 0x7f4480004800 2024-05-14T10:12:58.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.902+0000 7f4495600640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4478076320 0x7f4478078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:58.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.902+0000 7f449cc00640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4478076320 0x7f4478078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:58.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.904+0000 7f449cc00640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4478076320 0x7f4478078830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4484032000 tx=0x7f448402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:58.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.941+0000 7f4495600640 1 -- 172.21.15.135:0/543353618 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f448c05d3b0 con 0x7f4480004800 2024-05-14T10:12:58.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:58.942+0000 7f4495600640 1 -- 172.21.15.135:0/543353618 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f448c061120 con 0x7f4480004800 2024-05-14T10:12:59.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.168+0000 7f44a0000640 1 -- 172.21.15.135:0/543353618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f4498154d30 con 0x7f4480004800 2024-05-14T10:12:59.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.403+0000 7f4495600640 1 -- 172.21.15.135:0/543353618 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f4498154d30 con 0x7f4480004800 2024-05-14T10:12:59.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.403+0000 7f4495600640 1 -- 172.21.15.135:0/543353618 <== mon.0 v2:172.21.15.135:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f448c060c30 con 0x7f4480004800 2024-05-14T10:12:59.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.407+0000 7f44a0000640 1 -- 172.21.15.135:0/543353618 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4478076320 msgr2=0x7f4478078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:59.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.407+0000 7f44a0000640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4478076320 0x7f4478078830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4484032000 tx=0x7f448402c000 comp rx=0 tx=0).stop 2024-05-14T10:12:59.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.407+0000 7f44a0000640 1 -- 172.21.15.135:0/543353618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 msgr2=0x7f44981553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:59.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.407+0000 7f44a0000640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 0x7f44981553c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f448c00e770 tx=0x7f448c00ec30 comp rx=0 tx=0).stop 2024-05-14T10:12:59.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.407+0000 7f44a0000640 1 -- 172.21.15.135:0/543353618 shutdown_connections 2024-05-14T10:12:59.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.407+0000 7f44a0000640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f4478076320 0x7f4478078830 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:59.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.407+0000 7f44a0000640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44980c8cf0 0x7f44981573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:59.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.407+0000 7f44a0000640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44980c88e0 0x7f4498156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:59.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.407+0000 7f44a0000640 1 --2- 172.21.15.135:0/543353618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4480004800 0x7f44981553c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:59.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.407+0000 7f44a0000640 1 -- 172.21.15.135:0/543353618 >> 172.21.15.135:0/543353618 conn(0x7f4498073d40 msgr2=0x7f449806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:59.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.407+0000 7f44a0000640 1 -- 172.21.15.135:0/543353618 shutdown_connections 2024-05-14T10:12:59.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.408+0000 7f44a0000640 1 -- 172.21.15.135:0/543353618 wait complete. 2024-05-14T10:12:59.447 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-14T10:12:59.447 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T10:12:59.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.710+0000 7f8019e00640 1 Processor -- start 2024-05-14T10:12:59.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.710+0000 7f8019e00640 1 -- start start 2024-05-14T10:12:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.712+0000 7f8019e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8014071de0 0x7f80141532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.712+0000 7f8019e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80140c6570 0x7f801415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.712+0000 7f8019e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80140c5590 con 0x7f80140c6160 2024-05-14T10:12:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.712+0000 7f8019e00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f80140c52b0 con 0x7f8014071de0 2024-05-14T10:12:59.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.712+0000 7f8019e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8014074920 con 0x7f80140c6570 2024-05-14T10:12:59.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.770+0000 7f8012a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8014071de0 0x7f80141532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:59.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.772+0000 7f8012a00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8014071de0 0x7f80141532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51000/0 (socket says 172.21.15.135:51000) 2024-05-14T10:12:59.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.772+0000 7f8012a00640 1 -- 172.21.15.135:0/622197782 learned_addr learned my addr 172.21.15.135:0/622197782 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:59.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.778+0000 7f8012a00640 1 -- 172.21.15.135:0/622197782 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80140c6570 msgr2=0x7f801415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:59.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.778+0000 7f8012a00640 1 --2- 172.21.15.135:0/622197782 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80140c6570 0x7f801415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:59.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.778+0000 7f8012a00640 1 -- 172.21.15.135:0/622197782 >> v1:172.21.15.196:6789/0 conn(0x7f80140c6160 legacy=0x7f801415c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:12:59.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.778+0000 7f8012a00640 1 -- 172.21.15.135:0/622197782 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80140c6980 con 0x7f8014071de0 2024-05-14T10:12:59.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.782+0000 7f8012a00640 1 --2- 172.21.15.135:0/622197782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014071de0 0x7f80141532b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8004009870 tx=0x7f800402c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a968d90b9f67bd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.793+0000 7f8012000640 1 -- 172.21.15.135:0/622197782 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8004038070 con 0x7f8014071de0 2024-05-14T10:12:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.793+0000 7f8012000640 1 -- 172.21.15.135:0/622197782 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8004031710 con 0x7f8014071de0 2024-05-14T10:12:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.793+0000 7f8012000640 1 -- 172.21.15.135:0/622197782 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8004031b00 con 0x7f8014071de0 2024-05-14T10:12:59.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.795+0000 7f8019e00640 1 -- 172.21.15.135:0/622197782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014071de0 msgr2=0x7f80141532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:59.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.795+0000 7f8019e00640 1 --2- 172.21.15.135:0/622197782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014071de0 0x7f80141532b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8004009870 tx=0x7f800402c480 comp rx=0 tx=0).stop 2024-05-14T10:12:59.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.795+0000 7f8019e00640 1 -- 172.21.15.135:0/622197782 shutdown_connections 2024-05-14T10:12:59.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.795+0000 7f8019e00640 1 --2- 172.21.15.135:0/622197782 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80140c6570 0x7f801415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:59.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.795+0000 7f8019e00640 1 --2- 172.21.15.135:0/622197782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014071de0 0x7f80141532b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:59.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.795+0000 7f8019e00640 1 -- 172.21.15.135:0/622197782 >> 172.21.15.135:0/622197782 conn(0x7f8014073cf0 msgr2=0x7f8014074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:12:59.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.795+0000 7f8019e00640 1 -- 172.21.15.135:0/622197782 shutdown_connections 2024-05-14T10:12:59.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.795+0000 7f8019e00640 1 -- 172.21.15.135:0/622197782 wait complete. 2024-05-14T10:12:59.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.801+0000 7f8019e00640 1 Processor -- start 2024-05-14T10:12:59.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.802+0000 7f8019e00640 1 -- start start 2024-05-14T10:12:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.805+0000 7f8019e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8014071de0 0x7f80141f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.805+0000 7f8019e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80140c6160 0x7f80141f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.805+0000 7f8019e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80140c6570 0x7f80141e3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.806+0000 7f8019e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80140c4c40 con 0x7f80140c6160 2024-05-14T10:12:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.806+0000 7f8019e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f801406c790 con 0x7f8014071de0 2024-05-14T10:12:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.806+0000 7f8019e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f80140c7e80 con 0x7f80140c6570 2024-05-14T10:12:59.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.806+0000 7f800a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80140c6160 0x7f80141f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:59.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.807+0000 7f800a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80140c6160 0x7f80141f3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51012/0 (socket says 172.21.15.135:51012) 2024-05-14T10:12:59.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.807+0000 7f800a000640 1 -- 172.21.15.135:0/3825827429 learned_addr learned my addr 172.21.15.135:0/3825827429 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:12:59.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.814+0000 7f8013400640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80140c6570 0x7f80141e3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.815+0000 7f8012a00640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8014071de0 0x7f80141f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.819+0000 7f800a000640 1 -- 172.21.15.135:0/3825827429 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80140c6570 msgr2=0x7f80141e3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.819+0000 7f800a000640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80140c6570 0x7f80141e3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:59.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.819+0000 7f800a000640 1 -- 172.21.15.135:0/3825827429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8014071de0 msgr2=0x7f80141f6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:12:59.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.819+0000 7f800a000640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8014071de0 0x7f80141f6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:12:59.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.819+0000 7f800a000640 1 -- 172.21.15.135:0/3825827429 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80141494f0 con 0x7f80140c6160 2024-05-14T10:12:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.825+0000 7f800a000640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80140c6160 0x7f80141f3710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00b3f0 tx=0x7f7ffc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:59.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.837+0000 7f800be00640 1 -- 172.21.15.135:0/3825827429 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc015020 con 0x7f80140c6160 2024-05-14T10:12:59.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.837+0000 7f800be00640 1 -- 172.21.15.135:0/3825827429 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7ffc011830 con 0x7f80140c6160 2024-05-14T10:12:59.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.837+0000 7f800be00640 1 -- 172.21.15.135:0/3825827429 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc011c20 con 0x7f80140c6160 2024-05-14T10:12:59.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.837+0000 7f8019e00640 1 -- 172.21.15.135:0/3825827429 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80141497d0 con 0x7f80140c6160 2024-05-14T10:12:59.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.838+0000 7f8019e00640 1 -- 172.21.15.135:0/3825827429 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80140cc6d0 con 0x7f80140c6160 2024-05-14T10:12:59.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.839+0000 7f8019e00640 1 -- 172.21.15.135:0/3825827429 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8014069a90 con 0x7f80140c6160 2024-05-14T10:12:59.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.890+0000 7f800be00640 1 -- 172.21.15.135:0/3825827429 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7ffc018020 con 0x7f80140c6160 2024-05-14T10:12:59.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.893+0000 7f800be00640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7ff0076350 0x7f7ff0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:12:59.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.894+0000 7f8012a00640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7ff0076350 0x7f7ff0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:12:59.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.896+0000 7f8012a00640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7ff0076350 0x7f7ff0078860 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8004035000 tx=0x7f8004008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:12:59.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:12:59.902+0000 7f800be00640 1 -- 172.21.15.135:0/3825827429 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f7ffc011dc0 con 0x7f80140c6160 2024-05-14T10:13:00.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.259+0000 7f800be00640 1 -- 172.21.15.135:0/3825827429 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7ffc01f020 con 0x7f80140c6160 2024-05-14T10:13:00.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.525+0000 7f8019e00640 1 -- 172.21.15.135:0/3825827429 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8014073ad0 con 0x7f80140c6160 2024-05-14T10:13:00.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.574+0000 7f800be00640 1 -- 172.21.15.135:0/3825827429 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6888 (secure 0 0 0) 0x7f7ffc060d50 con 0x7f80140c6160 2024-05-14T10:13:00.573 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T10:13:00.574 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4032169993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4032169993},{"type":"v1","addr":"172.21.15.135:6837","nonce":4032169993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/1397919075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":1397919075},{"type":"v1","addr":"172.21.15.196:6833","nonce":1397919075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/4240420134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":4240420134},{"type":"v1","addr":"172.21.15.196:6835","nonce":4240420134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T09:40:45.555908+0000","modified":"2024-05-14T09:41:31.018579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4255,"mds_1":4252,"mds_2":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":15,"addr":"172.21.15.135:6835/3270089159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3270089159},{"type":"v1","addr":"172.21.15.135:6835","nonce":3270089159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4252":{"gid":4252,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":14,"addr":"172.21.15.135:6839/2302038485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2302038485},{"type":"v1","addr":"172.21.15.135:6839","nonce":2302038485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6837/3644723215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3644723215},{"type":"v1","addr":"172.21.15.196:6837","nonce":3644723215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4240,4252,4255]},"id":1}]} 2024-05-14T10:13:00.574 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 14 2024-05-14T10:13:00.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 -- 172.21.15.135:0/3825827429 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7ff0076350 msgr2=0x7f7ff0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:00.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7ff0076350 0x7f7ff0078860 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8004035000 tx=0x7f8004008030 comp rx=0 tx=0).stop 2024-05-14T10:13:00.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 -- 172.21.15.135:0/3825827429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80140c6160 msgr2=0x7f80141f3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:00.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80140c6160 0x7f80141f3710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00b3f0 tx=0x7f7ffc00b8b0 comp rx=0 tx=0).stop 2024-05-14T10:13:00.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 -- 172.21.15.135:0/3825827429 shutdown_connections 2024-05-14T10:13:00.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7ff0076350 0x7f7ff0078860 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:00.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f80140c6570 0x7f80141e3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:00.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80140c6160 0x7f80141f3710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:00.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 --2- 172.21.15.135:0/3825827429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8014071de0 0x7f80141f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:00.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 -- 172.21.15.135:0/3825827429 >> 172.21.15.135:0/3825827429 conn(0x7f8014073cf0 msgr2=0x7f801414b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:00.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 -- 172.21.15.135:0/3825827429 shutdown_connections 2024-05-14T10:13:00.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.578+0000 7f8019e00640 1 -- 172.21.15.135:0/3825827429 wait complete. 2024-05-14T10:13:00.609 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T10:13:00.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.886+0000 7fe170200640 1 Processor -- start 2024-05-14T10:13:00.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.887+0000 7fe170200640 1 -- start start 2024-05-14T10:13:00.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.889+0000 7fe170200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe168071fe0 0x7fe168154550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:00.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.889+0000 7fe170200640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16815b160 con 0x7fe168074810 2024-05-14T10:13:00.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.889+0000 7fe170200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16815ae80 con 0x7fe1680c84d0 2024-05-14T10:13:00.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.889+0000 7fe170200640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fe16815ac30 con 0x7fe168071fe0 2024-05-14T10:13:00.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.890+0000 7fe16e200640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fe1680c84d0 0x7fe1680c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:34436/0 (socket says 172.21.15.135:34436) 2024-05-14T10:13:00.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.891+0000 7fe16e200640 1 -- 172.21.15.135:0/453642898 learned_addr learned my addr 172.21.15.135:0/453642898 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:13:00.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.897+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3947537440 0 0) 0x7fe16815ae80 con 0x7fe1680c84d0 2024-05-14T10:13:00.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.897+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe150003520 con 0x7fe1680c84d0 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1079169957 0 0) 0x7fe150003520 con 0x7fe1680c84d0 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 >> v2:172.21.15.135:3300/0 conn(0x7fe168071fe0 msgr2=0x7fe168154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 --2- 172.21.15.135:0/453642898 >> v2:172.21.15.135:3300/0 conn(0x7fe168071fe0 0x7fe168154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 >> v1:172.21.15.135:6789/0 conn(0x7fe168074810 legacy=0x7fe1680c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1680c8ce0 con 0x7fe1680c84d0 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2908980752 0 0) 0x7fe160001a70 con 0x7fe1680c84d0 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 >> v1:172.21.15.196:6789/0 conn(0x7fe1680c84d0 legacy=0x7fe1680c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 --2- 172.21.15.135:0/453642898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe150003a50 0x7fe150003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 --2- 172.21.15.135:0/453642898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe150004800 0x7fe150004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 --2- 172.21.15.135:0/453642898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1500053f0 0x7fe15000fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe16815ac30 con 0x7fe150004800 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe150010770 con 0x7fe1500053f0 2024-05-14T10:13:00.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.908+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe150010970 con 0x7fe150003a50 2024-05-14T10:13:00.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.910+0000 7fe16d800640 1 --2- 172.21.15.135:0/453642898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe150003a50 0x7fe150003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:00.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.912+0000 7fe16ce00640 1 --2- 172.21.15.135:0/453642898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe150004800 0x7fe150004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:00.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.920+0000 7fe16d800640 1 -- 172.21.15.135:0/453642898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1500053f0 msgr2=0x7fe15000fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:00.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.920+0000 7fe16d800640 1 --2- 172.21.15.135:0/453642898 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1500053f0 0x7fe15000fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:00.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.920+0000 7fe16d800640 1 -- 172.21.15.135:0/453642898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe150004800 msgr2=0x7fe150004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:00.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.920+0000 7fe16d800640 1 --2- 172.21.15.135:0/453642898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe150004800 0x7fe150004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:00.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.920+0000 7fe16d800640 1 -- 172.21.15.135:0/453642898 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe150003520 con 0x7fe150003a50 2024-05-14T10:13:00.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.920+0000 7fe16e200640 1 -- 172.21.15.135:0/453642898 reap_dead start 2024-05-14T10:13:00.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.926+0000 7fe16d800640 1 --2- 172.21.15.135:0/453642898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe150003a50 0x7fe150003ea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009860 tx=0x7fe150005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c249d421f0e7cdf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:00.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.936+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c037070 con 0x7fe150003a50 2024-05-14T10:13:00.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.936+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe15c02aa70 con 0x7fe150003a50 2024-05-14T10:13:00.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.936+0000 7fe167e00640 1 -- 172.21.15.135:0/453642898 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c009460 con 0x7fe150003a50 2024-05-14T10:13:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.938+0000 7fe170200640 1 -- 172.21.15.135:0/453642898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe150003a50 msgr2=0x7fe150003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.938+0000 7fe170200640 1 --2- 172.21.15.135:0/453642898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe150003a50 0x7fe150003ea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009860 tx=0x7fe150005830 comp rx=0 tx=0).stop 2024-05-14T10:13:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.938+0000 7fe170200640 1 -- 172.21.15.135:0/453642898 shutdown_connections 2024-05-14T10:13:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.938+0000 7fe170200640 1 --2- 172.21.15.135:0/453642898 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe150003a50 0x7fe150003ea0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.938+0000 7fe170200640 1 -- 172.21.15.135:0/453642898 >> 172.21.15.135:0/453642898 conn(0x7fe168073cf0 msgr2=0x7fe168074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.938+0000 7fe170200640 1 -- 172.21.15.135:0/453642898 shutdown_connections 2024-05-14T10:13:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.939+0000 7fe170200640 1 -- 172.21.15.135:0/453642898 wait complete. 2024-05-14T10:13:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.942+0000 7fe170200640 1 Processor -- start 2024-05-14T10:13:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.942+0000 7fe170200640 1 -- start start 2024-05-14T10:13:00.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.944+0000 7fe170200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe150003a50 0x7fe1681ef700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:00.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.945+0000 7fe170200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe168150610 0x7fe1680cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:00.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.945+0000 7fe170200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe16814e840 0x7fe16814ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:00.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.945+0000 7fe170200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe1680c88e0 con 0x7fe168150610 2024-05-14T10:13:00.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.945+0000 7fe170200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe1680c92a0 con 0x7fe16814e840 2024-05-14T10:13:00.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.945+0000 7fe170200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fe16806c6f0 con 0x7fe150003a50 2024-05-14T10:13:00.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.946+0000 7fe16ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe168150610 0x7fe1680cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:00.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.946+0000 7fe16ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe168150610 0x7fe1680cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51040/0 (socket says 172.21.15.135:51040) 2024-05-14T10:13:00.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.946+0000 7fe16ce00640 1 -- 172.21.15.135:0/3374011776 learned_addr learned my addr 172.21.15.135:0/3374011776 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:13:00.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.946+0000 7fe16e200640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe16814e840 0x7fe16814ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:00.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.947+0000 7fe16d800640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe150003a50 0x7fe1681ef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:00.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.952+0000 7fe16ce00640 1 -- 172.21.15.135:0/3374011776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe150003a50 msgr2=0x7fe1681ef700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:00.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.952+0000 7fe16ce00640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe150003a50 0x7fe1681ef700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:00.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.952+0000 7fe16ce00640 1 -- 172.21.15.135:0/3374011776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe16814e840 msgr2=0x7fe16814ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:00.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.952+0000 7fe16ce00640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe16814e840 0x7fe16814ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:00.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.952+0000 7fe16ce00640 1 -- 172.21.15.135:0/3374011776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1681efc40 con 0x7fe168150610 2024-05-14T10:13:00.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.955+0000 7fe16ce00640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe168150610 0x7fe1680cc4b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe15400e440 tx=0x7fe15400e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.961+0000 7fe165600640 1 -- 172.21.15.135:0/3374011776 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154019070 con 0x7fe168150610 2024-05-14T10:13:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.961+0000 7fe165600640 1 -- 172.21.15.135:0/3374011776 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe154005320 con 0x7fe168150610 2024-05-14T10:13:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.961+0000 7fe165600640 1 -- 172.21.15.135:0/3374011776 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154007290 con 0x7fe168150610 2024-05-14T10:13:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.961+0000 7fe170200640 1 -- 172.21.15.135:0/3374011776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe168149220 con 0x7fe168150610 2024-05-14T10:13:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.961+0000 7fe170200640 1 -- 172.21.15.135:0/3374011776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1681497e0 con 0x7fe168150610 2024-05-14T10:13:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:00.963+0000 7fe170200640 1 -- 172.21.15.135:0/3374011776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe168069a90 con 0x7fe168150610 2024-05-14T10:13:01.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.299+0000 7fe165600640 1 -- 172.21.15.135:0/3374011776 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe15401c070 con 0x7fe168150610 2024-05-14T10:13:01.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.300+0000 7fe165600640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe148076350 0x7fe148078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:01.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.301+0000 7fe16d800640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe148076350 0x7fe148078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:01.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.302+0000 7fe16d800640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe148076350 0x7fe148078860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe15c034000 tx=0x7fe15c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:01.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.339+0000 7fe165600640 1 -- 172.21.15.135:0/3374011776 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7fe15405c590 con 0x7fe168150610 2024-05-14T10:13:01.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.340+0000 7fe165600640 1 -- 172.21.15.135:0/3374011776 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe154023020 con 0x7fe168150610 2024-05-14T10:13:01.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.603+0000 7fe170200640 1 -- 172.21.15.135:0/3374011776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe168157bd0 con 0x7fe168150610 2024-05-14T10:13:01.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.639+0000 7fe165600640 1 -- 172.21.15.135:0/3374011776 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6888 (secure 0 0 0) 0x7fe154060300 con 0x7fe168150610 2024-05-14T10:13:01.639 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T10:13:01.639 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4032169993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4032169993},{"type":"v1","addr":"172.21.15.135:6837","nonce":4032169993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/1397919075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":1397919075},{"type":"v1","addr":"172.21.15.196:6833","nonce":1397919075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/4240420134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":4240420134},{"type":"v1","addr":"172.21.15.196:6835","nonce":4240420134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T09:40:45.555908+0000","modified":"2024-05-14T09:41:31.018579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4255,"mds_1":4252,"mds_2":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":15,"addr":"172.21.15.135:6835/3270089159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3270089159},{"type":"v1","addr":"172.21.15.135:6835","nonce":3270089159}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4252":{"gid":4252,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":14,"addr":"172.21.15.135:6839/2302038485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2302038485},{"type":"v1","addr":"172.21.15.135:6839","nonce":2302038485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6837/3644723215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3644723215},{"type":"v1","addr":"172.21.15.196:6837","nonce":3644723215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4240,4252,4255]},"id":1}]} 2024-05-14T10:13:01.639 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 14 2024-05-14T10:13:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.642+0000 7fe170200640 1 -- 172.21.15.135:0/3374011776 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe148076350 msgr2=0x7fe148078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.642+0000 7fe170200640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe148076350 0x7fe148078860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe15c034000 tx=0x7fe15c02e000 comp rx=0 tx=0).stop 2024-05-14T10:13:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.642+0000 7fe170200640 1 -- 172.21.15.135:0/3374011776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe168150610 msgr2=0x7fe1680cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.643+0000 7fe170200640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe168150610 0x7fe1680cc4b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe15400e440 tx=0x7fe15400e900 comp rx=0 tx=0).stop 2024-05-14T10:13:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.643+0000 7fe170200640 1 -- 172.21.15.135:0/3374011776 shutdown_connections 2024-05-14T10:13:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.643+0000 7fe170200640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7fe148076350 0x7fe148078860 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.643+0000 7fe170200640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe16814e840 0x7fe16814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.643+0000 7fe170200640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe168150610 0x7fe1680cc4b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.643+0000 7fe170200640 1 --2- 172.21.15.135:0/3374011776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe150003a50 0x7fe1681ef700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.643+0000 7fe170200640 1 -- 172.21.15.135:0/3374011776 >> 172.21.15.135:0/3374011776 conn(0x7fe168073cf0 msgr2=0x7fe16815a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.643+0000 7fe170200640 1 -- 172.21.15.135:0/3374011776 shutdown_connections 2024-05-14T10:13:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.643+0000 7fe170200640 1 -- 172.21.15.135:0/3374011776 wait complete. 2024-05-14T10:13:01.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T10:13:01.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.941+0000 7f7586e00640 1 Processor -- start 2024-05-14T10:13:01.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.941+0000 7f7586e00640 1 -- start start 2024-05-14T10:13:01.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.944+0000 7f7586e00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f75800c66d0 0x7f75800cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:01.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.944+0000 7f7586e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7580152df0 0x7f75800cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:01.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.944+0000 7f7586e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758015ced0 con 0x7f75800cd370 2024-05-14T10:13:01.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.944+0000 7f7586e00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f758015d170 con 0x7f75800c66d0 2024-05-14T10:13:01.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.944+0000 7f7586e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f758006c790 con 0x7f7580152df0 2024-05-14T10:13:01.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.947+0000 7f7586400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f75800cd370 0x7f758006d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:34438/0 (socket says 172.21.15.135:34438) 2024-05-14T10:13:01.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.947+0000 7f7586400640 1 -- 172.21.15.135:0/2467062440 learned_addr learned my addr 172.21.15.135:0/2467062440 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:13:01.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.947+0000 7f7585a00640 1 --2- 172.21.15.135:0/2467062440 >> v2:172.21.15.135:3300/0 conn(0x7f75800c66d0 0x7f75800cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:01.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.947+0000 7f7585000640 1 --2- 172.21.15.135:0/2467062440 >> v2:172.21.15.196:3300/0 conn(0x7f7580152df0 0x7f75800cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:01.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.954+0000 7f7585a00640 1 -- 172.21.15.135:0/2467062440 >> v2:172.21.15.196:3300/0 conn(0x7f7580152df0 msgr2=0x7f75800cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:01.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.954+0000 7f7585a00640 1 --2- 172.21.15.135:0/2467062440 >> v2:172.21.15.196:3300/0 conn(0x7f7580152df0 0x7f75800cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:01.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.954+0000 7f7585a00640 1 -- 172.21.15.135:0/2467062440 >> v1:172.21.15.196:6789/0 conn(0x7f75800cd370 legacy=0x7f758006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:01.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.954+0000 7f7585a00640 1 -- 172.21.15.135:0/2467062440 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758006ca70 con 0x7f75800c66d0 2024-05-14T10:13:01.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:01.964+0000 7f7585a00640 1 --2- 172.21.15.135:0/2467062440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75800c66d0 0x7f75800cdbe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f758015d0a0 tx=0x7f757402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5152048a7b5ac2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:02.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.050+0000 7f757fe00640 1 -- 172.21.15.135:0/2467062440 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574037070 con 0x7f75800c66d0 2024-05-14T10:13:02.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.050+0000 7f757fe00640 1 -- 172.21.15.135:0/2467062440 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7574032440 con 0x7f75800c66d0 2024-05-14T10:13:02.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.050+0000 7f757fe00640 1 -- 172.21.15.135:0/2467062440 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574032830 con 0x7f75800c66d0 2024-05-14T10:13:02.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.051+0000 7f7586e00640 1 -- 172.21.15.135:0/2467062440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75800c66d0 msgr2=0x7f75800cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:02.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.051+0000 7f7586e00640 1 --2- 172.21.15.135:0/2467062440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75800c66d0 0x7f75800cdbe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f758015d0a0 tx=0x7f757402a230 comp rx=0 tx=0).stop 2024-05-14T10:13:02.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.052+0000 7f7586e00640 1 -- 172.21.15.135:0/2467062440 shutdown_connections 2024-05-14T10:13:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.052+0000 7f7586e00640 1 --2- 172.21.15.135:0/2467062440 >> v2:172.21.15.196:3300/0 conn(0x7f7580152df0 0x7f75800cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.052+0000 7f7586e00640 1 --2- 172.21.15.135:0/2467062440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75800c66d0 0x7f75800cdbe0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.052+0000 7f7586e00640 1 -- 172.21.15.135:0/2467062440 >> 172.21.15.135:0/2467062440 conn(0x7f75800ce650 msgr2=0x7f75800cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.052+0000 7f7586e00640 1 -- 172.21.15.135:0/2467062440 shutdown_connections 2024-05-14T10:13:02.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.052+0000 7f7586e00640 1 -- 172.21.15.135:0/2467062440 wait complete. 2024-05-14T10:13:02.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.057+0000 7f7586e00640 1 Processor -- start 2024-05-14T10:13:02.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.057+0000 7f7586e00640 1 -- start start 2024-05-14T10:13:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.061+0000 7f7586e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75800c66d0 0x7f7580150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.061+0000 7f7586e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75800cd370 0x7f758014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.061+0000 7f7586e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7580152df0 0x7f758014e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.061+0000 7f7586e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f75800b42e0 con 0x7f75800c66d0 2024-05-14T10:13:02.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.061+0000 7f7586e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f758006d030 con 0x7f7580152df0 2024-05-14T10:13:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.061+0000 7f7586e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f75800b4460 con 0x7f75800cd370 2024-05-14T10:13:02.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.062+0000 7f7585000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75800cd370 0x7f758014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.063+0000 7f7585a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75800c66d0 0x7f7580150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.063+0000 7f7585000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75800cd370 0x7f758014e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.135:49504/0 (socket says 172.21.15.135:49504) 2024-05-14T10:13:02.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.063+0000 7f7585000640 1 -- 172.21.15.135:0/2830024610 learned_addr learned my addr 172.21.15.135:0/2830024610 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:13:02.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.066+0000 7f7586400640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7580152df0 0x7f758014e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:02.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.068+0000 7f7585a00640 1 -- 172.21.15.135:0/2830024610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75800cd370 msgr2=0x7f758014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:02.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.068+0000 7f7585a00640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75800cd370 0x7f758014e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:02.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.068+0000 7f7585a00640 1 -- 172.21.15.135:0/2830024610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7580152df0 msgr2=0x7f758014e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:02.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.068+0000 7f7585a00640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7580152df0 0x7f758014e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:02.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.068+0000 7f7585a00640 1 -- 172.21.15.135:0/2830024610 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75800d12b0 con 0x7f75800c66d0 2024-05-14T10:13:02.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.071+0000 7f7585a00640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75800c66d0 0x7f7580150410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7574031000 tx=0x7f75740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:02.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.076+0000 7f757d600640 1 -- 172.21.15.135:0/2830024610 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574037070 con 0x7f75800c66d0 2024-05-14T10:13:02.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.076+0000 7f757d600640 1 -- 172.21.15.135:0/2830024610 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7574042070 con 0x7f75800c66d0 2024-05-14T10:13:02.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.077+0000 7f757d600640 1 -- 172.21.15.135:0/2830024610 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574030e40 con 0x7f75800c66d0 2024-05-14T10:13:02.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.077+0000 7f7586e00640 1 -- 172.21.15.135:0/2830024610 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75801e8b00 con 0x7f75800c66d0 2024-05-14T10:13:02.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.077+0000 7f7586e00640 1 -- 172.21.15.135:0/2830024610 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75801e90c0 con 0x7f75800c66d0 2024-05-14T10:13:02.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.078+0000 7f7586e00640 1 -- 172.21.15.135:0/2830024610 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7580069980 con 0x7f75800c66d0 2024-05-14T10:13:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.105+0000 7f757d600640 1 -- 172.21.15.135:0/2830024610 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7574047460 con 0x7f75800c66d0 2024-05-14T10:13:02.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.107+0000 7f757d600640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7560076320 0x7f7560078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:02.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.107+0000 7f7585000640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7560076320 0x7f7560078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:02.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.108+0000 7f757d600640 1 -- 172.21.15.135:0/2830024610 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7f7574032440 con 0x7f75800c66d0 2024-05-14T10:13:02.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.109+0000 7f7585000640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7560076320 0x7f7560078830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f75800cfa00 tx=0x7f756c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:02.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.466+0000 7f757d600640 1 -- 172.21.15.135:0/2830024610 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f757404d060 con 0x7f75800c66d0 2024-05-14T10:13:02.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.701+0000 7f7586e00640 1 -- 172.21.15.135:0/2830024610 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75800b7830 con 0x7f75800c66d0 2024-05-14T10:13:02.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.753+0000 7f757d600640 1 -- 172.21.15.135:0/2830024610 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+18997 (secure 0 0 0) 0x7f7574082390 con 0x7f75800c66d0 2024-05-14T10:13:02.753 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-14T10:13:02.753 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":33,"fsid":"3d7e4a56-2293-41af-9139-c92eede1b811","created":"2024-05-14T09:39:53.738882+0000","modified":"2024-05-14T09:41:04.087625+0000","last_up_change":"2024-05-14T09:40:19.470930+0000","last_in_change":"2024-05-14T09:40:08.507187+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T09:40:17.032087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T09:40:40.770106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T09:40:43.375791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T09:40:51.210089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea745758-5a6b-44a4-a1f7-b1bbbb8e1b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6811","nonce":2395598420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6813","nonce":2395598420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6817","nonce":2395598420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2395598420},{"type":"v1","addr":"172.21.15.135:6815","nonce":2395598420}]},"public_addr":"172.21.15.135:6811/2395598420","cluster_addr":"172.21.15.135:6813/2395598420","heartbeat_back_addr":"172.21.15.135:6817/2395598420","heartbeat_front_addr":"172.21.15.135:6815/2395598420","state":["exists","up"]},{"osd":1,"uuid":"12b12d4a-1242-4630-afc3-14bf24bfb26e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6819","nonce":2447766167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6821","nonce":2447766167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6825","nonce":2447766167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2447766167},{"type":"v1","addr":"172.21.15.135:6823","nonce":2447766167}]},"public_addr":"172.21.15.135:6819/2447766167","cluster_addr":"172.21.15.135:6821/2447766167","heartbeat_back_addr":"172.21.15.135:6825/2447766167","heartbeat_front_addr":"172.21.15.135:6823/2447766167","state":["exists","up"]},{"osd":2,"uuid":"0e05891c-f772-4ff0-926b-8503fcb9223b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6827","nonce":3157168741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6829","nonce":3157168741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6833","nonce":3157168741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3157168741},{"type":"v1","addr":"172.21.15.135:6831","nonce":3157168741}]},"public_addr":"172.21.15.135:6827/3157168741","cluster_addr":"172.21.15.135:6829/3157168741","heartbeat_back_addr":"172.21.15.135:6833/3157168741","heartbeat_front_addr":"172.21.15.135:6831/3157168741","state":["exists","up"]},{"osd":3,"uuid":"8fa7fe0d-d8c8-4292-9761-e19514a8ee4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6803","nonce":3064760126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6805","nonce":3064760126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6809","nonce":3064760126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3064760126},{"type":"v1","addr":"172.21.15.135:6807","nonce":3064760126}]},"public_addr":"172.21.15.135:6803/3064760126","cluster_addr":"172.21.15.135:6805/3064760126","heartbeat_back_addr":"172.21.15.135:6809/3064760126","heartbeat_front_addr":"172.21.15.135:6807/3064760126","state":["exists","up"]},{"osd":4,"uuid":"061a08d5-a3d9-43d1-a153-857d5ce2bf1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6813","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6816","nonce":710239496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6821","nonce":710239496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6831","nonce":710239496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6825","nonce":710239496},{"type":"v1","addr":"172.21.15.196:6828","nonce":710239496}]},"public_addr":"172.21.15.196:6816/710239496","cluster_addr":"172.21.15.196:6821/710239496","heartbeat_back_addr":"172.21.15.196:6831/710239496","heartbeat_front_addr":"172.21.15.196:6828/710239496","state":["exists","up"]},{"osd":5,"uuid":"46f9b266-db51-42fe-8a9b-65c2cf2ddfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6809","nonce":1160661510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6811","nonce":1160661510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6815","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6817","nonce":1160661510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":1160661510},{"type":"v1","addr":"172.21.15.196:6814","nonce":1160661510}]},"public_addr":"172.21.15.196:6809/1160661510","cluster_addr":"172.21.15.196:6811/1160661510","heartbeat_back_addr":"172.21.15.196:6817/1160661510","heartbeat_front_addr":"172.21.15.196:6814/1160661510","state":["exists","up"]},{"osd":6,"uuid":"722ee974-e43e-4391-b03b-3c2095efb4df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6820","nonce":2170854383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6823","nonce":2170854383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6829","nonce":2170854383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":2170854383},{"type":"v1","addr":"172.21.15.196:6826","nonce":2170854383}]},"public_addr":"172.21.15.196:6820/2170854383","cluster_addr":"172.21.15.196:6823/2170854383","heartbeat_back_addr":"172.21.15.196:6829/2170854383","heartbeat_front_addr":"172.21.15.196:6826/2170854383","state":["exists","up"]},{"osd":7,"uuid":"a7339c9e-f78e-4d4f-a32e-63464c3a601f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6801","nonce":3759821371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6803","nonce":3759821371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6807","nonce":3759821371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":3759821371},{"type":"v1","addr":"172.21.15.196:6805","nonce":3759821371}]},"public_addr":"172.21.15.196:6801/3759821371","cluster_addr":"172.21.15.196:6803/3759821371","heartbeat_back_addr":"172.21.15.196:6807/3759821371","heartbeat_front_addr":"172.21.15.196:6805/3759821371","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.511832+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.242796+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.569577+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.501103+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.397874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.328170+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.296784+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T09:40:14.491633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T10:13:02.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.756+0000 7f7586e00640 1 -- 172.21.15.135:0/2830024610 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7560076320 msgr2=0x7f7560078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:02.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.756+0000 7f7586e00640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7560076320 0x7f7560078830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f75800cfa00 tx=0x7f756c009190 comp rx=0 tx=0).stop 2024-05-14T10:13:02.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.756+0000 7f7586e00640 1 -- 172.21.15.135:0/2830024610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75800c66d0 msgr2=0x7f7580150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:02.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.756+0000 7f7586e00640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75800c66d0 0x7f7580150410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7574031000 tx=0x7f75740046c0 comp rx=0 tx=0).stop 2024-05-14T10:13:02.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.757+0000 7f7586e00640 1 -- 172.21.15.135:0/2830024610 shutdown_connections 2024-05-14T10:13:02.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.757+0000 7f7586e00640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f7560076320 0x7f7560078830 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:02.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.757+0000 7f7586e00640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7580152df0 0x7f758014e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:02.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.757+0000 7f7586e00640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75800cd370 0x7f758014e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:02.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.757+0000 7f7586e00640 1 --2- 172.21.15.135:0/2830024610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75800c66d0 0x7f7580150410 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:02.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.757+0000 7f7586e00640 1 -- 172.21.15.135:0/2830024610 >> 172.21.15.135:0/2830024610 conn(0x7f75800ce650 msgr2=0x7f75800c7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:02.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.757+0000 7f7586e00640 1 -- 172.21.15.135:0/2830024610 shutdown_connections 2024-05-14T10:13:02.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:02.757+0000 7f7586e00640 1 -- 172.21.15.135:0/2830024610 wait complete. 2024-05-14T10:13:02.783 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-14T10:13:03.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.059+0000 7ff8ae200640 1 Processor -- start 2024-05-14T10:13:03.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.059+0000 7ff8ae200640 1 -- start start 2024-05-14T10:13:03.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.061+0000 7ff8ae200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff8a8152ed0 0x7ff8a81532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:03.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.062+0000 7ff8ae200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff8a80c60a0 0x7ff8a80c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:03.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.062+0000 7ff8ae200640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8a80c5900 con 0x7ff8a815c610 2024-05-14T10:13:03.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.062+0000 7ff8ae200640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7ff8a815a510 con 0x7ff8a8152ed0 2024-05-14T10:13:03.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.062+0000 7ff8ae200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7ff8a806c6f0 con 0x7ff8a80c60a0 2024-05-14T10:13:03.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.127+0000 7ff8a6a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff8a80c60a0 0x7ff8a80c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:03.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.129+0000 7ff8a6a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff8a80c60a0 0x7ff8a80c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:59464/0 (socket says 172.21.15.135:59464) 2024-05-14T10:13:03.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.129+0000 7ff8a6a00640 1 -- 172.21.15.135:0/1754100210 learned_addr learned my addr 172.21.15.135:0/1754100210 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:13:03.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.129+0000 7ff8a7400640 1 --2- 172.21.15.135:0/1754100210 >> v2:172.21.15.135:3300/0 conn(0x7ff8a8152ed0 0x7ff8a81532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:03.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.140+0000 7ff8a6a00640 1 -- 172.21.15.135:0/1754100210 >> v2:172.21.15.135:3300/0 conn(0x7ff8a8152ed0 msgr2=0x7ff8a81532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:03.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.140+0000 7ff8a6a00640 1 --2- 172.21.15.135:0/1754100210 >> v2:172.21.15.135:3300/0 conn(0x7ff8a8152ed0 0x7ff8a81532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:03.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.140+0000 7ff8a6a00640 1 -- 172.21.15.135:0/1754100210 >> v1:172.21.15.135:6789/0 conn(0x7ff8a815c610 legacy=0x7ff8a815ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:03.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.140+0000 7ff8a6a00640 1 -- 172.21.15.135:0/1754100210 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a815d290 con 0x7ff8a80c60a0 2024-05-14T10:13:03.140 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:13:03.150 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:13:03.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.147+0000 7ff8a6a00640 1 --2- 172.21.15.135:0/1754100210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8a80c60a0 0x7ff8a80c64b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff894009870 tx=0x7ff89402a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a35970c97c946b7e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:03.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.157+0000 7ff8a6000640 1 -- 172.21.15.135:0/1754100210 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894037070 con 0x7ff8a80c60a0 2024-05-14T10:13:03.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.158+0000 7ff8a6000640 1 -- 172.21.15.135:0/1754100210 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff894032440 con 0x7ff8a80c60a0 2024-05-14T10:13:03.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.158+0000 7ff8a6000640 1 -- 172.21.15.135:0/1754100210 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894032830 con 0x7ff8a80c60a0 2024-05-14T10:13:03.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.159+0000 7ff8ae200640 1 -- 172.21.15.135:0/1754100210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8a80c60a0 msgr2=0x7ff8a80c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:03.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.159+0000 7ff8ae200640 1 --2- 172.21.15.135:0/1754100210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8a80c60a0 0x7ff8a80c64b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff894009870 tx=0x7ff89402a2a0 comp rx=0 tx=0).stop 2024-05-14T10:13:03.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.159+0000 7ff8ae200640 1 -- 172.21.15.135:0/1754100210 shutdown_connections 2024-05-14T10:13:03.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.159+0000 7ff8ae200640 1 --2- 172.21.15.135:0/1754100210 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8a80c60a0 0x7ff8a80c64b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:03.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.159+0000 7ff8ae200640 1 --2- 172.21.15.135:0/1754100210 >> v2:172.21.15.135:3300/0 conn(0x7ff8a8152ed0 0x7ff8a81532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:03.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.159+0000 7ff8ae200640 1 -- 172.21.15.135:0/1754100210 >> 172.21.15.135:0/1754100210 conn(0x7ff8a8073d40 msgr2=0x7ff8a8074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:03.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.160+0000 7ff8ae200640 1 -- 172.21.15.135:0/1754100210 shutdown_connections 2024-05-14T10:13:03.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.160+0000 7ff8ae200640 1 -- 172.21.15.135:0/1754100210 wait complete. 2024-05-14T10:13:03.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.162+0000 7ff8ae200640 1 Processor -- start 2024-05-14T10:13:03.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.163+0000 7ff8ae200640 1 -- start start 2024-05-14T10:13:03.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.164+0000 7ff8ae200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a80c60a0 0x7ff8a80c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:03.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.164+0000 7ff8ae200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8a8152ed0 0x7ff8a8150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:03.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.164+0000 7ff8ae200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8a815c610 0x7ff8a814ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:03.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.164+0000 7ff8ae200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a80c69f0 con 0x7ff8a80c60a0 2024-05-14T10:13:03.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.164+0000 7ff8ae200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a80c5c10 con 0x7ff8a8152ed0 2024-05-14T10:13:03.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.164+0000 7ff8ae200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7ff8a806cc20 con 0x7ff8a815c610 2024-05-14T10:13:03.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.165+0000 7ff8a7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a80c60a0 0x7ff8a80c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:03.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.166+0000 7ff8a7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a80c60a0 0x7ff8a80c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51086/0 (socket says 172.21.15.135:51086) 2024-05-14T10:13:03.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.166+0000 7ff8a7400640 1 -- 172.21.15.135:0/3365245530 learned_addr learned my addr 172.21.15.135:0/3365245530 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:13:03.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.166+0000 7ff8a7e00640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8a815c610 0x7ff8a814ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:03.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.166+0000 7ff8a6a00640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8a8152ed0 0x7ff8a8150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:03.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.171+0000 7ff8a7400640 1 -- 172.21.15.135:0/3365245530 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8a815c610 msgr2=0x7ff8a814ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:03.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.171+0000 7ff8a7400640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8a815c610 0x7ff8a814ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:03.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.171+0000 7ff8a7400640 1 -- 172.21.15.135:0/3365245530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8a8152ed0 msgr2=0x7ff8a8150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:03.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.171+0000 7ff8a7400640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8a8152ed0 0x7ff8a8150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:03.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.171+0000 7ff8a7400640 1 -- 172.21.15.135:0/3365245530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a80c8c30 con 0x7ff8a80c60a0 2024-05-14T10:13:03.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.174+0000 7ff8a7400640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a80c60a0 0x7ff8a80c86f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff89800e8a0 tx=0x7ff89800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:03.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.179+0000 7ff89f400640 1 -- 172.21.15.135:0/3365245530 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898017070 con 0x7ff8a80c60a0 2024-05-14T10:13:03.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.179+0000 7ff89f400640 1 -- 172.21.15.135:0/3365245530 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff89800c940 con 0x7ff8a80c60a0 2024-05-14T10:13:03.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.179+0000 7ff89f400640 1 -- 172.21.15.135:0/3365245530 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89800cd50 con 0x7ff8a80c60a0 2024-05-14T10:13:03.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.179+0000 7ff8ae200640 1 -- 172.21.15.135:0/3365245530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a8151500 con 0x7ff8a80c60a0 2024-05-14T10:13:03.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.179+0000 7ff8ae200640 1 -- 172.21.15.135:0/3365245530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a814a770 con 0x7ff8a80c60a0 2024-05-14T10:13:03.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.181+0000 7ff8ae200640 1 -- 172.21.15.135:0/3365245530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a8069a60 con 0x7ff8a80c60a0 2024-05-14T10:13:03.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.210+0000 7ff89f400640 1 -- 172.21.15.135:0/3365245530 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff89801a070 con 0x7ff8a80c60a0 2024-05-14T10:13:03.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.211+0000 7ff89f400640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff8880762d0 0x7ff8880787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:03.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.212+0000 7ff8a6a00640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff8880762d0 0x7ff8880787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:03.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.213+0000 7ff8a6a00640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff8880762d0 0x7ff8880787e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff894034000 tx=0x7ff89402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:03.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.215+0000 7ff89f400640 1 -- 172.21.15.135:0/3365245530 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6764+0+0 (secure 0 0 0) 0x7ff89805d220 con 0x7ff8a80c60a0 2024-05-14T10:13:03.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.527+0000 7ff89f400640 1 -- 172.21.15.135:0/3365245530 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff898061020 con 0x7ff8a80c60a0 2024-05-14T10:13:03.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:03.786+0000 7ff8ae200640 1 -- 172.21.15.135:0/3365245530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff8a8073b20 con 0x7ff8a80c60a0 2024-05-14T10:13:04.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.101+0000 7ff89f400640 1 -- 172.21.15.135:0/3365245530 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7ff898065320 con 0x7ff8a80c60a0 2024-05-14T10:13:04.101 INFO:teuthology.orchestra.run.smithi135.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-14T10:13:04.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 -- 172.21.15.135:0/3365245530 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff8880762d0 msgr2=0x7ff8880787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:04.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff8880762d0 0x7ff8880787e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff894034000 tx=0x7ff89402e000 comp rx=0 tx=0).stop 2024-05-14T10:13:04.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 -- 172.21.15.135:0/3365245530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a80c60a0 msgr2=0x7ff8a80c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:04.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a80c60a0 0x7ff8a80c86f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff89800e8a0 tx=0x7ff89800ed60 comp rx=0 tx=0).stop 2024-05-14T10:13:04.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 -- 172.21.15.135:0/3365245530 shutdown_connections 2024-05-14T10:13:04.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7ff8880762d0 0x7ff8880787e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:04.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8a8152ed0 0x7ff8a8150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:04.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8a815c610 0x7ff8a814ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:04.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 --2- 172.21.15.135:0/3365245530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8a80c60a0 0x7ff8a80c86f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:04.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 -- 172.21.15.135:0/3365245530 >> 172.21.15.135:0/3365245530 conn(0x7ff8a8073d40 msgr2=0x7ff8a81592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:04.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 -- 172.21.15.135:0/3365245530 shutdown_connections 2024-05-14T10:13:04.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.106+0000 7ff8ae200640 1 -- 172.21.15.135:0/3365245530 wait complete. 2024-05-14T10:13:04.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-14T10:13:04.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.419+0000 7f2f9de00640 1 Processor -- start 2024-05-14T10:13:04.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.419+0000 7f2f9de00640 1 -- start start 2024-05-14T10:13:04.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.421+0000 7f2f9de00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2f98150b20 0x7f2f9806c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:04.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.421+0000 7f2f9de00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2f980c6b90 0x7f2f980c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:04.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.421+0000 7f2f9de00640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f9806cfe0 con 0x7f2f9815aa90 2024-05-14T10:13:04.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.421+0000 7f2f9de00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f2f98071ab0 con 0x7f2f98150b20 2024-05-14T10:13:04.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.421+0000 7f2f9de00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f2f9806cdc0 con 0x7f2f980c6b90 2024-05-14T10:13:04.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.423+0000 7f2f9d400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2f980c6b90 0x7f2f980c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:04.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.423+0000 7f2f9d400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2f980c6b90 0x7f2f980c6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.135:56658/0 (socket says 172.21.15.135:56658) 2024-05-14T10:13:04.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.423+0000 7f2f9d400640 1 -- 172.21.15.135:0/3875748640 learned_addr learned my addr 172.21.15.135:0/3875748640 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:13:04.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.429+0000 7f2f9d400640 1 -- 172.21.15.135:0/3875748640 >> v2:172.21.15.135:3300/0 conn(0x7f2f98150b20 msgr2=0x7f2f9806c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:04.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.429+0000 7f2f9d400640 1 --2- 172.21.15.135:0/3875748640 >> v2:172.21.15.135:3300/0 conn(0x7f2f98150b20 0x7f2f9806c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:04.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.429+0000 7f2f9d400640 1 -- 172.21.15.135:0/3875748640 >> v1:172.21.15.135:6789/0 conn(0x7f2f9815aa90 legacy=0x7f2f980c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:04.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.429+0000 7f2f9d400640 1 -- 172.21.15.135:0/3875748640 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f98070cf0 con 0x7f2f980c6b90 2024-05-14T10:13:04.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.434+0000 7f2f9d400640 1 --2- 172.21.15.135:0/3875748640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f980c6b90 0x7f2f980c6fa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f980c7ac0 tx=0x7f2f9002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b9dc01234e56804 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:04.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.454+0000 7f2f97400640 1 -- 172.21.15.135:0/3875748640 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90036070 con 0x7f2f980c6b90 2024-05-14T10:13:04.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.454+0000 7f2f97400640 1 -- 172.21.15.135:0/3875748640 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2f90031600 con 0x7f2f980c6b90 2024-05-14T10:13:04.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.454+0000 7f2f97400640 1 -- 172.21.15.135:0/3875748640 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900319f0 con 0x7f2f980c6b90 2024-05-14T10:13:04.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.455+0000 7f2f9de00640 1 -- 172.21.15.135:0/3875748640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f980c6b90 msgr2=0x7f2f980c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:04.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.455+0000 7f2f9de00640 1 --2- 172.21.15.135:0/3875748640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f980c6b90 0x7f2f980c6fa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f980c7ac0 tx=0x7f2f9002a730 comp rx=0 tx=0).stop 2024-05-14T10:13:04.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.455+0000 7f2f9de00640 1 -- 172.21.15.135:0/3875748640 shutdown_connections 2024-05-14T10:13:04.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.455+0000 7f2f9de00640 1 --2- 172.21.15.135:0/3875748640 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f980c6b90 0x7f2f980c6fa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:04.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.455+0000 7f2f9de00640 1 --2- 172.21.15.135:0/3875748640 >> v2:172.21.15.135:3300/0 conn(0x7f2f98150b20 0x7f2f9806c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:04.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.455+0000 7f2f9de00640 1 -- 172.21.15.135:0/3875748640 >> 172.21.15.135:0/3875748640 conn(0x7f2f980ca160 msgr2=0x7f2f980ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:04.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.456+0000 7f2f9de00640 1 -- 172.21.15.135:0/3875748640 shutdown_connections 2024-05-14T10:13:04.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.456+0000 7f2f9de00640 1 -- 172.21.15.135:0/3875748640 wait complete. 2024-05-14T10:13:04.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.459+0000 7f2f9de00640 1 Processor -- start 2024-05-14T10:13:04.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.459+0000 7f2f9de00640 1 -- start start 2024-05-14T10:13:04.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.461+0000 7f2f9de00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f980c6b90 0x7f2f981e7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:04.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.461+0000 7f2f9de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f98150b20 0x7f2f98151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:04.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.461+0000 7f2f9de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f9815aa90 0x7f2f981f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:04.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.461+0000 7f2f9de00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f98071620 con 0x7f2f9815aa90 2024-05-14T10:13:04.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.461+0000 7f2f9de00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2f98150f30 con 0x7f2f980c6b90 2024-05-14T10:13:04.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.461+0000 7f2f9de00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f2f980712b0 con 0x7f2f98150b20 2024-05-14T10:13:04.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.462+0000 7f2f9d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f9815aa90 0x7f2f981f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:04.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.462+0000 7f2f9d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f9815aa90 0x7f2f981f2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41852/0 (socket says 172.21.15.135:41852) 2024-05-14T10:13:04.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.462+0000 7f2f9d400640 1 -- 172.21.15.135:0/3880283876 learned_addr learned my addr 172.21.15.135:0/3880283876 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:13:04.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.467+0000 7f2f9d400640 1 -- 172.21.15.135:0/3880283876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f98150b20 msgr2=0x7f2f98151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:04.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.467+0000 7f2f9d400640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f98150b20 0x7f2f98151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:04.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.467+0000 7f2f9d400640 1 -- 172.21.15.135:0/3880283876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f980c6b90 msgr2=0x7f2f981e7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:04.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.467+0000 7f2f9d400640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f980c6b90 0x7f2f981e7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:04.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.467+0000 7f2f9d400640 1 -- 172.21.15.135:0/3880283876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f981f3590 con 0x7f2f9815aa90 2024-05-14T10:13:04.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.470+0000 7f2f9d400640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f9815aa90 0x7f2f981f2b60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2f90034040 tx=0x7f2f90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:04.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.476+0000 7f2f94c00640 1 -- 172.21.15.135:0/3880283876 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90036050 con 0x7f2f9815aa90 2024-05-14T10:13:04.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.476+0000 7f2f94c00640 1 -- 172.21.15.135:0/3880283876 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2f90042070 con 0x7f2f9815aa90 2024-05-14T10:13:04.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.476+0000 7f2f94c00640 1 -- 172.21.15.135:0/3880283876 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90009510 con 0x7f2f9815aa90 2024-05-14T10:13:04.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.476+0000 7f2f9de00640 1 -- 172.21.15.135:0/3880283876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f981e74a0 con 0x7f2f9815aa90 2024-05-14T10:13:04.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.476+0000 7f2f9de00640 1 -- 172.21.15.135:0/3880283876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f981e7740 con 0x7f2f9815aa90 2024-05-14T10:13:04.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.478+0000 7f2f9de00640 1 -- 172.21.15.135:0/3880283876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9806a300 con 0x7f2f9815aa90 2024-05-14T10:13:04.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.503+0000 7f2f94c00640 1 -- 172.21.15.135:0/3880283876 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2f90007bf0 con 0x7f2f9815aa90 2024-05-14T10:13:04.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.505+0000 7f2f94c00640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f7c076350 0x7f2f7c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:04.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.506+0000 7f2f9ca00640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f7c076350 0x7f2f7c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:04.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.507+0000 7f2f9ca00640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f7c076350 0x7f2f7c078860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f98154900 tx=0x7f2f8c006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:04.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.508+0000 7f2f94c00640 1 -- 172.21.15.135:0/3880283876 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7022+0+0 (secure 0 0 0) 0x7f2f9007dea0 con 0x7f2f9815aa90 2024-05-14T10:13:04.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:04.827+0000 7f2f94c00640 1 -- 172.21.15.135:0/3880283876 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2f9806a300 con 0x7f2f9815aa90 2024-05-14T10:13:05.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:05.103+0000 7f2f9de00640 1 -- 172.21.15.135:0/3880283876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2f980ca700 con 0x7f2f9815aa90 2024-05-14T10:13:05.731 INFO:tasks.ceph.mds.e.smithi135.stderr:==00:00:32:37.225 41523== 2024-05-14T10:13:05.732 INFO:tasks.ceph.mds.e.smithi135.stderr:==00:00:32:37.226 41523== Exit program on first error (--exit-on-first-error=yes) 2024-05-14T10:13:05.887 INFO:tasks.ceph.mds.f.smithi196.stderr:==00:00:32:37.361 41370== 2024-05-14T10:13:05.887 INFO:tasks.ceph.mds.f.smithi196.stderr:==00:00:32:37.361 41370== Exit program on first error (--exit-on-first-error=yes) 2024-05-14T10:13:05.887 INFO:tasks.ceph.mds.a.smithi135.stderr:==00:00:32:37.385 41521== 2024-05-14T10:13:05.887 INFO:tasks.ceph.mds.a.smithi135.stderr:==00:00:32:37.385 41521== Exit program on first error (--exit-on-first-error=yes) 2024-05-14T10:13:05.904 INFO:tasks.ceph.mds.e.smithi135.stderr:daemon-helper: command failed with exit status 42 2024-05-14T10:13:06.104 INFO:tasks.ceph.mds.a.smithi135.stderr:daemon-helper: command failed with exit status 42 2024-05-14T10:13:06.124 INFO:tasks.ceph.mds.f.smithi196.stderr:daemon-helper: command failed with exit status 42 2024-05-14T10:13:06.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.161+0000 7f2f94c00640 1 -- 172.21.15.135:0/3880283876 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7f2f9004b020 con 0x7f2f9815aa90 2024-05-14T10:13:06.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.164+0000 7f2f9de00640 1 -- 172.21.15.135:0/3880283876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f7c076350 msgr2=0x7f2f7c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:06.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.164+0000 7f2f9de00640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f7c076350 0x7f2f7c078860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f98154900 tx=0x7f2f8c006bf0 comp rx=0 tx=0).stop 2024-05-14T10:13:06.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.164+0000 7f2f9de00640 1 -- 172.21.15.135:0/3880283876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f9815aa90 msgr2=0x7f2f981f2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:06.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.164+0000 7f2f9de00640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f9815aa90 0x7f2f981f2b60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2f90034040 tx=0x7f2f90004a40 comp rx=0 tx=0).stop 2024-05-14T10:13:06.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.164+0000 7f2f9de00640 1 -- 172.21.15.135:0/3880283876 shutdown_connections 2024-05-14T10:13:06.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.164+0000 7f2f9de00640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f2f7c076350 0x7f2f7c078860 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:06.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.164+0000 7f2f9de00640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f9815aa90 0x7f2f981f2b60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:06.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.164+0000 7f2f9de00640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2f98150b20 0x7f2f98151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:06.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.164+0000 7f2f9de00640 1 --2- 172.21.15.135:0/3880283876 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2f980c6b90 0x7f2f981e7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:06.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.164+0000 7f2f9de00640 1 -- 172.21.15.135:0/3880283876 >> 172.21.15.135:0/3880283876 conn(0x7f2f980ca160 msgr2=0x7f2f9814c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:06.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.165+0000 7f2f9de00640 1 -- 172.21.15.135:0/3880283876 shutdown_connections 2024-05-14T10:13:06.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.165+0000 7f2f9de00640 1 -- 172.21.15.135:0/3880283876 wait complete. 2024-05-14T10:13:06.198 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-14T10:13:06.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.502+0000 7f8b8b200640 1 Processor -- start 2024-05-14T10:13:06.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.502+0000 7f8b8b200640 1 -- start start 2024-05-14T10:13:06.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.504+0000 7f8b8b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b8c158ec0 0x7f8b8c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:06.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.504+0000 7f8b8b200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8b8c071a70 0x7f8b8c070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:06.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.504+0000 7f8b8b200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b8c1535f0 con 0x7f8b8c0710b0 2024-05-14T10:13:06.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.504+0000 7f8b8b200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 -- 0x7f8b8c159470 con 0x7f8b8c071a70 2024-05-14T10:13:06.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.504+0000 7f8b8b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8c159730 con 0x7f8b8c158ec0 2024-05-14T10:13:06.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.506+0000 7f8b89e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b8c158ec0 0x7f8b8c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:06.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.507+0000 7f8b8a800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8b8c0710b0 0x7f8b8c0c8680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.135:58696/0 (socket says 172.21.15.135:58696) 2024-05-14T10:13:06.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.507+0000 7f8b8a800640 1 -- 172.21.15.135:0/3588609931 learned_addr learned my addr 172.21.15.135:0/3588609931 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-14T10:13:06.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.507+0000 7f8b81400640 1 --2- 172.21.15.135:0/3588609931 >> v2:172.21.15.196:3300/0 conn(0x7f8b8c071a70 0x7f8b8c070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:06.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.515+0000 7f8b89e00640 1 -- 172.21.15.135:0/3588609931 >> v2:172.21.15.196:3300/0 conn(0x7f8b8c071a70 msgr2=0x7f8b8c070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:06.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.515+0000 7f8b89e00640 1 --2- 172.21.15.135:0/3588609931 >> v2:172.21.15.196:3300/0 conn(0x7f8b8c071a70 0x7f8b8c070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:06.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.515+0000 7f8b89e00640 1 -- 172.21.15.135:0/3588609931 >> v1:172.21.15.196:6789/0 conn(0x7f8b8c0710b0 legacy=0x7f8b8c0c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:06.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.516+0000 7f8b89e00640 1 -- 172.21.15.135:0/3588609931 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8c159a10 con 0x7f8b8c158ec0 2024-05-14T10:13:06.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.522+0000 7f8b89e00640 1 --2- 172.21.15.135:0/3588609931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b8c158ec0 0x7f8b8c1530b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009d90 tx=0x7f8b7c02a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1541ef3ce2a919e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:06.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.535+0000 7f8b89400640 1 -- 172.21.15.135:0/3588609931 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c007740 con 0x7f8b8c158ec0 2024-05-14T10:13:06.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.535+0000 7f8b89400640 1 -- 172.21.15.135:0/3588609931 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8b7c0078e0 con 0x7f8b8c158ec0 2024-05-14T10:13:06.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.535+0000 7f8b89400640 1 -- 172.21.15.135:0/3588609931 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c007cd0 con 0x7f8b8c158ec0 2024-05-14T10:13:06.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.536+0000 7f8b8b200640 1 -- 172.21.15.135:0/3588609931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b8c158ec0 msgr2=0x7f8b8c1530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:06.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.536+0000 7f8b8b200640 1 --2- 172.21.15.135:0/3588609931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b8c158ec0 0x7f8b8c1530b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009d90 tx=0x7f8b7c02a6f0 comp rx=0 tx=0).stop 2024-05-14T10:13:06.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.536+0000 7f8b8b200640 1 -- 172.21.15.135:0/3588609931 shutdown_connections 2024-05-14T10:13:06.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.536+0000 7f8b8b200640 1 --2- 172.21.15.135:0/3588609931 >> v2:172.21.15.196:3300/0 conn(0x7f8b8c071a70 0x7f8b8c070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:06.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.536+0000 7f8b8b200640 1 --2- 172.21.15.135:0/3588609931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b8c158ec0 0x7f8b8c1530b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:06.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.536+0000 7f8b8b200640 1 -- 172.21.15.135:0/3588609931 >> 172.21.15.135:0/3588609931 conn(0x7f8b8c0ca160 msgr2=0x7f8b8c0ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:06.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.536+0000 7f8b8b200640 1 -- 172.21.15.135:0/3588609931 shutdown_connections 2024-05-14T10:13:06.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.536+0000 7f8b8b200640 1 -- 172.21.15.135:0/3588609931 wait complete. 2024-05-14T10:13:06.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.539+0000 7f8b8b200640 1 Processor -- start 2024-05-14T10:13:06.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.539+0000 7f8b8b200640 1 -- start start 2024-05-14T10:13:06.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.541+0000 7f8b8b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b8c0710b0 0x7f8b8c147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:06.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.541+0000 7f8b8b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b8c071a70 0x7f8b8c148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:06.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.541+0000 7f8b8b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b8c158ec0 0x7f8b8c141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:06.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.541+0000 7f8b8b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c0c8160 con 0x7f8b8c0710b0 2024-05-14T10:13:06.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.541+0000 7f8b8b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c0c7e80 con 0x7f8b8c158ec0 2024-05-14T10:13:06.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.541+0000 7f8b8b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8c0c9be0 con 0x7f8b8c071a70 2024-05-14T10:13:06.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.542+0000 7f8b89e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b8c0710b0 0x7f8b8c147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:06.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.542+0000 7f8b89e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b8c0710b0 0x7f8b8c147b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41866/0 (socket says 172.21.15.135:41866) 2024-05-14T10:13:06.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.542+0000 7f8b89e00640 1 -- 172.21.15.135:0/1887069039 learned_addr learned my addr 172.21.15.135:0/1887069039 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:13:06.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.543+0000 7f8b8a800640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b8c158ec0 0x7f8b8c141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:06.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.543+0000 7f8b81400640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b8c071a70 0x7f8b8c148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:06.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.547+0000 7f8b89e00640 1 -- 172.21.15.135:0/1887069039 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b8c071a70 msgr2=0x7f8b8c148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:06.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.547+0000 7f8b89e00640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b8c071a70 0x7f8b8c148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:06.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.547+0000 7f8b89e00640 1 -- 172.21.15.135:0/1887069039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b8c158ec0 msgr2=0x7f8b8c141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:06.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.547+0000 7f8b89e00640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b8c158ec0 0x7f8b8c141550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:06.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.547+0000 7f8b89e00640 1 -- 172.21.15.135:0/1887069039 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8c1491c0 con 0x7f8b8c0710b0 2024-05-14T10:13:06.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.549+0000 7f8b89e00640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b8c0710b0 0x7f8b8c147b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009d90 tx=0x7f8b7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.553+0000 7f8b82a00640 1 -- 172.21.15.135:0/1887069039 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c040030 con 0x7f8b8c0710b0 2024-05-14T10:13:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.553+0000 7f8b82a00640 1 -- 172.21.15.135:0/1887069039 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8b7c031940 con 0x7f8b8c0710b0 2024-05-14T10:13:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.553+0000 7f8b82a00640 1 -- 172.21.15.135:0/1887069039 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c031d30 con 0x7f8b8c0710b0 2024-05-14T10:13:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.553+0000 7f8b8b200640 1 -- 172.21.15.135:0/1887069039 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8c145740 con 0x7f8b8c0710b0 2024-05-14T10:13:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.553+0000 7f8b8b200640 1 -- 172.21.15.135:0/1887069039 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b8c145d00 con 0x7f8b8c0710b0 2024-05-14T10:13:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.555+0000 7f8b8b200640 1 -- 172.21.15.135:0/1887069039 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b8c069980 con 0x7f8b8c0710b0 2024-05-14T10:13:06.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.582+0000 7f8b82a00640 1 -- 172.21.15.135:0/1887069039 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8b7c043030 con 0x7f8b8c0710b0 2024-05-14T10:13:06.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.584+0000 7f8b82a00640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8b680762d0 0x7f8b680787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:06.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.584+0000 7f8b81400640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8b680762d0 0x7f8b680787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:06.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.585+0000 7f8b81400640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8b680762d0 0x7f8b680787e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c1636f0 tx=0x7f8b74009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:06.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.586+0000 7f8b82a00640 1 -- 172.21.15.135:0/1887069039 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7022+0+0 (secure 0 0 0) 0x7f8b7c07de50 con 0x7f8b8c0710b0 2024-05-14T10:13:06.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:06.929+0000 7f8b82a00640 1 -- 172.21.15.135:0/1887069039 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8b7c081c50 con 0x7f8b8c0710b0 2024-05-14T10:13:07.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:07.222+0000 7f8b8b200640 1 -- 172.21.15.135:0/1887069039 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8b8c1485c0 con 0x7f8b8c0710b0 2024-05-14T10:13:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.301+0000 7f8b82a00640 1 -- 172.21.15.135:0/1887069039 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7f8b7c085f50 con 0x7f8b8c0710b0 2024-05-14T10:13:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' removed 2024-05-14T10:13:08.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.304+0000 7f8b8b200640 1 -- 172.21.15.135:0/1887069039 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8b680762d0 msgr2=0x7f8b680787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:08.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.304+0000 7f8b8b200640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8b680762d0 0x7f8b680787e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c1636f0 tx=0x7f8b74009190 comp rx=0 tx=0).stop 2024-05-14T10:13:08.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.305+0000 7f8b8b200640 1 -- 172.21.15.135:0/1887069039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b8c0710b0 msgr2=0x7f8b8c147b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:08.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.305+0000 7f8b8b200640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b8c0710b0 0x7f8b8c147b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009d90 tx=0x7f8b7c004a40 comp rx=0 tx=0).stop 2024-05-14T10:13:08.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.305+0000 7f8b8b200640 1 -- 172.21.15.135:0/1887069039 shutdown_connections 2024-05-14T10:13:08.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.305+0000 7f8b8b200640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f8b680762d0 0x7f8b680787e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:08.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.305+0000 7f8b8b200640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b8c158ec0 0x7f8b8c141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:08.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.305+0000 7f8b8b200640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b8c071a70 0x7f8b8c148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:08.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.305+0000 7f8b8b200640 1 --2- 172.21.15.135:0/1887069039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b8c0710b0 0x7f8b8c147b00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:08.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.305+0000 7f8b8b200640 1 -- 172.21.15.135:0/1887069039 >> 172.21.15.135:0/1887069039 conn(0x7f8b8c0ca160 msgr2=0x7f8b8c0c56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:08.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.305+0000 7f8b8b200640 1 -- 172.21.15.135:0/1887069039 shutdown_connections 2024-05-14T10:13:08.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.305+0000 7f8b8b200640 1 -- 172.21.15.135:0/1887069039 wait complete. 2024-05-14T10:13:08.344 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-14T10:13:08.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.613+0000 7f91e6c00640 1 Processor -- start 2024-05-14T10:13:08.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.613+0000 7f91e6c00640 1 -- start start 2024-05-14T10:13:08.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.615+0000 7f91e6c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91e015ab20 0x7f91e0153f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:08.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.615+0000 7f91e6c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91e0071f70 0x7f91e006d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:08.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.615+0000 7f91e6c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e0074ce0 con 0x7f91e01544b0 2024-05-14T10:13:08.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.615+0000 7f91e6c00640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7f91e006cde0 con 0x7f91e0071f70 2024-05-14T10:13:08.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.615+0000 7f91e6c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f91e0074a00 con 0x7f91e015ab20 2024-05-14T10:13:08.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.616+0000 7f91e4c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91e0071f70 0x7f91e006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:08.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.617+0000 7f91e4c00640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91e0071f70 0x7f91e006d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41878/0 (socket says 172.21.15.135:41878) 2024-05-14T10:13:08.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.617+0000 7f91e4c00640 1 -- 172.21.15.135:0/704498658 learned_addr learned my addr 172.21.15.135:0/704498658 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:13:08.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.618+0000 7f91dfe00640 1 --2- 172.21.15.135:0/704498658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91e015ab20 0x7f91e0153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:08.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.620+0000 7f91e4c00640 1 -- 172.21.15.135:0/704498658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91e015ab20 msgr2=0x7f91e0153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:08.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.620+0000 7f91e4c00640 1 --2- 172.21.15.135:0/704498658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91e015ab20 0x7f91e0153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:08.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.620+0000 7f91e4c00640 1 -- 172.21.15.135:0/704498658 >> v1:172.21.15.196:6789/0 conn(0x7f91e01544b0 legacy=0x7f91e00c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:08.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.620+0000 7f91e4c00640 1 -- 172.21.15.135:0/704498658 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e006c790 con 0x7f91e0071f70 2024-05-14T10:13:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.623+0000 7f91e4c00640 1 --2- 172.21.15.135:0/704498658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91e0071f70 0x7f91e006d270 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009e50 tx=0x7f91d802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4df20867661375 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:08.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.625+0000 7f91dea00640 1 -- 172.21.15.135:0/704498658 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8036070 con 0x7f91e0071f70 2024-05-14T10:13:08.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.628+0000 7f91dea00640 1 -- 172.21.15.135:0/704498658 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f91d8031600 con 0x7f91e0071f70 2024-05-14T10:13:08.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.628+0000 7f91dea00640 1 -- 172.21.15.135:0/704498658 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80319f0 con 0x7f91e0071f70 2024-05-14T10:13:08.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.628+0000 7f91e6c00640 1 -- 172.21.15.135:0/704498658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91e0071f70 msgr2=0x7f91e006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:08.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.628+0000 7f91e6c00640 1 --2- 172.21.15.135:0/704498658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91e0071f70 0x7f91e006d270 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009e50 tx=0x7f91d802a710 comp rx=0 tx=0).stop 2024-05-14T10:13:08.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.629+0000 7f91e6c00640 1 -- 172.21.15.135:0/704498658 shutdown_connections 2024-05-14T10:13:08.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.629+0000 7f91e6c00640 1 --2- 172.21.15.135:0/704498658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91e0071f70 0x7f91e006d270 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:08.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.629+0000 7f91e6c00640 1 --2- 172.21.15.135:0/704498658 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91e015ab20 0x7f91e0153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:08.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.629+0000 7f91e6c00640 1 -- 172.21.15.135:0/704498658 >> 172.21.15.135:0/704498658 conn(0x7f91e0073d40 msgr2=0x7f91e0074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:08.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.629+0000 7f91e6c00640 1 -- 172.21.15.135:0/704498658 shutdown_connections 2024-05-14T10:13:08.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.629+0000 7f91e6c00640 1 -- 172.21.15.135:0/704498658 wait complete. 2024-05-14T10:13:08.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.631+0000 7f91e6c00640 1 Processor -- start 2024-05-14T10:13:08.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.632+0000 7f91e6c00640 1 -- start start 2024-05-14T10:13:08.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.633+0000 7f91e6c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91e0071f70 0x7f91e01f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:08.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.633+0000 7f91e6c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91e01544b0 0x7f91e00c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:08.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.633+0000 7f91e6c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91e015ab20 0x7f91e015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:08.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.633+0000 7f91e6c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f91e00c7380 con 0x7f91e015ab20 2024-05-14T10:13:08.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.633+0000 7f91e6c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f91e00c4690 con 0x7f91e0071f70 2024-05-14T10:13:08.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.633+0000 7f91e6c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7f91e00c7500 con 0x7f91e01544b0 2024-05-14T10:13:08.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.634+0000 7f91e4c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91e015ab20 0x7f91e015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:08.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.634+0000 7f91e4c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91e015ab20 0x7f91e015dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41890/0 (socket says 172.21.15.135:41890) 2024-05-14T10:13:08.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.634+0000 7f91e4c00640 1 -- 172.21.15.135:0/1949926541 learned_addr learned my addr 172.21.15.135:0/1949926541 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:13:08.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.635+0000 7f91dfe00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91e0071f70 0x7f91e01f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:08.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.636+0000 7f91df400640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91e01544b0 0x7f91e00c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:08.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.639+0000 7f91e4c00640 1 -- 172.21.15.135:0/1949926541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91e01544b0 msgr2=0x7f91e00c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:08.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.639+0000 7f91e4c00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91e01544b0 0x7f91e00c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:08.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.639+0000 7f91e4c00640 1 -- 172.21.15.135:0/1949926541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91e0071f70 msgr2=0x7f91e01f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:08.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.639+0000 7f91e4c00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91e0071f70 0x7f91e01f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:08.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.639+0000 7f91e4c00640 1 -- 172.21.15.135:0/1949926541 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e0150180 con 0x7f91e015ab20 2024-05-14T10:13:08.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.642+0000 7f91e4c00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91e015ab20 0x7f91e015dc00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f91d8034040 tx=0x7f91d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:08.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.646+0000 7f91d7e00640 1 -- 172.21.15.135:0/1949926541 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d803f020 con 0x7f91e015ab20 2024-05-14T10:13:08.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.646+0000 7f91d7e00640 1 -- 172.21.15.135:0/1949926541 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f91d8037040 con 0x7f91e015ab20 2024-05-14T10:13:08.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.646+0000 7f91d7e00640 1 -- 172.21.15.135:0/1949926541 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8036070 con 0x7f91e015ab20 2024-05-14T10:13:08.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.646+0000 7f91e6c00640 1 -- 172.21.15.135:0/1949926541 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e0150460 con 0x7f91e015ab20 2024-05-14T10:13:08.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.646+0000 7f91e6c00640 1 -- 172.21.15.135:0/1949926541 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e00c6890 con 0x7f91e015ab20 2024-05-14T10:13:08.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.648+0000 7f91e6c00640 1 -- 172.21.15.135:0/1949926541 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e0069a60 con 0x7f91e015ab20 2024-05-14T10:13:08.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.676+0000 7f91d7e00640 1 -- 172.21.15.135:0/1949926541 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f91d8042020 con 0x7f91e015ab20 2024-05-14T10:13:08.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.677+0000 7f91d7e00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f91bc076320 0x7f91bc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:08.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.678+0000 7f91dfe00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f91bc076320 0x7f91bc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:08.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:08.679+0000 7f91dfe00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f91bc076320 0x7f91bc078830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009aa0 tx=0x7f91c8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:09.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.010+0000 7f91d7e00640 1 -- 172.21.15.135:0/1949926541 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6584+0+0 (secure 0 0 0) 0x7f91d8009510 con 0x7f91e015ab20 2024-05-14T10:13:09.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.011+0000 7f91d7e00640 1 -- 172.21.15.135:0/1949926541 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91d8049030 con 0x7f91e015ab20 2024-05-14T10:13:09.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.224+0000 7f91e6c00640 1 -- 172.21.15.135:0/1949926541 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f91e00764e0 con 0x7f91e015ab20 2024-05-14T10:13:09.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-05-14T10:13:09.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-05-14T10:13:09.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-05-14T10:13:09.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.692+0000 7f91d7e00640 1 -- 172.21.15.135:0/1949926541 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7f91d80810f0 con 0x7f91e015ab20 2024-05-14T10:13:09.693 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' removed 2024-05-14T10:13:09.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.696+0000 7f91e6c00640 1 -- 172.21.15.135:0/1949926541 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f91bc076320 msgr2=0x7f91bc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:09.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.696+0000 7f91e6c00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f91bc076320 0x7f91bc078830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009aa0 tx=0x7f91c8009190 comp rx=0 tx=0).stop 2024-05-14T10:13:09.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.696+0000 7f91e6c00640 1 -- 172.21.15.135:0/1949926541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91e015ab20 msgr2=0x7f91e015dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:09.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.696+0000 7f91e6c00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91e015ab20 0x7f91e015dc00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f91d8034040 tx=0x7f91d8004a40 comp rx=0 tx=0).stop 2024-05-14T10:13:09.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.696+0000 7f91e6c00640 1 -- 172.21.15.135:0/1949926541 shutdown_connections 2024-05-14T10:13:09.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.696+0000 7f91e6c00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7f91bc076320 0x7f91bc078830 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:09.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.696+0000 7f91e6c00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91e015ab20 0x7f91e015dc00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:09.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.696+0000 7f91e6c00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f91e01544b0 0x7f91e00c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:09.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.696+0000 7f91e6c00640 1 --2- 172.21.15.135:0/1949926541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f91e0071f70 0x7f91e01f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:09.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.697+0000 7f91e6c00640 1 -- 172.21.15.135:0/1949926541 >> 172.21.15.135:0/1949926541 conn(0x7f91e0073d40 msgr2=0x7f91e00c3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:09.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.697+0000 7f91e6c00640 1 -- 172.21.15.135:0/1949926541 shutdown_connections 2024-05-14T10:13:09.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.697+0000 7f91e6c00640 1 -- 172.21.15.135:0/1949926541 wait complete. 2024-05-14T10:13:09.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-14T10:13:09.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.993+0000 7fef17200640 1 Processor -- start 2024-05-14T10:13:09.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.993+0000 7fef17200640 1 -- start start 2024-05-14T10:13:09.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.995+0000 7fef17200640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fef18071a70 0x7fef18070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:09.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.995+0000 7fef17200640 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef18159470 con 0x7fef18158ec0 2024-05-14T10:13:09.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.995+0000 7fef17200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef18159730 con 0x7fef180710b0 2024-05-14T10:13:09.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.995+0000 7fef17200640 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 -- 0x7fef18159a10 con 0x7fef18071a70 2024-05-14T10:13:09.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.996+0000 7fef0d400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fef18071a70 0x7fef18070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:09.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.997+0000 7fef0d400640 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fef18071a70 0x7fef18070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41904/0 (socket says 172.21.15.135:41904) 2024-05-14T10:13:09.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:09.997+0000 7fef0d400640 1 -- 172.21.15.135:0/1737334867 learned_addr learned my addr 172.21.15.135:0/1737334867 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:13:10.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.001+0000 7fef0d400640 1 -- 172.21.15.135:0/1737334867 >> v1:172.21.15.196:6789/0 conn(0x7fef180710b0 legacy=0x7fef180c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T10:13:10.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.001+0000 7fef0d400640 1 -- 172.21.15.135:0/1737334867 >> v1:172.21.15.135:6789/0 conn(0x7fef18158ec0 legacy=0x7fef181530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:10.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.001+0000 7fef0d400640 1 -- 172.21.15.135:0/1737334867 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef18159cf0 con 0x7fef18071a70 2024-05-14T10:13:10.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.005+0000 7fef0d400640 1 --2- 172.21.15.135:0/1737334867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef18071a70 0x7fef18070b70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fef0000bb10 tx=0x7fef0002c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a83d6f0211eb0e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:10.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.011+0000 7fef15400640 1 -- 172.21.15.135:0/1737334867 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef00035070 con 0x7fef18071a70 2024-05-14T10:13:10.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.011+0000 7fef15400640 1 -- 172.21.15.135:0/1737334867 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fef00031610 con 0x7fef18071a70 2024-05-14T10:13:10.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.011+0000 7fef15400640 1 -- 172.21.15.135:0/1737334867 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef00031a00 con 0x7fef18071a70 2024-05-14T10:13:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.012+0000 7fef17200640 1 -- 172.21.15.135:0/1737334867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef18071a70 msgr2=0x7fef18070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.012+0000 7fef17200640 1 --2- 172.21.15.135:0/1737334867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef18071a70 0x7fef18070b70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fef0000bb10 tx=0x7fef0002c9b0 comp rx=0 tx=0).stop 2024-05-14T10:13:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.012+0000 7fef17200640 1 -- 172.21.15.135:0/1737334867 shutdown_connections 2024-05-14T10:13:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.012+0000 7fef17200640 1 --2- 172.21.15.135:0/1737334867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef18071a70 0x7fef18070b70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.012+0000 7fef17200640 1 -- 172.21.15.135:0/1737334867 >> 172.21.15.135:0/1737334867 conn(0x7fef180ca160 msgr2=0x7fef180ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.012+0000 7fef17200640 1 -- 172.21.15.135:0/1737334867 shutdown_connections 2024-05-14T10:13:10.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.013+0000 7fef17200640 1 -- 172.21.15.135:0/1737334867 wait complete. 2024-05-14T10:13:10.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.015+0000 7fef17200640 1 Processor -- start 2024-05-14T10:13:10.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.015+0000 7fef17200640 1 -- start start 2024-05-14T10:13:10.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.017+0000 7fef17200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fef180710b0 0x7fef181f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:10.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.017+0000 7fef17200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef18071a70 0x7fef180be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:10.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.017+0000 7fef17200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef18158ec0 0x7fef1814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:10.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.017+0000 7fef17200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef180c9be0 con 0x7fef18158ec0 2024-05-14T10:13:10.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.017+0000 7fef17200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fef180c8160 con 0x7fef18071a70 2024-05-14T10:13:10.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.017+0000 7fef17200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 -- 0x7fef180c9d60 con 0x7fef180710b0 2024-05-14T10:13:10.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.017+0000 7fef16800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef18158ec0 0x7fef1814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:10.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.018+0000 7fef16800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef18158ec0 0x7fef1814c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41910/0 (socket says 172.21.15.135:41910) 2024-05-14T10:13:10.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.018+0000 7fef16800640 1 -- 172.21.15.135:0/2924283656 learned_addr learned my addr 172.21.15.135:0/2924283656 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-14T10:13:10.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.022+0000 7fef16800640 1 -- 172.21.15.135:0/2924283656 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fef180710b0 msgr2=0x7fef181f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:10.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.022+0000 7fef16800640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fef180710b0 0x7fef181f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:10.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.022+0000 7fef16800640 1 -- 172.21.15.135:0/2924283656 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef18071a70 msgr2=0x7fef180be7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:10.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.022+0000 7fef16800640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef18071a70 0x7fef180be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:10.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.022+0000 7fef16800640 1 -- 172.21.15.135:0/2924283656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef180bed30 con 0x7fef18158ec0 2024-05-14T10:13:10.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.026+0000 7fef16800640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef18158ec0 0x7fef1814c240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fef1000ba10 tx=0x7fef1000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:10.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.033+0000 7fef0ea00640 1 -- 172.21.15.135:0/2924283656 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10019070 con 0x7fef18158ec0 2024-05-14T10:13:10.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.033+0000 7fef0ea00640 1 -- 172.21.15.135:0/2924283656 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fef1000cba0 con 0x7fef18158ec0 2024-05-14T10:13:10.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.033+0000 7fef0ea00640 1 -- 172.21.15.135:0/2924283656 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10014440 con 0x7fef18158ec0 2024-05-14T10:13:10.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.033+0000 7fef17200640 1 -- 172.21.15.135:0/2924283656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef18155d40 con 0x7fef18158ec0 2024-05-14T10:13:10.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.033+0000 7fef17200640 1 -- 172.21.15.135:0/2924283656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef180bd4c0 con 0x7fef18158ec0 2024-05-14T10:13:10.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.034+0000 7fef17200640 1 -- 172.21.15.135:0/2924283656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef180c7b70 con 0x7fef18158ec0 2024-05-14T10:13:10.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.065+0000 7fef0ea00640 1 -- 172.21.15.135:0/2924283656 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef10003970 con 0x7fef18158ec0 2024-05-14T10:13:10.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.066+0000 7fef0ea00640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7feef4076350 0x7feef4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T10:13:10.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.067+0000 7fef15e00640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7feef4076350 0x7feef4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T10:13:10.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.068+0000 7fef15e00640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7feef4076350 0x7feef4078860 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fef08000f60 tx=0x7fef080079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T10:13:10.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.072+0000 7fef0ea00640 1 -- 172.21.15.135:0/2924283656 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6025+0+0 (secure 0 0 0) 0x7fef1005cbc0 con 0x7fef18158ec0 2024-05-14T10:13:10.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.400+0000 7fef0ea00640 1 -- 172.21.15.135:0/2924283656 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fef180c7b70 con 0x7fef18158ec0 2024-05-14T10:13:10.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:10.618+0000 7fef17200640 1 -- 172.21.15.135:0/2924283656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fef18157060 con 0x7fef18158ec0 2024-05-14T10:13:11.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.017+0000 7fef0ea00640 1 -- 172.21.15.135:0/2924283656 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v37) ==== 178+0+0 (secure 0 0 0) 0x7fef18157060 con 0x7fef18158ec0 2024-05-14T10:13:11.018 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data_ec' removed 2024-05-14T10:13:11.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.021+0000 7fef17200640 1 -- 172.21.15.135:0/2924283656 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7feef4076350 msgr2=0x7feef4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:11.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.021+0000 7fef17200640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7feef4076350 0x7feef4078860 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fef08000f60 tx=0x7fef080079b0 comp rx=0 tx=0).stop 2024-05-14T10:13:11.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.021+0000 7fef17200640 1 -- 172.21.15.135:0/2924283656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef18158ec0 msgr2=0x7fef1814c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T10:13:11.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.021+0000 7fef17200640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef18158ec0 0x7fef1814c240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fef1000ba10 tx=0x7fef1000bed0 comp rx=0 tx=0).stop 2024-05-14T10:13:11.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.022+0000 7fef17200640 1 -- 172.21.15.135:0/2924283656 shutdown_connections 2024-05-14T10:13:11.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.022+0000 7fef17200640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.135:6800/88161500,v1:172.21.15.135:6801/88161500] conn(0x7feef4076350 0x7feef4078860 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:11.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.022+0000 7fef17200640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef18071a70 0x7fef180be7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:11.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.022+0000 7fef17200640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef18158ec0 0x7fef1814c240 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:11.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.022+0000 7fef17200640 1 --2- 172.21.15.135:0/2924283656 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fef180710b0 0x7fef181f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T10:13:11.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.022+0000 7fef17200640 1 -- 172.21.15.135:0/2924283656 >> 172.21.15.135:0/2924283656 conn(0x7fef180ca160 msgr2=0x7fef18157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T10:13:11.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.022+0000 7fef17200640 1 -- 172.21.15.135:0/2924283656 shutdown_connections 2024-05-14T10:13:11.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-14T10:13:11.022+0000 7fef17200640 1 -- 172.21.15.135:0/2924283656 wait complete. 2024-05-14T10:13:11.059 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-14T10:13:11.059 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-14T10:13:11.059 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:11.060 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-14T10:13:11.060 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi135 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a" 2024-05-14T10:13:11.060 INFO:tasks.ceph.mds.a:Stopped 2024-05-14T10:13:11.061 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-14T10:13:11.061 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:11.106 INFO:tasks.ceph.mds.c.smithi135.stderr:2024-05-14T10:13:11.071+0000 f85d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 41509) UID: 0 2024-05-14T10:13:11.107 INFO:tasks.ceph.mds.c.smithi135.stderr:2024-05-14T10:13:11.076+0000 f85d640 -1 mds.c *** got signal Terminated *** 2024-05-14T10:13:16.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-05-14T10:13:16.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~7s 2024-05-14T10:13:16.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~7s 2024-05-14T10:13:16.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-05-14T10:13:17.162 INFO:tasks.ceph.mds.c:Stopped 2024-05-14T10:13:17.162 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-14T10:13:17.162 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:17.163 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-14T10:13:17.163 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi135 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2024-05-14T10:13:17.163 INFO:tasks.ceph.mds.e:Stopped 2024-05-14T10:13:17.163 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-14T10:13:17.163 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:17.213 INFO:tasks.ceph.mds.b.smithi196.stderr:2024-05-14T10:13:17.175+0000 f85d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 41362) UID: 0 2024-05-14T10:13:17.214 INFO:tasks.ceph.mds.b.smithi196.stderr:2024-05-14T10:13:17.180+0000 f85d640 -1 mds.b *** got signal Terminated *** 2024-05-14T10:13:20.663 INFO:tasks.ceph.mds.b.smithi196.stderr:2024-05-14T10:13:20.653+0000 11060640 -1 mgrc handle_mgr_configure dropping unexpected configure message 2024-05-14T10:13:22.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-14T10:13:22.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~13s 2024-05-14T10:13:22.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-05-14T10:13:22.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-05-14T10:13:23.265 INFO:tasks.ceph.mds.b:Stopped 2024-05-14T10:13:23.265 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-14T10:13:23.266 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:23.311 INFO:tasks.ceph.mds.d.smithi196.stderr:2024-05-14T10:13:23.276+0000 f85d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 41363) UID: 0 2024-05-14T10:13:23.313 INFO:tasks.ceph.mds.d.smithi196.stderr:2024-05-14T10:13:23.281+0000 f85d640 -1 mds.d *** got signal Terminated *** 2024-05-14T10:13:28.846 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-05-14T10:13:28.846 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~20s 2024-05-14T10:13:28.847 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-14T10:13:29.367 INFO:tasks.ceph.mds.d:Stopped 2024-05-14T10:13:29.368 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-14T10:13:29.368 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:29.368 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-14T10:13:29.368 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi196 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2024-05-14T10:13:29.368 INFO:tasks.ceph.mds.f:Stopped 2024-05-14T10:13:29.368 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-14T10:13:29.369 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-14T10:13:29.369 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:29.370 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-14T10:13:29.370+0000 7f9475600640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 36763) UID: 0 2024-05-14T10:13:29.370 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-14T10:13:29.370+0000 7f9475600640 -1 osd.0 40 *** Got signal Terminated *** 2024-05-14T10:13:33.303 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:13:33.311 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:13:35.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-14T10:13:35.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-05-14T10:13:35.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-05-14T10:13:35.471 INFO:tasks.ceph.osd.0:Stopped 2024-05-14T10:13:35.471 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-14T10:13:35.471 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:35.473 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-14T10:13:35.473+0000 7fbf7e400640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 36753) UID: 0 2024-05-14T10:13:35.473 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-14T10:13:35.473+0000 7fbf7e400640 -1 osd.1 42 *** Got signal Terminated *** 2024-05-14T10:13:41.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-14T10:13:41.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-14T10:13:41.574 INFO:tasks.ceph.osd.1:Stopped 2024-05-14T10:13:41.575 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-14T10:13:41.575 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:41.576 INFO:tasks.ceph.osd.2.smithi135.stderr:2024-05-14T10:13:41.576+0000 7fb94f200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 36764) UID: 0 2024-05-14T10:13:41.576 INFO:tasks.ceph.osd.2.smithi135.stderr:2024-05-14T10:13:41.576+0000 7fb94f200640 -1 osd.2 43 *** Got signal Terminated *** 2024-05-14T10:13:47.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-14T10:13:47.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-14T10:13:47.677 INFO:tasks.ceph.osd.2:Stopped 2024-05-14T10:13:47.677 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-14T10:13:47.677 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:47.679 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-05-14T10:13:47.679+0000 7fde54c00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 36767) UID: 0 2024-05-14T10:13:47.679 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-05-14T10:13:47.680+0000 7fde54c00640 -1 osd.3 44 *** Got signal Terminated *** 2024-05-14T10:13:53.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-14T10:13:53.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-14T10:13:53.779 INFO:tasks.ceph.osd.3:Stopped 2024-05-14T10:13:53.780 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-14T10:13:53.780 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:53.782 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-05-14T10:13:53.782+0000 7fb8a3600640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 36822) UID: 0 2024-05-14T10:13:53.782 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-05-14T10:13:53.782+0000 7fb8a3600640 -1 osd.4 45 *** Got signal Terminated *** 2024-05-14T10:13:58.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-14T10:13:58.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-14T10:13:59.881 INFO:tasks.ceph.osd.4:Stopped 2024-05-14T10:13:59.882 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-14T10:13:59.882 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:13:59.883 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-05-14T10:13:59.883+0000 7fdbc7200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 36823) UID: 0 2024-05-14T10:13:59.883 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-05-14T10:13:59.883+0000 7fdbc7200640 -1 osd.5 46 *** Got signal Terminated *** 2024-05-14T10:14:03.474 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:03.483 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:04.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-14T10:14:04.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-14T10:14:05.983 INFO:tasks.ceph.osd.5:Stopped 2024-05-14T10:14:05.984 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-14T10:14:05.984 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:14:05.985 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-05-14T10:14:05.986+0000 7fa4daa00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 36827) UID: 0 2024-05-14T10:14:05.986 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-05-14T10:14:05.986+0000 7fa4daa00640 -1 osd.6 47 *** Got signal Terminated *** 2024-05-14T10:14:10.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-14T10:14:10.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-14T10:14:12.086 INFO:tasks.ceph.osd.6:Stopped 2024-05-14T10:14:12.087 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-14T10:14:12.087 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:14:12.088 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-05-14T10:14:12.087+0000 7f3022400640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 36828) UID: 0 2024-05-14T10:14:12.088 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-05-14T10:14:12.087+0000 7f3022400640 -1 osd.7 47 *** Got signal Terminated *** 2024-05-14T10:14:15.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-14T10:14:15.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-14T10:14:18.189 INFO:tasks.ceph.osd.7:Stopped 2024-05-14T10:14:18.189 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-14T10:14:18.190 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-14T10:14:18.190 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:14:18.192 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T10:14:18.191+0000 7fd48ac00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 36405) UID: 0 2024-05-14T10:14:18.192 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-14T10:14:18.191+0000 7fd48ac00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-14T10:14:18.284 INFO:tasks.ceph.mgr.y:Stopped 2024-05-14T10:14:18.285 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-14T10:14:18.285 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:14:21.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-05-14T10:14:21.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-14T10:14:24.386 INFO:tasks.ceph.mgr.x:Stopped 2024-05-14T10:14:24.386 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-14T10:14:24.386 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-14T10:14:24.387 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:14:24.437 INFO:tasks.ceph.mon.a.smithi135.stderr:2024-05-14T10:14:24.397+0000 e22b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 36402) UID: 0 2024-05-14T10:14:24.439 INFO:tasks.ceph.mon.a.smithi135.stderr:2024-05-14T10:14:24.401+0000 e22b640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-14T10:14:25.507 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:34:46.972 36409== 2024-05-14T10:14:25.507 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:34:46.972 36409== Exit program on first error (--exit-on-first-error=yes) 2024-05-14T10:14:25.567 INFO:tasks.ceph.mon.a.smithi135.stderr:daemon-helper: command failed with exit status 42 2024-05-14T10:14:26.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-05-14T10:14:26.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-05-14T10:14:30.488 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-14T10:14:30.488 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi135 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-05-14T10:14:30.489 INFO:tasks.ceph.mon.a:Stopped 2024-05-14T10:14:30.489 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-14T10:14:30.489 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:14:30.540 INFO:tasks.ceph.mon.b.smithi196.stderr:2024-05-14T10:14:30.500+0000 e22b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 36222) UID: 0 2024-05-14T10:14:30.541 INFO:tasks.ceph.mon.b.smithi196.stderr:2024-05-14T10:14:30.505+0000 e22b640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-05-14T10:14:31.413 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-05-14T10:14:31.528 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:34:53.006 36229== 2024-05-14T10:14:31.528 INFO:tasks.ceph.mon.b.smithi196.stderr:==00:00:34:53.006 36229== Exit program on first error (--exit-on-first-error=yes) 2024-05-14T10:14:31.583 INFO:tasks.ceph.mon.b.smithi196.stderr:daemon-helper: command failed with exit status 42 2024-05-14T10:14:33.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:33.679 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:36.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-05-14T10:14:36.590 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-14T10:14:36.590 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi196 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-05-14T10:14:36.591 INFO:tasks.ceph.mon.b:Stopped 2024-05-14T10:14:36.591 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-14T10:14:36.591 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T10:14:36.642 INFO:tasks.ceph.mon.c.smithi196.stderr:2024-05-14T10:14:36.603+0000 e22b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 36223) UID: 0 2024-05-14T10:14:36.643 INFO:tasks.ceph.mon.c.smithi196.stderr:2024-05-14T10:14:36.607+0000 e22b640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-05-14T10:14:37.457 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:34:58.933 36230== 2024-05-14T10:14:37.457 INFO:tasks.ceph.mon.c.smithi196.stderr:==00:00:34:58.933 36230== Exit program on first error (--exit-on-first-error=yes) 2024-05-14T10:14:37.510 INFO:tasks.ceph.mon.c.smithi196.stderr:daemon-helper: command failed with exit status 42 2024-05-14T10:14:41.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-14T10:14:41.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-05-14T10:14:42.692 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-14T10:14:42.692 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi196 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-05-14T10:14:42.693 INFO:tasks.ceph.mon.c:Stopped 2024-05-14T10:14:42.693 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-14T10:14:42.693 DEBUG:teuthology.orchestra.run.smithi135:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-05-14T10:14:42.891 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T10:14:42.891 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-14T10:14:43.051 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T10:14:43.051 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-14T10:14:43.189 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T10:14:43.190 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-14T10:14:43.338 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T10:14:43.338 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-14T10:14:43.510 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi196.front.sepia.ceph.com 2024-05-14T10:14:43.510 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-14T10:14:43.785 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi196.front.sepia.ceph.com 2024-05-14T10:14:43.785 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-14T10:14:43.925 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi196.front.sepia.ceph.com 2024-05-14T10:14:43.925 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-14T10:14:44.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi196.front.sepia.ceph.com 2024-05-14T10:14:44.058 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-14T10:14:44.214 INFO:tasks.ceph:Archiving mon data... 2024-05-14T10:14:44.216 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681/data/mon.a.tgz 2024-05-14T10:14:44.216 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-05-14T10:14:44.273 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.Ju6HUhXDAs 2024-05-14T10:14:44.274 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Ju6HUhXDAs 2024-05-14T10:14:44.447 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.Ju6HUhXDAs 2024-05-14T10:14:44.587 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.Ju6HUhXDAs is 362KB 2024-05-14T10:14:44.695 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.Ju6HUhXDAs 2024-05-14T10:14:44.750 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681/data/mon.b.tgz 2024-05-14T10:14:44.750 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-05-14T10:14:44.807 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.LtNCEYIgF2 2024-05-14T10:14:44.808 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LtNCEYIgF2 2024-05-14T10:14:44.992 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.LtNCEYIgF2 2024-05-14T10:14:45.131 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.LtNCEYIgF2 is 381KB 2024-05-14T10:14:45.201 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.LtNCEYIgF2 2024-05-14T10:14:45.254 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681/data/mon.c.tgz 2024-05-14T10:14:45.255 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-05-14T10:14:45.307 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.XiJ2AEIqmt 2024-05-14T10:14:45.307 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.XiJ2AEIqmt 2024-05-14T10:14:45.476 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.XiJ2AEIqmt 2024-05-14T10:14:45.614 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.XiJ2AEIqmt is 382KB 2024-05-14T10:14:45.717 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.XiJ2AEIqmt 2024-05-14T10:14:45.772 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-14T10:14:45.772 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-14T10:14:45.779 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-14T10:14:46.219 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2024-05-14T10:14:46.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-14T10:14:46.562 INFO:tasks.ceph:Archiving crash dumps... 2024-05-14T10:14:46.564 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681/remote/smithi135/crash 2024-05-14T10:14:46.565 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-14T10:14:46.650 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681/remote/smithi196/crash 2024-05-14T10:14:46.651 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-14T10:14:46.738 INFO:tasks.ceph:Shutting down logrotate 2024-05-14T10:14:46.738 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:46.746 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:46.857 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:46.943 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-14T10:14:47.030 INFO:tasks.ceph:Compressing logs... 2024-05-14T10:14:47.031 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T10:14:47.038 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T10:14:47.114 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43626.log 2024-05-14T10:14:47.115 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36897.log 2024-05-14T10:14:47.116 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41916.log 2024-05-14T10:14:47.116 INFO:teuthology.orchestra.run.smithi135.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43626.log.gz 2024-05-14T10:14:47.117 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42060.log 2024-05-14T10:14:47.118 INFO:teuthology.orchestra.run.smithi135.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36897.log.gz 2024-05-14T10:14:47.118 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36612.log 2024-05-14T10:14:47.119 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.41916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41619.log 2024-05-14T10:14:47.119 INFO:teuthology.orchestra.run.smithi135.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41916.log.gz 2024-05-14T10:14:47.119 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-14T10:14:47.120 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.42060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48697.log 2024-05-14T10:14:47.120 INFO:teuthology.orchestra.run.smithi135.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42060.log.gz 2024-05-14T10:14:47.121 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.41619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48823.log 2024-05-14T10:14:47.121 INFO:teuthology.orchestra.run.smithi135.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41619.log.gz 2024-05-14T10:14:47.121 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36612.log: gzip 87.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.36612.log.gz -- 2024-05-14T10:14:47.121 INFO:teuthology.orchestra.run.smithi196.stderr: /var/log/ceph/ceph-mds.f.log 2024-05-14T10:14:47.122 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36732.log 2024-05-14T10:14:47.122 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-14T10:14:47.123 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48697.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48697.log.gz 2024-05-14T10:14:47.123 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41748.log 2024-05-14T10:14:47.123 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45144.log 2024-05-14T10:14:47.123 INFO:teuthology.orchestra.run.smithi135.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48823.log.gz 2024-05-14T10:14:47.123 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.41748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49177.log 2024-05-14T10:14:47.125 INFO:teuthology.orchestra.run.smithi135.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41748.log.gz 2024-05-14T10:14:47.125 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.45144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48457.log 2024-05-14T10:14:47.125 INFO:teuthology.orchestra.run.smithi135.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.45144.log.gz 2024-05-14T10:14:47.125 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36572.log 2024-05-14T10:14:47.125 INFO:teuthology.orchestra.run.smithi196.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36732.log.gz 2024-05-14T10:14:47.126 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-14T10:14:47.126 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36572.log: 88.0% 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz -- replaced with /var/log/ceph/ceph-client.admin.36572.log.gz 2024-05-14T10:14:47.126 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-05-14T10:14:47.127 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36490.log 2024-05-14T10:14:47.127 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.49177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42102.log 2024-05-14T10:14:47.127 INFO:teuthology.orchestra.run.smithi135.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49177.log.gz 2024-05-14T10:14:47.127 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44157.log 2024-05-14T10:14:47.128 INFO:teuthology.orchestra.run.smithi135.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48457.log.gz 2024-05-14T10:14:47.130 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.42102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48078.log 2024-05-14T10:14:47.130 INFO:teuthology.orchestra.run.smithi135.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42102.log.gz 2024-05-14T10:14:47.130 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42803.log 2024-05-14T10:14:47.130 INFO:teuthology.orchestra.run.smithi135.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44157.log.gz 2024-05-14T10:14:47.130 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41790.log 2024-05-14T10:14:47.130 INFO:teuthology.orchestra.run.smithi135.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48078.log.gz 2024-05-14T10:14:47.130 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-14T10:14:47.130 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.36490.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-14T10:14:47.131 INFO:teuthology.orchestra.run.smithi196.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36490.log.gz 2024-05-14T10:14:47.131 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-14T10:14:47.131 INFO:teuthology.orchestra.run.smithi196.stderr: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-14T10:14:47.132 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36530.log 2024-05-14T10:14:47.132 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36652.log 2024-05-14T10:14:47.133 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.42803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42270.log 2024-05-14T10:14:47.133 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.41790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47994.log 2024-05-14T10:14:47.133 INFO:teuthology.orchestra.run.smithi135.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.42803.log.gz 2024-05-14T10:14:47.133 INFO:teuthology.orchestra.run.smithi135.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41790.log.gz 2024-05-14T10:14:47.133 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.42270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45078.log 2024-05-14T10:14:47.133 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42270.log.gz 2024-05-14T10:14:47.134 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36530.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-14T10:14:47.135 INFO:teuthology.orchestra.run.smithi196.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36530.log.gz 2024-05-14T10:14:47.135 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.47994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43879.log 2024-05-14T10:14:47.135 INFO:teuthology.orchestra.run.smithi135.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47994.log.gz 2024-05-14T10:14:47.135 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36652.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36652.log.gz 2024-05-14T10:14:47.136 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.45078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42378.log 2024-05-14T10:14:47.136 INFO:teuthology.orchestra.run.smithi135.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.45078.log.gz 2024-05-14T10:14:47.136 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42312.log 2024-05-14T10:14:47.136 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43879.log.gz 2024-05-14T10:14:47.137 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-14T10:14:47.137 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mgr.x.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-14T10:14:47.137 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-05-14T10:14:47.138 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.42378.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-14T10:14:47.138 INFO:teuthology.orchestra.run.smithi135.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42378.log.gz 2024-05-14T10:14:47.138 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.42312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42000.log 2024-05-14T10:14:47.139 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-05-14T10:14:47.139 INFO:teuthology.orchestra.run.smithi135.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.42312.log.gz 2024-05-14T10:14:47.139 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30395.log 2024-05-14T10:14:47.140 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/valgrind/mon.b.log: 69.8% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-05-14T10:14:47.140 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.42000.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-14T10:14:47.140 INFO:teuthology.orchestra.run.smithi135.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42000.log.gz 2024-05-14T10:14:47.141 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.tmp-client.admin.30395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44154.log 2024-05-14T10:14:47.141 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30395.log.gz 2024-05-14T10:14:47.142 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/valgrind/mds.d.log: 57.4% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-05-14T10:14:47.142 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-05-14T10:14:47.142 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48120.log 2024-05-14T10:14:47.144 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-05-14T10:14:47.144 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44154.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44154.log.gz 2024-05-14T10:14:47.144 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47952.log 2024-05-14T10:14:47.144 INFO:teuthology.orchestra.run.smithi135.stderr: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-14T10:14:47.145 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44234.log 2024-05-14T10:14:47.145 INFO:teuthology.orchestra.run.smithi135.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48120.log.gz 2024-05-14T10:14:47.146 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/valgrind/mds.f.log: 67.8% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-05-14T10:14:47.146 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/valgrind/mon.c.log: 69.8% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-05-14T10:14:47.147 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.47952.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47952.log.gz 2024-05-14T10:14:47.147 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-14T10:14:47.147 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41704.log 2024-05-14T10:14:47.147 INFO:teuthology.orchestra.run.smithi135.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44234.log.gz 2024-05-14T10:14:47.147 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41520.log 2024-05-14T10:14:47.148 INFO:teuthology.orchestra.run.smithi135.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-14T10:14:47.148 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.41704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43248.log 2024-05-14T10:14:47.149 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41704.log.gz 2024-05-14T10:14:47.149 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-05-14T10:14:47.149 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-14T10:14:47.149 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/valgrind/mds.b.log: 57.4% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-05-14T10:14:47.150 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.41520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43584.log 2024-05-14T10:14:47.150 INFO:teuthology.orchestra.run.smithi135.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41520.log.gz 2024-05-14T10:14:47.150 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43248.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43248.log.gz 2024-05-14T10:14:47.151 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48865.log 2024-05-14T10:14:47.151 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44442.log 2024-05-14T10:14:47.151 INFO:teuthology.orchestra.run.smithi135.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43584.log.gz 2024-05-14T10:14:47.152 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48865.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-14T10:14:47.153 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36450.log 2024-05-14T10:14:47.154 INFO:teuthology.orchestra.run.smithi135.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48865.log.gz 2024-05-14T10:14:47.154 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44442.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44442.log.gz 2024-05-14T10:14:47.154 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49051.log 2024-05-14T10:14:47.155 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43710.log 2024-05-14T10:14:47.155 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36692.log 2024-05-14T10:14:47.156 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36450.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36450.log.gz 2024-05-14T10:14:47.156 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-14T10:14:47.156 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.49051.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49051.log.gz 2024-05-14T10:14:47.157 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41301.log 2024-05-14T10:14:47.157 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48415.log 2024-05-14T10:14:47.158 INFO:teuthology.orchestra.run.smithi196.stderr:gzip/var/log/ceph/ceph-client.admin.36692.log: -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-14T10:14:47.158 INFO:teuthology.orchestra.run.smithi135.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43710.log.gz 2024-05-14T10:14:47.158 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.41301.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41301.log.gz 2024-05-14T10:14:47.159 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48499.log 2024-05-14T10:14:47.159 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48949.log 2024-05-14T10:14:47.160 INFO:teuthology.orchestra.run.smithi135.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48415.log.gz 2024-05-14T10:14:47.160 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48499.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48499.log.gz 2024-05-14T10:14:47.161 INFO:teuthology.orchestra.run.smithi196.stderr: 88.4%/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: -- replaced with /var/log/ceph/ceph-client.admin.36692.log.gz 2024-05-14T10:14:47.161 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43878.log 2024-05-14T10:14:47.162 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48739.log 2024-05-14T10:14:47.162 INFO:teuthology.orchestra.run.smithi135.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48949.log.gz 2024-05-14T10:14:47.162 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43878.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43878.log.gz 2024-05-14T10:14:47.162 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-14T10:14:47.163 INFO:teuthology.orchestra.run.smithi196.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-14T10:14:47.164 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43304.log 2024-05-14T10:14:47.164 INFO:teuthology.orchestra.run.smithi135.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48739.log.gz 2024-05-14T10:14:47.165 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44844.log 2024-05-14T10:14:47.167 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43304.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-14T10:14:47.167 INFO:teuthology.orchestra.run.smithi135.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43304.log.gz 2024-05-14T10:14:47.167 INFO:teuthology.orchestra.run.smithi196.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-14T10:14:47.168 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44844.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-14T10:14:47.168 INFO:teuthology.orchestra.run.smithi135.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44844.log.gz 2024-05-14T10:14:47.169 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43668.log 2024-05-14T10:14:47.170 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-14T10:14:47.172 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43028.log 2024-05-14T10:14:47.172 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43668.log.gz 2024-05-14T10:14:47.172 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-14T10:14:47.173 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43401.log 2024-05-14T10:14:47.175 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45012.log 2024-05-14T10:14:47.175 INFO:teuthology.orchestra.run.smithi135.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43028.log.gz 2024-05-14T10:14:47.176 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41565.log 2024-05-14T10:14:47.176 INFO:teuthology.orchestra.run.smithi135.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43401.log.gz 2024-05-14T10:14:47.178 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.45012.log: 91.1%/var/log/ceph/ceph-client.admin.41565.log: -- replaced with /var/log/ceph/ceph-client.admin.45012.log.gz 2024-05-14T10:14:47.179 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose 87.9% -- /var/log/ceph/ceph-client.admin.48288.log 2024-05-14T10:14:47.179 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41565.log.gz 2024-05-14T10:14:47.180 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43447.log 2024-05-14T10:14:47.182 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48991.log 2024-05-14T10:14:47.182 INFO:teuthology.orchestra.run.smithi135.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48288.log.gz 2024-05-14T10:14:47.183 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43447.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43447.log.gz 2024-05-14T10:14:47.184 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41958.log 2024-05-14T10:14:47.184 INFO:teuthology.orchestra.run.smithi135.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48991.log.gz 2024-05-14T10:14:47.185 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48605.log 2024-05-14T10:14:47.186 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.41958.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-05-14T10:14:47.186 INFO:teuthology.orchestra.run.smithi135.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41958.log.gz 2024-05-14T10:14:47.188 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48605.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-05-14T10:14:47.188 INFO:teuthology.orchestra.run.smithi135.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48605.log.gz 2024-05-14T10:14:47.189 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/valgrind/mds.e.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-05-14T10:14:47.191 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/valgrind/mon.a.log: 69.9% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-05-14T10:14:47.191 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-05-14T10:14:47.192 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-05-14T10:14:47.193 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 57.3% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-05-14T10:14:47.194 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-05-14T10:14:47.194 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/valgrind/client.0.log: 76.5% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-05-14T10:14:47.195 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48162.log 2024-05-14T10:14:47.196 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49093.log 2024-05-14T10:14:47.196 INFO:teuthology.orchestra.run.smithi135.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-05-14T10:14:47.198 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48560.log 2024-05-14T10:14:47.198 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48162.log.gz 2024-05-14T10:14:47.198 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.49093.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49093.log.gz 2024-05-14T10:14:47.199 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43086.log 2024-05-14T10:14:47.200 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48907.log 2024-05-14T10:14:47.200 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48560.log.gz 2024-05-14T10:14:47.202 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44802.log 2024-05-14T10:14:47.202 INFO:teuthology.orchestra.run.smithi135.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43086.log.gz 2024-05-14T10:14:47.203 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48907.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48907.log.gz 2024-05-14T10:14:47.204 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43892.log 2024-05-14T10:14:47.204 INFO:teuthology.orchestra.run.smithi135.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44802.log.gz 2024-05-14T10:14:47.205 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-14T10:14:47.207 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41832.log 2024-05-14T10:14:47.207 INFO:teuthology.orchestra.run.smithi135.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43892.log.gz 2024-05-14T10:14:47.209 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44553.log 2024-05-14T10:14:47.211 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.41832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43542.log 2024-05-14T10:14:47.211 INFO:teuthology.orchestra.run.smithi135.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41832.log.gz 2024-05-14T10:14:47.212 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44553.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44553.log.gz 2024-05-14T10:14:47.213 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43891.log 2024-05-14T10:14:47.215 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43542.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43542.log.gz 2024-05-14T10:14:47.216 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43891.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43891.log.gz 2024-05-14T10:14:47.216 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48331.log 2024-05-14T10:14:47.218 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44192.log 2024-05-14T10:14:47.219 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48331.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48331.log.gz 2024-05-14T10:14:47.220 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44192.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44192.log.gz 2024-05-14T10:14:47.221 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36408.log 2024-05-14T10:14:47.222 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47868.log 2024-05-14T10:14:47.224 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36408.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.36408.log.gz 2024-05-14T10:14:47.225 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.47868.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47868.log.gz 2024-05-14T10:14:47.225 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44246.log 2024-05-14T10:14:47.227 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43880.log 2024-05-14T10:14:47.228 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44246.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44246.log.gz 2024-05-14T10:14:47.230 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43880.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43880.log.gz 2024-05-14T10:14:47.230 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44233.log 2024-05-14T10:14:47.232 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45699.log 2024-05-14T10:14:47.233 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44233.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44233.log.gz 2024-05-14T10:14:47.236 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.0.45699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44718.log 2024-05-14T10:14:47.238 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48204.log 2024-05-14T10:14:47.239 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44718.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44718.log.gz 2024-05-14T10:14:47.239 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48036.log 2024-05-14T10:14:47.241 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36772.log 2024-05-14T10:14:47.244 INFO:teuthology.orchestra.run.smithi135.stderr: 87.5%/var/log/ceph/ceph-client.admin.48036.log: -- replaced with /var/log/ceph/ceph-client.admin.48204.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43350.log 2024-05-14T10:14:47.245 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36772.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36772.log.gz 2024-05-14T10:14:47.246 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-05-14T10:14:47.247 INFO:teuthology.orchestra.run.smithi135.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48036.log.gz 2024-05-14T10:14:47.248 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41405.log 2024-05-14T10:14:47.252 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43350.log: /var/log/ceph/ceph-client.admin.41405.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43350.log.gz 2024-05-14T10:14:47.253 INFO:teuthology.orchestra.run.smithi135.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-05-14T10:14:47.253 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41405.log.gz 2024-05-14T10:14:47.256 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47668.log 2024-05-14T10:14:47.258 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43164.log 2024-05-14T10:14:47.261 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.47668.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47668.log.gz 2024-05-14T10:14:47.263 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44928.log 2024-05-14T10:14:47.264 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43164.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43164.log.gz 2024-05-14T10:14:47.265 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43497.log 2024-05-14T10:14:47.267 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44928.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44928.log.gz 2024-05-14T10:14:47.272 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42186.log 2024-05-14T10:14:47.272 INFO:teuthology.orchestra.run.smithi135.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43497.log.gz 2024-05-14T10:14:47.273 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42144.log 2024-05-14T10:14:47.275 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.42186.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42186.log.gz 2024-05-14T10:14:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.42144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44074.log 2024-05-14T10:14:47.278 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42144.log.gz 2024-05-14T10:14:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44184.log 2024-05-14T10:14:47.284 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44074.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44074.log.gz 2024-05-14T10:14:47.289 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44760.log 2024-05-14T10:14:47.289 INFO:teuthology.orchestra.run.smithi135.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44184.log.gz 2024-05-14T10:14:47.290 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45290.log 2024-05-14T10:14:47.292 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44760.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44760.log.gz 2024-05-14T10:14:47.295 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48373.log 2024-05-14T10:14:47.296 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.45290.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45290.log.gz 2024-05-14T10:14:47.298 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44587.log 2024-05-14T10:14:47.299 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48373.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48373.log.gz 2024-05-14T10:14:47.301 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44598.log 2024-05-14T10:14:47.301 INFO:teuthology.orchestra.run.smithi135.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44587.log.gz 2024-05-14T10:14:47.304 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43206.log 2024-05-14T10:14:47.306 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44598.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44598.log.gz 2024-05-14T10:14:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43206.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43206.log.gz 2024-05-14T10:14:47.310 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43890.log 2024-05-14T10:14:47.314 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48246.log 2024-05-14T10:14:47.316 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43890.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43890.log.gz 2024-05-14T10:14:47.318 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44422.log 2024-05-14T10:14:47.320 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48246.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48246.log.gz 2024-05-14T10:14:47.321 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-14T10:14:47.325 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44422.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43881.log 2024-05-14T10:14:47.328 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.43881.log: -- replaced with /var/log/ceph/ceph-client.admin.44422.log.gz 2024-05-14T10:14:47.328 INFO:teuthology.orchestra.run.smithi135.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43881.log.gz 2024-05-14T10:14:47.330 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41874.log 2024-05-14T10:14:47.333 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44604.log 2024-05-14T10:14:47.337 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.41874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44970.log 2024-05-14T10:14:47.337 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44604.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41874.log.gz 2024-05-14T10:14:47.338 INFO:teuthology.orchestra.run.smithi135.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44604.log.gz 2024-05-14T10:14:47.341 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44886.log 2024-05-14T10:14:47.342 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44492.log 2024-05-14T10:14:47.342 INFO:teuthology.orchestra.run.smithi135.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44970.log.gz 2024-05-14T10:14:47.343 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44886.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44886.log.gz 2024-05-14T10:14:47.349 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48783.log 2024-05-14T10:14:47.350 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.44492.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44492.log.gz 2024-05-14T10:14:47.351 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47726.log 2024-05-14T10:14:47.353 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48783.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48783.log.gz 2024-05-14T10:14:47.353 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48654.log 2024-05-14T10:14:47.355 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.47726.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47726.log.gz 2024-05-14T10:14:47.359 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.48654.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48654.log.gz 2024-05-14T10:14:47.361 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47910.log 2024-05-14T10:14:47.363 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49135.log 2024-05-14T10:14:47.365 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.47910.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47910.log.gz 2024-05-14T10:14:47.366 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43889.log 2024-05-14T10:14:47.368 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.49135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42228.log 2024-05-14T10:14:47.371 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.43889.log: 88.6% 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43889.log.gz 2024-05-14T10:14:47.372 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49135.log.gz 2024-05-14T10:14:47.374 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.42228.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42228.log.gz 2024-05-14T10:14:47.413 INFO:teuthology.orchestra.run.smithi135.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-05-14T10:14:47.487 INFO:teuthology.orchestra.run.smithi135.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-14T10:14:47.495 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-14T10:14:47.620 INFO:teuthology.orchestra.run.smithi196.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-14T10:14:47.719 INFO:teuthology.orchestra.run.smithi196.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-14T10:14:48.761 INFO:teuthology.orchestra.run.smithi135.stderr: 89.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-14T10:14:49.261 INFO:teuthology.orchestra.run.smithi196.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-14T10:14:49.502 INFO:teuthology.orchestra.run.smithi135.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-14T10:14:49.590 INFO:teuthology.orchestra.run.smithi135.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-14T10:14:49.762 INFO:teuthology.orchestra.run.smithi196.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-14T10:14:50.180 INFO:teuthology.orchestra.run.smithi196.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-14T10:14:50.217 INFO:teuthology.orchestra.run.smithi135.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-14T10:14:50.580 INFO:teuthology.orchestra.run.smithi196.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-14T10:14:50.662 INFO:teuthology.orchestra.run.smithi135.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-14T10:14:52.540 INFO:teuthology.orchestra.run.smithi135.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.45699.log.gz 2024-05-14T10:14:52.545 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-05-14T10:14:52.545 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m5.461s 2024-05-14T10:14:52.545 INFO:teuthology.orchestra.run.smithi135.stderr:user 0m17.435s 2024-05-14T10:14:52.545 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m1.645s 2024-05-14T10:14:56.652 INFO:teuthology.orchestra.run.smithi196.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-05-14T10:14:56.656 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-05-14T10:14:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:real 0m9.568s 2024-05-14T10:14:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:user 0m20.315s 2024-05-14T10:14:56.656 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m1.595s 2024-05-14T10:14:56.657 INFO:tasks.ceph:Archiving logs... 2024-05-14T10:14:56.657 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681/remote/smithi135/log 2024-05-14T10:14:56.658 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T10:14:59.183 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681/remote/smithi196/log 2024-05-14T10:14:59.184 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T10:15:02.079 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-05-14T10:15:02.080 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-14T10:15:02.088 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-05-14T10:15:02.089 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-14T10:15:02.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T10:15:02.097 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T10:15:02.247 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-14T10:15:02.256 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-14T10:15:02.256 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T10:15:02.264 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T10:15:02.311 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-05-14T10:15:02.317 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-05-14T10:15:02.321 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T10:15:02.322 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-14T10:15:02.322 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 7 377 65 +1121us[+1125us] +/- 59ms 2024-05-14T10:15:02.322 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 66 -775us[ -770us] +/- 73ms 2024-05-14T10:15:02.322 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -578us[ -578us] +/- 80ms 2024-05-14T10:15:02.322 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T10:15:02.327 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T10:15:02.327 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-05-14T10:15:02.327 INFO:teuthology.orchestra.run.smithi196.stdout:^* hv01.front.sepia.ceph.com 3 7 377 127 +1033us[+1045us] +/- 59ms 2024-05-14T10:15:02.327 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 62 -841us[ -841us] +/- 74ms 2024-05-14T10:15:02.327 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 67 -598us[ -598us] +/- 79ms 2024-05-14T10:15:02.327 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T10:15:02.328 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-14T10:15:02.338 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-14T10:15:02.338 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-14T10:15:02.346 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T10:15:02.515 DEBUG:teuthology.orchestra.run.smithi196:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T10:15:02.707 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T10:15:02.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:15:02.799 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T10:15:02.892 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:15:02.892 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-14T10:15:02.902 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-14T10:15:02.911 INFO:teuthology.task.internal:Duration was 3091.878389 seconds 2024-05-14T10:15:02.911 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-14T10:15:02.920 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-14T10:15:02.920 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T10:15:02.927 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T10:15:03.060 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T10:15:03.069 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T10:15:03.517 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-14T10:15:03.517 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-05-14T10:15:03.517 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T10:15:03.577 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-05-14T10:15:03.577 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T10:15:03.651 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-14T10:15:03.651 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T10:15:03.658 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T10:15:03.740 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-14T10:15:03.740 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T10:15:03.746 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T10:15:03.930 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-14T10:15:03.941 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-14T10:15:03.941 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T10:15:04.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T10:15:04.112 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-14T10:15:04.122 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T10:15:04.130 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T10:15:04.223 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-05-14T10:15:04.224 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-05-14T10:15:04.268 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T10:15:04.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:15:04.317 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T10:15:04.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T10:15:04.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-14T10:15:04.382 INFO:teuthology.task.internal:Transferring archived files... 2024-05-14T10:15:04.383 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681/remote/smithi135 2024-05-14T10:15:04.383 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T10:15:04.480 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681/remote/smithi196 2024-05-14T10:15:04.480 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T10:15:04.578 INFO:teuthology.task.internal:Removing archive directory... 2024-05-14T10:15:04.578 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T10:15:04.586 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T10:15:04.642 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-14T10:15:04.653 INFO:teuthology.task.internal:Not uploading archives. 2024-05-14T10:15:04.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-14T10:15:04.663 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-14T10:15:04.663 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T10:15:04.669 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T10:15:04.718 INFO:teuthology.orchestra.run.smithi135.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 10:15 /home/ubuntu/cephtest 2024-05-14T10:15:04.723 INFO:teuthology.orchestra.run.smithi196.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 10:15 /home/ubuntu/cephtest 2024-05-14T10:15:04.726 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-14T10:15:04.761 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-14T10:15:04.772 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-05-14T10:15:04.772 INFO:teuthology.nuke:Checking targets against current locks 2024-05-14T10:15:04.799 DEBUG:teuthology.nuke:shortname: smithi135 2024-05-14T10:15:04.799 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T10:15:04.824 DEBUG:teuthology.nuke:shortname: smithi196 2024-05-14T10:15:04.825 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T10:15:04.828 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 09:14:12.406492', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIPdqmRcfkAd8InfGtLXOKFfEPYARVHKrYuYM0eW2pW7fKonJ75X8tAReGE68/ACIBchR2/DXapwr3ZLSmNmi0='} 2024-05-14T10:15:04.852 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705681', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 09:14:12.404503', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIZsn4PaLA5f0ZhIB56Idv0+jgfWuLQa+HklIyQYCqxiE/mjddYUvqk3d4GBzUTabTrwiGivMcyAAl1zC4jrAw='} 2024-05-14T10:15:04.869 INFO:teuthology.orchestra.console.smithi135:Power off 2024-05-14T10:15:04.869 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T10:15:04.893 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2024-05-14T10:15:04.893 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:15:04.907 INFO:teuthology.orchestra.console.smithi196:Power off 2024-05-14T10:15:04.907 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T10:15:04.915 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-05-14T10:15:04.928 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-05-14T10:15:04.929 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:15:04.949 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-05-14T10:15:08.915 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:15:08.950 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:15:09.026 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-05-14T10:15:09.060 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-05-14T10:15:13.029 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:15:13.061 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:15:13.139 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2024-05-14T10:15:13.170 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-05-14T10:15:13.271 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-05-14T10:15:17.141 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T10:15:17.252 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2024-05-14T10:15:17.352 INFO:teuthology.orchestra.console.smithi135:Power off completed 2024-05-14T10:15:17.456 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/valgrind} duration: 3091.878389120102 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default mon.a-kernel-sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e mon.b-kernel-sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e owner: scheduled_vshankar@teuthology status: fail success: false 2024-05-14T10:15:17.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T10:15:17.553 INFO:teuthology.run:FAIL